My Connectors: Data Flow Initiation and Management

This page is the crucial starting point for data flow, enabling users to connect to external data sources and build the necessary data objects for downstream analytics and consumption.

The My Connectors page is the foundational interface for establishing the platform's data ecosystem. It functions as the initial entry point for all data ingestion, enabling users to link the system to a wide variety of external data sources.

By successfully integrating these diverse sources, this page facilitates the upstream creation of essential data objects (including datasets, views, and data forms). This critical process ensures that the resulting structured information is immediately available and optimized for consumption by all downstream analytics and visualization components across the platform's various modules.

Data Connector Creation and Lifecycle

The process of initiating data flow begins with the creation of your first Data Connector, which follows these key steps:

  1. Connector Initiation: The user begins the data integration process directly on the My Connectors page.

  2. Completion and Standardization: Upon successful configuration and completion, the new Data Connector is automatically added to the Standard Connectors list.

  3. Lifecycle Management: Once standardized, each Data Connector becomes an asset credited with multiple administrative and operational actions (e.g., editing credentials, refreshing schema, or managing access rights).

The subsequent sections of this documentation will detail the step-by-step process of Data Connector creation and the complete guide to managing the lifecycle of a Standard Data Connector.

Overview of the My Connectors Page

On the My Connectors page, the following objects are displayed:

  1. Connector List: A list of all available connectors, including details such as the connector name and the data source type (e.g., ClickHouse, MySQL, Google Sheets). This list helps users navigate and manage the various data sources they have connected.

  2. Search Bar: A search field to quickly find a specific connector by name or other relevant information.

  3. Create Button: A button that allows users to create new data connectors. When clicked, this button reveals a selection of options for beginning the creation flow:

    • Data Store Metadata

    • Data Sheet

    • Data Sandbox These options guide users in setting up new connectors based on their needs.

  4. Filters: A filter option that helps users narrow down the list of connectors based on specific criteria, such as data source type or other connector attributes.

  5. Connector Information: When a connector is selected, detailed information is shown on the right side of the page. This includes:

    • Name: The name of the connector.

    • Data Source Type: The type of the data source (e.g., ClickHouse, MySQL).

    • Database: The database associated with the connector.

    • Description: A description or additional details about the connector.

  6. Tabs: These tabs allow users to navigate between different sections related to the selected connector:

    • Data Set: Displays associated data sets for the selected connector.

    • Table: Shows tables available for use with the connector.

    • Function: If applicable, lists available functions related to the connector.

    • Feature Store: Provides access to the feature store for machine learning tasks.

    • Data as API: Allows users to expose data as an API.

    • Data Forms: For managing data input forms associated with the connector.

  7. Data Sets: Below the tabs, users can view the data sets linked to the selected connector. Users can also create new data sets related to the connector.

  8. Settings and Options: Options to manage, edit, or delete the connectors and their associated data sets. These are accessible via ellipses (three dots) next to each item in the list.

These objects provide a streamlined interface for managing data connectors, data sets, and related resources within the platform.

Last updated