> For the complete documentation index, see [llms.txt](https://docs.bdb.ai/data-science-lab-6/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.bdb.ai/data-science-lab-6/tabs-for-a-dsl-project/data/adding-data.md).

# Adding Data

This page describes the steps to add data to your DSL project.

## Adding Data Sets

{% hint style="warning" %}
*<mark style="color:orange;">**Pre-requisites:**</mark>*&#x20;

* *The users must have permission to access the **Data Center** module of the Platform.*&#x20;
* *The users must have the required data sets listed under the **Data Center** module.*
  {% endhint %}

{% hint style="success" %}
*Check out the illustration to understand the steps for adding Datasets to a DSL Project.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fz33KQNYQvBTgQKJBgwTz%2Fuploads%2FrVkBjqYeGbQRlqpbDfmy%2FAdding%20Datasets.mp4?alt=media&token=7d8ac8bc-0bd9-4bd3-be92-527fa7114713>" %}
***Adding Datasets to a DSL Project***
{% endembed %}

* Open a Project.&#x20;
* Click the ***Data*** tab to open it.
* Click the ***Add Data*** option from the ***Data*** tab.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/RHo4XoBnmPMC08QzBcva/image.png" alt=""><figcaption></figcaption></figure>

* The ***Add Data*** page opens offering two options to choose data:
  * Data service (the default selection)
  * Data Sandbox Files
  * Feature Stores
* Go ahead with the ***Data Sets*** option from the ***Data Source*** drop-down menu.
* Use the ***Search*** space to search through the displayed data service list.
* Select the required data set(s) using the checkboxes provided next to it.
* Click the ***Add*** option.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/90xFsV8rcjsUas1tGOyD/image.png" alt=""><figcaption></figcaption></figure>

* The selected data set(s) gets added to the concerned project.
* A notification message appears to inform the same.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/9s3fCTpdlPoHhcozv1m3/image.png" alt=""><figcaption></figcaption></figure>

## Uploading and Adding Data Sandbox Files

{% hint style="warning" %}
*<mark style="color:orange;">**Pre-requite:**</mark> The user must configure the **Sandbox Settings** to access the Data Sandbox option under the **Data Science Lab**.*
{% endhint %}

{% hint style="success" %}
*Check out the illustration to understand the steps for uploading and adding Datasandbox to a DSL Project.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fz33KQNYQvBTgQKJBgwTz%2Fuploads%2FCzd8ISouybzGdr1e1T4D%2FUploading%20and%20Adding%20Data%20Sandbox.mp4?alt=media&token=b8e4f2ae-b005-4d00-905a-8fc7918f5511>" %}
***Uploading and Adding Data Sandbox Files***
{% endembed %}

### Uploading a Data Sandbox

* Open a DSL Project.
* Click on the ***Data*** tab.
* Click the ***Add Data*** option.&#x20;

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/CeLvIlgPKVW8seqySOek/image.png" alt=""><figcaption></figcaption></figure>

* The user gets redirected to the ***Add Data*** page.
* Select the ***Data Sandbox*** option from the Data Source drop-down menu.&#x20;
* Click the ***Upload*** option to upload a Data Sandbox file.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/g6D1vwwABNJUZMVCmkMi/image.png" alt=""><figcaption></figcaption></figure>

* The user gets redirected to the ***Upload Data Sandbox*** page.
* Provide a ***Sandbox Name***.
* Provide a ***Description*** of the Data Sandbox.
* Click the ***Choose File*** option to select a file.
* Choose a file from your system and upload it. The supported files are

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/Kt7CK3DumKnhDtYGRz2o/image.png" alt=""><figcaption></figcaption></figure>

* Click the ***Save*** option to begin the file upload.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/jcgivjDycU8jUwfq3tNd/image.png" alt=""><figcaption></figcaption></figure>

* Wait till the uploaded file gets loaded 100%.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/XLAPRoiMEmbm2KTFko4W/image.png" alt=""><figcaption></figcaption></figure>

* The uploaded sandbox file gets added under the ***Add Datasets*** page.
* A notification message appears to indicate that the file has been uploaded.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/bncDiXkhXCFauiEqjZAB/image.png" alt=""><figcaption></figcaption></figure>

### Adding Data Sandbox files

* The user gets redirected to the ***Add Data*** page.
* Select the ***Data Sandbox*** option from the ***Data Source*** drop-down menu.
* Use the search space to search a specific data sandbox.
* Select Data Sandbox files using the checkbox given next to the Sandbox entry (The uploaded Data Sandbox file appears at the top of the list).&#x20;
* Click the ***Add*** option that appears after selecting the uploaded Sandbox file.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/kcDmnqD5XgSKhTRAFJvF/image.png" alt=""><figcaption></figcaption></figure>

* The user gets redirected to the ***Dataset*** tab where the added dataset file gets listed.
* A notification message appears to inform that the selected Dataset (in this case, the selected Data Sandbox file) has been updated.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/JRlXeyp4uXlYSwEFl9kY/image.png" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
*<mark style="color:green;">Please Note:</mark> The users get a **search bar** to search across the multiple Datasets options on the **Add Datasets** page.*
{% endhint %}

## Adding Feature Stores

{% hint style="success" %}
*Check out the illustration to understand the steps for adding Feature Stores to a DSL Project.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2Fc5JcR0X4ppbLOKMnYKOO%2FAdding%20Feature%20Stores.mp4?alt=media&token=c8e36e3b-2ec4-4a0c-9b86-90bb901b87cd>" %}
***Adding Feature Stores to a DSL Project***
{% endembed %}

* Navigate to a DSL Project.
* Click the ***Data*** tab to open it.
* Click the ***Add Data*** option from the ***Data*** tab.

<figure><img src="https://content.gitbook.com/content/28ipFzCz8EMtVtHrBFLx/blobs/mRgzsqMbDwHhc1ziWS23/image.png" alt=""><figcaption></figcaption></figure>

* The ***Add Data*** page opens offering three options to choose data.
* Select the ***Feature Stores*** option from the Data Source drop-down menu.
* Use the ***Search*** space to search through the displayed data service list.
* Select the required feature store(s) using the checkboxes provided next to it.
* Click the ***Add*** option.&#x20;

  <figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FSQEvYsDDtr3OvI57kufY%2Fimage.png?alt=media&amp;token=e3ff00a7-7466-432c-9925-6c774a24e06e" alt=""><figcaption></figcaption></figure>
* A notification message appears to inform the same.&#x20;

  <figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FDagNmF6pPs8b06pLfA32%2Fimage.png?alt=media&amp;token=2dfc69cd-c4f7-4752-bab2-56b7b2502e8f" alt=""><figcaption></figcaption></figure>
* The selected feature store(s) gets added to the concerned project.&#x20;

  <figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2F7VZFAfdjCTaBvB7uwMSU%2Fimage.png?alt=media&amp;token=b72cd37f-d319-484c-9449-33efbdb8622b" alt=""><figcaption></figcaption></figure>

### Adding a Feature Store with Data Preparation

{% hint style="success" %}
*Check out the illustration to understand adding a Feature Store with Data Preparation.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2Fim8YyTYXsjkpRSEh7XZJ%2FData%20Preparation_in%20feature%20store.mp4?alt=media&token=0cfbb616-c877-4676-acf7-b7582c2c9ad0>" %}
***Data Preparation in a Feature Store***
{% endembed %}

* Navigate to the ***Data Science Lab*** module.
* Click the ***Create*** option provided for the Feature Store.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FdVJ4aSrmGUNag0Xd4J4y%2Fimage.png?alt=media&amp;token=a38fb124-5ed8-4c16-8a37-a0bc7a9c75d4" alt=""><figcaption></figcaption></figure>

* The ***Create Feature Store*** page opens.
* Provide a name to the Feature Set.
* Select a connector from the drop-down menu.
* Select a query from the table info. / Metadata list or write an SQL Query.
* Click the ***Validate*** option.
* A notification message ensures that the query is validated.
* The ***Preview*** of the data appears below.
* Click the ***Data Prep*** option.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FXWo4q7vsvxPIqZqd5r8n%2Fimage.png?alt=media&amp;token=63a41151-9d7a-438a-9b0d-7a95ead99029" alt=""><figcaption></figcaption></figure>

* The user gets redirected to the Data Preparation page.&#x20;

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FsyS0e5zjsEFMzWueRQjD%2Fimage.png?alt=media&amp;token=3d5082f2-a67e-4c67-83ce-d8204f4dade1" alt=""><figcaption></figcaption></figure>

* Navigate to the ***Transforms*** tab.
* Choose a transform from the list. Here, the Label Encoding transform is selected from the ML category.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2F7gp1gT2mxSu4dKdk5pPO%2Fimage.png?alt=media&amp;token=902de93d-ff0b-4801-a17a-5576d7194dce" alt=""><figcaption></figcaption></figure>

* A warning appears to remind the users that if the SQL query is changed, the applied data preparations or transformations will be lost.
* The ***Data Prep*** option will have a green mark suggesting that the Data Preparation is applied to the selected Feature Store.
* Click the ***Create*** option.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FsvJMPnNVi45PrpAn4UWY%2Fimage.png?alt=media&amp;token=be787994-d78a-44cd-a533-fd4eb442588a" alt=""><figcaption></figcaption></figure>

* A notification ensures that the Feature store job is initiated.&#x20;

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FG3KIAeliTgEdPELmQzcD%2Fimage.png?alt=media&amp;token=10444244-cf1e-4d8d-a1ba-24c2335f0058" alt=""><figcaption></figcaption></figure>

* The user gets redirected to the Feature Stores page.
* The newly created feature store gets added at the top of the list.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2F7CEzFn5AlWWlET31nQz1%2Fimage.png?alt=media&amp;token=14a961c0-a1ef-4c16-b5ae-62fb9c4fa172" alt=""><figcaption></figcaption></figure>

* Open a Project.
* The ***Workspace*** tab opens by default.
* Open the ***Data*** tab.
* &#x20;Click the ***Add Data*** icon.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FxtUH3f7XMFcMwZ9m7c1C%2Fimage.png?alt=media&amp;token=71a64dd7-317e-435f-b26f-669442e384e2" alt=""><figcaption></figcaption></figure>

* The ***Add Data*** page opens.
* Select Feature Stores as an option using the ***Data Source*** filter menu.
* The list of the available Feature Stores will be listed.
* Select a feature store using the checkbox.
* Click the ***Add*** option.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2Fu608LObRGK4sSwRvxqgu%2Fimage.png?alt=media&amp;token=b394c28a-cecc-4f75-ac4f-003349b55acb" alt=""><figcaption></figcaption></figure>

* A notification appears stating that the feature store has been added.
* The recently added feature store appears under the Data section of the selected project.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FVvmukOlobPwVdnONdGay%2Fimage.png?alt=media&amp;token=2db267b0-5185-4152-b220-e1bb22b464f3" alt=""><figcaption></figcaption></figure>

* Add a new code cell and put a checkmark in the given checkbox next to the recently added Feature Store as data for the project.
* The Data gets loaded in the code cell.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FKjrzbp3aDnldMXvtcKQt%2Fimage.png?alt=media&amp;token=5cc64e5b-5687-44c6-b97d-70f3ac92066e" alt=""><figcaption></figcaption></figure>

* Run the code cell with the loaded feature store.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2F45VM2lMHQp7e7G8dEPQ8%2Fimage.png?alt=media&amp;token=25ee0edc-7ffe-4976-8b01-9ae5db5a8fba" alt=""><figcaption></figcaption></figure>

* The data preview appears below the code cell.

<figure><img src="https://1760649651-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F28ipFzCz8EMtVtHrBFLx%2Fuploads%2FtOZwh1e0YSvqcWwwavYi%2Fimage.png?alt=media&amp;token=9c8b9231-78a3-4355-9743-06ffd6c4e3f6" alt=""><figcaption></figcaption></figure>
