> For the complete documentation index, see [llms.txt](https://docs.bdb.ai/data-science-lab-4/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.bdb.ai/data-science-lab-4/repo-sync-project/tabs-for-a-data-science-lab-project/tabs-for-pyspark-environment/dataset/dataset-list-page/data-preparation.md).

# Data Preparation

Data preparation is the process of collecting, cleaning, and transforming raw data into a format that can be easily analyzed and used for various applications.

Data Preparation involves gathering, refining, and converting raw data is a critical step in data analysis and machine learning, as the quality and accuracy of the data used directly impact the accuracy and reliability of the results. The data preparation is to ensure that the data is accurate, complete, consistent, and relevant to the analysis. By using this action, the data scientist can make more informed decisions, extract valuable insights, and unveil concealed trends and patterns within the raw data.

{% hint style="info" %}
*<mark style="color:green;">Please Note:</mark> The **BDB Data Science Lab** provides the **Data Preparation** icon on the **Dataset List page** to instantly access the Data Preparation framework.*
{% endhint %}

{% hint style="success" %}
*Go through the given illustration on how to access the Data Preparation framework from the **Dataset List** page.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FHWxol99l5NvooBpmKUw5%2FData%20Preparation%20option%20for%20an%20added%20Dataset.mp4?alt=media&token=c9cad016-bb5c-4266-9283-eb86e829c39c>" %}
***Accessing Data Preparation Framework***
{% endembed %}

* Navigate to the ***Dataset list*** page.
* Select a Dataset from the list.
* Click the ***Data Preparation*** icon.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FYXffbP8i3QcIq0SvedYf%2Fimage.png?alt=media&amp;token=9ea2d85e-b5b0-4885-87d4-c3096dd3c25d" alt=""><figcaption><p><em><strong>Data Preparation icon for a Dataset</strong></em></p></figcaption></figure>

* The ***Data Preparation*** page opens displaying the dataset in the grid format.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FHUFsyAVKTkUwaHARwdNg%2Fimage.png?alt=media&amp;token=4348ccbd-a7a8-4fef-906c-e8ee116df170" alt=""><figcaption></figcaption></figure>

* Open the ***Transforms*** tab to get the list of the Data Transforms.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FB7H3yi9fOs7SvprZYi9q%2Fimage.png?alt=media&amp;token=5dc1f4f3-142c-4370-ab21-77886a0c168c" alt=""><figcaption></figcaption></figure>

* Apply the required transforms on the data set. E.g., ***Auto Prep*** option is applied on the displayed Dataset (The user can also use any transformation using the ***Transforms*** tab).
  * Click the Auto Prep option.
  * The Transformation List appears with the pre-selected transforms, modify the selection.
  * Click the ***Proceed*** option.
* Provide a name for the ***Data Preparation***.
* Click the ***Back*** icon to go back.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FxNJWivUPL8agUnkyZAdI%2Fimage.png?alt=media&amp;token=b2dd543c-74e6-48d2-8365-6b1f67fd156d" alt=""><figcaption><p><em><strong>Applying Auto Prep Transforms and saving the Data Preparation</strong></em></p></figcaption></figure>

* While clicking the ***Back*** icon, a notification message appears to inform the users that the data preparation has been saved.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FJysVXr12rJEo9vrAszcq%2Fimage.png?alt=media&amp;token=3c4f9882-2ae9-4cf6-980e-a42a2ffa29b2" alt=""><figcaption><p><em><strong>Notification message while saving the Data Preparation</strong></em></p></figcaption></figure>

* The user gets redirected to the ***Dataset*** list page.&#x20;
* Select the ***Dataset*** for which the Preparation was saved.&#x20;
* Click the ***Data Preparation*** icon for the same Dataset.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FoJ1FWLvpW8KIzW5c65r8%2Fimage.png?alt=media&amp;token=28793094-aa26-40d5-8620-728813942964" alt=""><figcaption></figcaption></figure>

* While opening the Dataset it redirects to the ***Preparation List*** displaying the saved data preparation.
* Click the ***Create Preparation*** option to create a new Data Preparation.

<figure><img src="https://4082649235-files.gitbook.io/~/files/v0/b/gitbook-x-prod.appspot.com/o/spaces%2F1QeOywZjV1cHo55cMW8u%2Fuploads%2FjnhBeNK1dElgBlZOEWkx%2Fimage.png?alt=media&amp;token=97aa95ad-cead-4495-8a17-5863d18900b8" alt=""><figcaption></figcaption></figure>

{% hint style="info" %}
*<mark style="color:green;">Please Note</mark>:*&#x20;

* *The details on how to use the Data Preparation option are described in the **Data Preparation** section under the Data Center.*
* *Refer the* [***Data Science Lab Quick Start Flow***](https://docs.bdb.ai/data-science-lab-4/data-science-lab-quick-start-flow) *page to get an overview of the **Data Science Lab** module in nutshell.*&#x20;
  {% endhint %}