> For the complete documentation index, see [llms.txt](https://docs.bdb.ai/data-pipeline/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.bdb.ai/data-pipeline/getting-started/homepage/create-job/python-job.md).

# Python Job

This feature allows users to write their own Python script and run their script in the Jobs section of Data Pipeline module. 

Before creating the Python Job, the user has to create a project in the DS Lab module under Python Environment. Please refer the below image for reference: 

<figure><img src="/files/SATPyhb6nQqY2AtxEG9E" alt=""><figcaption></figcaption></figure>

After creating the project, the user needs to activate it and create a Notebook where they can write their own Python script. Once the script is written, the user must save it and export it to be able to use it in Python Jobs.

## **Creating a Python Job**

1. Click on the Data Pipeline module from the homepage.&#x20;
2. Click on the Create Job icon on the list pipeline page.&#x20;

<figure><img src="/files/yTOj6DlpwnMQg4BNdkDF" alt=""><figcaption></figcaption></figure>

3. The New Job dialog box appears redirecting the user to create a new Job.&#x20;
4. Enter a name for the new Job.&#x20;
5. Describe the Job (Optional).&#x20;
6. **Job Baseinfo:** Select Python Job from the drop-down.&#x20;
7. **Trigger By:** There are 2 options for triggering a job on success or failure of a job: \
   **Success Job:** On successful execution of the selected job the current job will be triggered.\
   **Failure Job:** On failure of the selected job the current job will be triggered.&#x20;
8. **Is Scheduled?**&#x20;
   * A job can be scheduled for a particular timestamp. Every time at the same timestamp the job will be triggered.&#x20;
   * Job must be scheduled according to UTC.&#x20;
9. **Docker Configuration**&#x20;
   * Select a resource allocation option using the radio button. The given choices are:&#x20;
     1. **Low**&#x20;
     2. **Medium**&#x20;
     3. **High**
   * Provide the resources required to run the python Job in the limit and Request section. \
     1\. **Limit:** Enter max CPU and Memory required for the Python Job. \
     2\. **Request:** Enter the CPU and Memory required for the job at the start.  \
     3\. **Instances:** Enter the number of instances for the Python Job. &#x20;
10. Click the ***Save*** option to save the Python Job.

<figure><img src="/files/gWluqNZUMLyTR08lKDxx" alt=""><figcaption><p>Creating a Python Job</p></figcaption></figure>

11. The Python Job gets saved, and it will redirect the user to the ***Job Editor*** workspace.&#x20;

<figure><img src="/files/89I5hxBDmi1f6R8VQKel" alt=""><figcaption></figcaption></figure>

{% hint style="success" %}
*Check out the below given demonstration configure a Python Job.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fuq3RSHHup7fjHYaspk7y%2Fuploads%2Fi0LgI9FzK7qAnGWv8kNU%2F2023-05-03-13-45-17%20(online-video-cutter.com).mp4?alt=media&token=fae4b373-a0e9-4bc7-8b59-0a8d770060ae>" %}
Configuring Python Job
{% endembed %}

## **Configuring the Meta information of Python Job**

Once the Python Job is created, follow the below given steps to configure the Meta Information tab of the Python Job.&#x20;

* **Project Name:** Select the same Project using the drop-down menu where the Notebook has been created.&#x20;
* **Script Name:** This field will list the exported Notebook names which are exported from the Data Science Lab module to Data Pipeline.&#x20;
* **External Library:** If any external libraries are used in the script the user can mention it here. The user can mention multiple libraries by giving comma (,) in between the names.&#x20;
* **Start Function:** Select the function name in which the script has been written.&#x20;
* **Script:** The Exported script appears under this space.&#x20;
* **Input Data:** If any parameter has been given in the function, then the name of the parameter is provided as Key, and value of the parameters has to be provided as value in this field. &#x20;

<figure><img src="/files/SsoPwk47L4LBiZuF5iHG" alt=""><figcaption><p>Meta information tab</p></figcaption></figure>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter, and the optional `goal` query parameter:

```
GET https://docs.bdb.ai/data-pipeline/getting-started/homepage/create-job/python-job.md?ask=<question>&goal=<endgoal>
```

`ask` is the immediate question: it should be specific, self-contained, and written in natural language.
`goal` is optional and describes the broader end goal you are ultimately trying to accomplish on behalf of the user. GitBook uses it to tailor the answer towards what is most useful for that goal.

The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.