> For the complete documentation index, see [llms.txt](https://docs.bdb.ai/data-pipeline-3/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://docs.bdb.ai/data-pipeline-3/getting-started/job-monitoring.md).

# Job Monitoring

The user can use the ***Job Monitoring*** feature to track a Job and its associated tasks. On this page, the user can view details such as Job Status, Last Activated (Date and Time), Last Deactivated (Date and Time), Total Allocated and Consumed CPU, and Total Allocated and Consumed Memory, all presented together on Job monitoring page.

{% hint style="success" %}
*Please go through the below given walk-through on the Job monitoring function.*
{% endhint %}

{% embed url="<https://files.gitbook.com/v0/b/gitbook-x-prod.appspot.com/o/spaces%2Fc39ZvXI46qjXzpN3rYAg%2Fuploads%2FdqhcAIsK6zkDIgRgZ9CQ%2F2023-11-14-18-52-14%20(online-video-cutter.com).mp4?alt=media&token=05cc15e9-3e7d-4b98-b062-b4c273173a85>" %}
***Job Monitoring***
{% endembed %}

## Accessing Job Monitoring Page

The user can access the Job Monitoring icon on the ***List Jobs*** and ***Job Workflow Editor*** pages.

* Navigate to the ***List Jobs*** page.
* The ***Job*** ***Monitoring*** icon can be seen for all the listed Jobs.&#x20;

<figure><img src="/files/TD1EL3F2tX9wtQEQfjTg" alt=""><figcaption><p><em><strong>Accessing Job Monitoring page from List Jobs page.</strong></em></p></figcaption></figure>

&#x20;    OR

* Navigate to the ***Job Workflow Editor*** page.&#x20;
* The ***Job Monitoring*** icon is provided on the Header panel.

<figure><img src="/files/F4DLg0lEAb0c3FWsCK3H" alt=""><figcaption><p><em><strong>Accessing Job Monitoring page from Job Workflow Editor.</strong></em></p></figcaption></figure>

* The ***Job Monitoring*** page opens displaying the details of resource usage for the selected job.

## Monitoring Page for a Spark Job

The below-given images displays Monitoring page for the Spark Job with details on the Spark driver and executor.

<figure><img src="/files/W8PUS9DFRPFkoalw46nA" alt=""><figcaption><p><em><strong>Monitoring page for Spark Job</strong></em></p></figcaption></figure>

**Displaying the monitoring details of the Spark Job Driver**&#x20;

<figure><img src="/files/UuwJMpjiqbSTJpJJFWbe" alt=""><figcaption><p><em><strong>Monitoring page for Spark Job - Driver</strong></em></p></figcaption></figure>

**Displaying the monitoring details of the Spark Job Executer**

<figure><img src="/files/kIMCo4E9AJu7coEqHoOG" alt=""><figcaption><p><em><strong>Monitoring page for Spark Job - Executer</strong></em></p></figcaption></figure>

## Monitoring Page for a PySpark Job

The below-given images displays Monitoring page for the PySpark Job with details on the PySpark driver and executor.

<figure><img src="/files/Qb39efstCHprthXkxSpN" alt=""><figcaption><p><em><strong>Monitoring page for PySpark Job</strong></em></p></figcaption></figure>

**Displaying the monitoring details of the PySpark Job Driver**

<figure><img src="/files/MoPzbXx2Wbnmbimv5ibc" alt=""><figcaption><p><em><strong>Monitoring page for PySpark Job - Driver</strong></em></p></figcaption></figure>

**Displaying the monitoring details of the PySpark Job Executer**

<figure><img src="/files/gy4zUi4q7Kxm4yjU8f0T" alt=""><figcaption><p><em><strong>Monitoring page for PySpark Job - Executer</strong></em></p></figcaption></figure>

## Monitoring Page for a Python Job

<figure><img src="/files/8bgfE2lUfobXqAVEb2ak" alt=""><figcaption><p><em><strong>Monitoring Page for Python Job</strong></em></p></figcaption></figure>

* If Memory or Core allocated to the component is less than required, then it will be displayed in red color as shown in the below image.
* **Clear:** It will clear all the monitoring details of the selected Job.

<figure><img src="/files/2aiZwsAyNKhj3Qf5gWxt" alt=""><figcaption></figcaption></figure>


---

# Agent Instructions
This documentation is published with GitBook. GitBook is the documentation platform designed so that both humans and AI agents can read, navigate, and reason over technical content effectively. Learn more at gitbook.com.

## Querying This Documentation
If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.bdb.ai/data-pipeline-3/getting-started/job-monitoring.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.