List Jobs

All the saved Jobs by a logged-in user get listed by using this option.

The List Jobs option opens the available Jobs List for the logged-in user. All the saved Jobs by a user get listed on this page. By clicking on the Job name the Details tab on the right side of the page gets displayed with the basic details of the selected job.

Job List

• Navigate to the Data Pipeline Homepage.

• Click on the List Jobs option.

Accessing the List Job option from Pipeline Homepage

• The List Jobs page opens displaying the created jobs.

List Jobs Page

Job Details & History Tabs

• Select a Job from the displayed list, and click on it.

• This will open a panel below the selected Job. It will contain two tabs:

  • Job Details - This tab displays the following details for the selected Job:

    • Tasks

    • Created By

    • Updated Date

    • Cron Expression

    • Trigger Interval

    • Description

  • History: This tab shows all the relevant information about the selected Job's past runs, including whether it was successful or not.

    • The Clear option is also provided under the History tab to clear the Job history.

      • Click the Refresh icon to refresh the displayed Job history.

Displaying Job Details & Job History for PySpark Job

• In the List Jobs page, the user can view and download the pod logs for all instances by clicking on the View System Logs option in the Job history tab. For reference, please see the image below.

View and Download Pod logs option for PySpark Job from List Jobs page

• Once the user clicks on the View System Logs option, a drawer panel will open from the right side of the window. The user can select the instance for which the System logs have to be downloaded from the Select Hostname drop-down option. For reference, please see the image below.

Viewing Pod logs for Spark Job

• Clear: It will clear all the job run history from the History tab. Please refer the below given image for reference.

Clear Job History

Searching Job

The user can search for a specific Job by using the Search bar on the Job List. By typing a common name all the existing jobs having that word will list. E.g., By typing sand all the existing Jobs with the word sand in it get listed as displayed in the following image:

Search tab for Jobs

The user can also customize the Job List by choosing available filters such as Job Status, Job Type, Job Running Status:

Customizing Job list with the available Filters

Please Note:

• The user can open the Job Editor for the selected Job from the list by clicking the View icon.

• The user can view and download logs only for Jobs that have either successfully run or failed. Logs for the interrupted jobs cannot be viewed or downloaded.