List Pipelines
Last updated
Last updated
The List Pipelines option opens the available Pipeline List for the logged-in user. All the saved pipelines by a user get listed on this page. The Details tab on the right side of the page displays the basic details of the selected pipeline.
Navigate to the Pipeline List page.
Select a data pipeline from the displayed list.
Click the Push Pipeline icon for the selected data pipeline.
The Push into Version Controlling System dialog box appears.
Provide a Commit Message (required) for the data pipeline version.
Select a Push Type out of the below-given choices to push the pipeline:
1.Version Control: For versioning of the pipeline in the same environment.
2.GIT Export (Migration): This is for pipeline migration. The pushed pipeline can be migrated to the destination environment from the migration window in Admin Module.
Click the Ok option.
​​
A notification message appears to confirm the completion of the action.
Version Control:
Pipeline Migration:
This feature is for pulling the previously moved versions of a pipeline that are committed by the user. This can help a user significantly to recover the lost pipelines or avoid unwanted modifications made to the pipeline.
Navigate to the Pipeline List page.
Select a data pipeline from the displayed list.
Click the Pull from GIT icon for the selected data pipeline.
The Pull from GIT dialog box appears.
Select the data pipeline version by marking the given checkbox.
Click the Ok option.
A confirmation message appears to assure the users that the concerned pipeline workflow has been imported.
Another confirmation message appears to assure the user that the concerned pipeline workflow has been pulled.
Clicking on the View icon will direct the user to the pipeline workflow editor page.
Navigate to the Pipeline List page.
Select a Pipeline from the list.
Click the View icon.
The Pipeline Editor page opens for that pipeline.
The user can search for a specific pipeline by using the Search bar on the Pipeline List. By typing a common name all the existing pipelines having that word will list. E.g., By typing the sample all the existing pipelines with the words that contain 'Sam' like sample in it get listed in the following image:​​
Click on the pipeline to view the information of the pipeline on the list pipeline page. Once clicked on the pipeline name, a menu will open in the right side of the screen showing all the details of the selected pipeline. Please go through the below demonstration:
By clicking on the pipeline name, the following details of that pipeline will be shown in the right side of the screen:
Components: Number of components used in the pipeline.
Created By: Owner name of the pipeline.
Created Date: Pipeline created date.
Updated By: Name of the person who has updated the pipeline recently.
Updated Date: Date when the pipeline is updated.
Clicking on the monitor pipeline icon will direct the user to the pipeline monitoring page.
Navigate to the Pipeline List page.
Select a Pipeline from the list.
Click the Monitor icon.
The user gets redirected to the Pipeline Monitoring page of the selected Pipeline.
The Monitor tab opens by default.
The user can click the Data Metrics tab if wants to see depiction of the component specific data metrics.
Failure analysis is a central failure mechanism. Here, the user can identify the failure reason. Failures of any pipeline stored at a particular location(collection). From there you can query your failed data in the Failure Analysis UI. It displays the failed records along with cause, event time, and pipeline Id.
Navigate to the Pipeline List page.
Select a Pipeline from the list.
Click on the Failure Analysis icon as highlighted in the below image to get redirected to the Failure Analysis page.
The user can share a pipeline with one or multiple users and user Groups using the Share Pipeline option.
Navigate to the Pipeline List page.
Select a Pipeline from the pipeline list.
Click on the Share Pipeline icon.
The Share Pipeline window opens.
Select an option out of the given choices: User (default tab) and User Group or Exclude User (the Exclude User option can be chosen, if the pipeline is already shared with a user/user group and you wish to exclude them from the privilege).
Select a user or user(s) from the displayed list of users (In case of the User Group(s) tab, it displays the names of the User Groups.
Click the arrow to move the selected User(s)/ User Group(s).
The selected user(s)/user group(s) get moved to the box given on the right (In case of the Exclude User option the selected user/ the user moved to the right-side box looses the access of the shared pipeline).
Click the Save option.
Privilege for the selected pipeline gets updated and the same gets communicated through a message.
By completing the steps mentioned above, the concerned pipeline gets successfully shared with the selected user/user group or the selected users can also be excluded from their privileges for the concerned pipeline.
The user can activate/deactivate the pipeline by clicking on the Activate/ Deactivate icon.
Click the List Pipelines icon to open the Pipeline list.
Select a Pipeline from the pipeline list.
Click on the Activate Pipeline icon.
The Confirmation dialog box opens to get the confirmation for the action.
Click the YES option.
A confirmation message appears.
The pipeline gets activated. The Activate Pipeline icon turns into Deactivate Pipeline.
the same gets communicated through the Status icon color.
Click the Deactivate Pipeline icon.
The Confirmation dialog box opens to get the confirmation for the action.
Click the YES option.
A confirmation message appears.
The pipeline gets deactivated. The same gets communicated through the color of the Status icon.
The pipeline pushed to the VCS using the Version Control option, can be pulled directly from the Pull Pipeline from GITicon.
Please Note: Check out the page for the more details on this topic.
Please Note: Refer to the for more details on this.
​
​
​
​
