Settings

This page is for the Advanced configuration of the Data Pipeline.

Following is the list of configurations on the settings page:

• Kafka Configuration

• DataPrep Settings

• Logger

• Default Configuration

• Pod Status

• DB Sync

Kafka Configuration

This is for configuring details that are used for creating the events in the pipeline.

Please Note: This configuration is critical and should not be changed as this can mess up the activated pipelines.

List Of configurations on settings page

Data Preparation Settings

This shows a list of all exported preps from the Data Preparation module.

List Of Exported Scripts

Data Science Models

Data Science models that have been published as a service from Data Science Workbench gets listed here.

List of publlished Data-Science Models

Logger

This gives the info and config details of the Kafka topic that is set for logging.

Logger Configuration

Default Configuration

This is for setting the Default component configuration for Low, Medium and, High configuration Pipelines.

Default Configuration

Please Note: The Non-Spark means Docker under the Default Configuration section.

Pod Status

The Pod Status page under the Settings option gives us monitoring capability on the health of the System Components.

System Component Health

Please Note: The system components should be up for proper functionality of the Pipeline module.

DB Sync

DB Sync in settings is to globally configure the Data Sync feature. This way we can enable a DB connection and use the same connection in the pipeline without using any extra resources.

Please Note: We support 5 drivers at present

• MongoDB

• Postgres

• MSSQL

• Oracle

• MySQL