Settings
This page is for the Advanced configuration of the Data Pipeline.
Following is the list of configurations on the settings page:
Kafka Configuration
DataPrep Settings
Logger
Default Configuration
Pod Status
DB Sync
Kafka Configuration
This is for configuring details that are used for creating the events in the pipeline.

Data Preparation Settings
This shows a list of all exported preps from the Data Preparation module.

Data Science Models
Data Science models that have been published as a service from Data Science Workbench gets listed here.

Logger
This gives the info and config details of the Kafka topic that is set for logging.

Default Configuration
This is for setting the Default component configuration for Low, Medium and, High configuration Pipelines.

Please Note: The Non-Spark means Docker under the Default Configuration section.
Pod Status
The Pod Status page under the Settings option gives us monitoring capability on the health of the System Components.

DB Sync
DB Sync in settings is to globally configure the Data Sync feature. This way we can enable a DB connection and use the same connection in the pipeline without using any extra resources.

Last updated
Was this helpful?