1 of 7

Advance Configuration & Monitoring

This section explains the mandatory configurations for the Data Pipeline module to work. You can monitor critical things like the health of system components and Data Channels from this section.

Configuration

This section provides Logger Settings, and Default Component Configuration options for the user to configure.

Default Component Configuration

This option helps to set the default component configuration values as Low, Medium and, High configuration for the Data Pipelines and Jobs.

Logger

This section provides information of the Kafka topic that is set for logging.

The Logger option opens the Logger Details displaying Customer Logs, Developer Logs, UI Logs, and duration in minutes and seconds.

Data Channel

The Data Channel page helps to check the state of the Kafka Brokers.

Data Pipelines use the Kafka topics as communication channels to pass information between two or more components. It is crucial for the functionality of the pipeline that brokers are up and running.

The Data Channel displays the health of the brokers, the number of partitions per broker, and Disk Space used.

Check out the given walk-through to understand Data Channel..

Please Note: The green indicator in status shows the broker is up and running; if it is red then the broker is down.

Cluster Events

This page enables a user to monitor all the events created in the pipeline environment.

Events of the deleted pipelines are visible on this page, and they can be deleted permanently and flushed from here.
Operations like Flush All and Delete All can be done from this page.

System Component Status

This option allows to monitor the health of the system components.

Pod Status

The Pod Status displays monitoring capability on the health of the system components.

Please Note: The system components should be up for proper functionality of the Pipeline module.

Data Channel

The Data Channel page helps to check the state of the Kafka Brokers.

Data Pipelines use the Kafka topics as communication channels to pass information between two or more components. It is crucial for the functionality of the pipeline that brokers are up and running.

The Data Channel displays the health of the brokers, the number of partitions per broker, and Disk Space used.

Check out the given walk-through to understand Data Channel..

Please Note: The green indicator in status shows the broker is up and running; if it is red then the broker is down.