Pipeline Editor

The Editor page of the Pipeline module serves as the central canvas for building and managing data flows.

Users can design, configure, and connect multiple components to create end-to-end pipelines within this workspace. The canvas provides a visual environment that simplifies complex workflows, allowing users to:

• Drag and drop components onto the canvas.

• Connect components using events to define the flow of data.

• Configure component properties to align with data processing requirements.

• Visualize the sequence of transformations and interactions between pipeline elements.

This editor is the foundation for orchestrating diverse data flows—ranging from ingestion and transformation to enrichment, analysis, and output—ensuring users can intuitively design robust data pipelines.

The major tasks covered under the Pipeline Editor page include:

1. Connecting Components

2. Memory and CPU Allocations

3. PIpeline Toolbar

4. Pipeline Components