# Getting Started

- [Homepage](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage.md)
- [Create](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create.md): Create a new Pipeline or Job based on the selected create option.
- [Creating a New Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-pipeline.md): This section provides the steps involved in creating a new Pipeline flow.
- [Adding Components to Canvas](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-pipeline/adding-components-to-canvas.md): Adding components to a pipeline workflow.
- [Connecting Components](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-pipeline/connecting-components.md): An event-driven architecture uses events to trigger and communicate between decoupled services and is common in modern applications built with microservices.
- [Events \[Kafka and Data Sync\]](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-pipeline/connecting-components/events-kafka-and-data-sync.md)
- [Memory and CPU Allocations](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-pipeline/memory-and-cpu-allocations.md): This section focuses on the Configuration tab provided for any Pipeline component.
- [Creating a New Job](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job.md): This section provides detailed information on the Jobs to make your data process faster.
- [Job Editor Page](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/job-editor-page.md): The Job Editor Page provides the user with all the necessary options and components to add a task and eventually create a Job workflow.
- [Spark Job](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job.md): This section provides details about the various categories of the task components which can be used in the Spark Job.
- [Readers](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers.md): All the available Reader Task components are included in this section.
- [HDFS Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/hdfs-reader.md)
- [MongoDB Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/mongodb-reader.md)
- [DB Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/db-reader.md)
- [S3 Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/s3-reader.md)
- [Azure Blob Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/azure-blob-reader.md)
- [ES Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/es-reader.md)
- [Sandbox Reader](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/sandbox-reader.md)
- [Athena Query Executer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/readers/athena-query-executer.md)
- [Writers](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers.md): All the available Writer Task components for a Job are explained in this section.
- [HDFS Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/hdfs-writer.md)
- [Azure Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/azure-writer.md)
- [DB Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/db-writer.md)
- [ES Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/es-writer.md)
- [S3 Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/s3-writer.md)
- [Sandbox Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/sandbox-writer.md)
- [Mongodb Writer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/mongodb-writer.md)
- [Kafka Producer](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/writers/kafka-producer.md)
- [Transformations](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/spark-job/transformations.md): This page aims to explain the various transformation options provided on the Jobs Editor page.
- [PySpark Job](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/pyspark-job.md): Write PySpark scripts and run them flawlessly in the Jobs.
- [Python Job](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/python-job.md): Write Python scripts and run them flawlessly in the Jobs.
- [Python Job (On demand)](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/python-job-on-demand.md)
- [Script Executer Job](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/script-executer-job.md)
- [Job Alerts](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/creating-a-new-job/job-alerts.md)
- [Register as Job](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/create/register-as-job.md)
- [Overview](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/overview.md): This page provides an overview and summary of the pipeline module, including details such as running status, types, number of pipelines and jobs, and resources used.
- [Jobs](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/overview/jobs.md)
- [Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/overview/pipeline.md): This page shows a summary of Pipelines in a graphical manner.
- [List Jobs](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/list-jobs.md): All the saved Jobs by a logged-in user get listed by using this option.
- [List Pipelines](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/list-pipelines.md)
- [Scheduler](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/scheduler.md)
- [Data Channel & Cluster Events](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/data-channel-and-cluster-events.md)
- [Trash](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/trash.md): This page describes how to delete a pipeline/Job or restore a deleted pipeline/Job using the Trash option.
- [Settings](https://docs.bdb.ai/data-pipeline-6/getting-started/homepage/settings.md)
- [Pipeline Workflow Editor](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor.md): The Pipeline Workflow Editor contains Toolbar, Component Panel, and the Right-side Panel together with the Design Canvas for the user to create a pipeline flow.
- [Pipeline Toolbar](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar.md)
- [Pipeline Overview](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/pipeline-overview.md): This page provides an overview of all the components used in the pipeline in a single place.
- [Pipeline Testing](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/pipeline-testing.md)
- [Search Component in Pipelines](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/search-component-in-pipelines.md)
- [Push & Pull Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/push-and-pull-pipeline.md)
- [Update Pipeline Components](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/update-pipeline-components.md): Users can update the version of the used pipeline components through this icon.
- [Full Screen](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/full-screen.md)
- [Log Panel](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/log-panel.md)
- [Event Panel](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/event-panel.md)
- [Activate/Deactivate Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/activate-deactivate-pipeline.md)
- [Update Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/update-pipeline.md)
- [Failure Analysis](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/failure-analysis.md)
- [Delete Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/delete-pipeline.md)
- [Pipeline Component Configuration](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/pipeline-component-configuration.md)
- [Pipeline Failure Alert History](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/pipeline-failure-alert-history.md)
- [Format Flowchart](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/format-flowchart.md): Arrange the components used in the Pipeline/Job Workflow.
- [Zoom In/Zoom Out](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/zoom-in-zoom-out.md)
- [Update Component Version](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/pipeline-toolbar/update-component-version.md)
- [Component Panel](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/component-panel.md)
- [Right-side Panel](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-workflow-editor/right-side-panel.md)
- [Testing Suite](https://docs.bdb.ai/data-pipeline-6/getting-started/testing-suite.md)
- [Activating Pipeline](https://docs.bdb.ai/data-pipeline-6/getting-started/activating-pipeline.md): Activating pipeline to deploy the pipelines.
- [Pipeline Monitoring](https://docs.bdb.ai/data-pipeline-6/getting-started/pipeline-monitoring.md): This Page explains How we can monitor the Pipelines.
- [Job Monitoring](https://docs.bdb.ai/data-pipeline-6/getting-started/job-monitoring.md): This page explains how we can monitor a Job.


---

# Agent Instructions: Querying This Documentation

If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question.

Perform an HTTP GET request on the current page URL with the `ask` query parameter:

```
GET https://docs.bdb.ai/data-pipeline-6/getting-started.md?ask=<question>
```

The question should be specific, self-contained, and written in natural language.
The response will contain a direct answer to the question and relevant excerpts and sources from the documentation.

Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.