Data Pipeline
search
Ctrlk
  • Data Pipelinechevron-right
  • Getting Startedchevron-right
  • Componentschevron-right
    • Adding Components to Workflow
    • Component Architecture
    • Component Base Configuration
    • Resource Configuration
    • Intelligent Scaling
    • Connection Validation
    • Readerschevron-right
    • Writerschevron-right
    • Machine Learningchevron-right
    • Consumerschevron-right
      • SFTP Monitor
      • MQTT Consumer
      • Video Stream Consumer
      • Eventhub Subscriber
      • Twitter Scrapper
      • Mongo ChangeStream
      • Rabbit MQ Consumer
      • AWS SNS Monitor
      • Kafka Consumer
      • API Ingestion and Webhook Listener
    • Producerschevron-right
    • Transformationschevron-right
    • Scriptingchevron-right
    • Scheduler
  • Custom Components
  • Advance Configuration & Monitoringchevron-right
  • Version Control
  • Use Cases
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. Components

Consumers

These are the real-time / Streaming component that ingests data or monitor for change in data objects from different sources to the pipeline.

SFTP Monitorchevron-rightMQTT Consumerchevron-rightVideo Stream Consumerchevron-rightEventhub Subscriberchevron-rightTwitter Scrapperchevron-rightMongo ChangeStreamchevron-rightRabbit MQ Consumerchevron-rightAWS SNS Monitorchevron-rightKafka Consumerchevron-rightAPI Ingestion and Webhook Listenerchevron-right
PreviousAutoML Runnerchevron-leftNextSFTP Monitorchevron-right