Data Pipeline
search
Ctrlk
Data Pipeline
  • Data Pipeline
  • Getting Started
  • Components
    • Adding Components to Workflow
    • Component Architecture
    • Component Base Configuration
    • Resource Configuration
    • Intelligent Scaling
    • Connection Validation
    • Readers
    • Writers
    • Machine Learning
    • Consumers
      • GCS Monitor
      • Sqoop Executer
      • OPC UA
      • SFTP Monitor
      • MQTT Consumer
      • Video Stream Consumer
      • Eventhub Subscriber
      • Twitter Scrapper
      • Mongo ChangeStream
      • Rabbit MQ Consumer
      • AWS SNS Monitor
      • Kafka Consumer
      • API Ingestion and Webhook Listener
    • Producers
    • Transformations
    • Scripting
    • Scheduler
    • Alerts
  • Custom Components
  • Advance Configuration & Monitoring
  • Version Control
  • Use Cases
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. Components

Consumers

These are the real-time / Streaming component that ingests data or monitor for change in data objects from different sources to the pipeline.

GCS Monitorchevron-rightSqoop Executerchevron-rightOPC UAchevron-rightSFTP Monitorchevron-rightMQTT Consumerchevron-rightVideo Stream Consumerchevron-rightEventhub Subscriberchevron-rightTwitter Scrapperchevron-rightMongo ChangeStreamchevron-rightRabbit MQ Consumerchevron-rightAWS SNS Monitorchevron-rightKafka Consumerchevron-rightAPI Ingestion and Webhook Listenerchevron-right
PreviousAutoML Runnerchevron-leftNextGCS Monitorchevron-right