Data Pipeline
Ctrlk
  • Data Pipeline
  • Getting Started
  • Components
    • Adding Components to Workflow
    • Component Architecture
    • Component Base Configuration
    • Resource Configuration
    • Intelligent Scaling
    • Connection Validation
    • Readers
    • Writers
    • Machine Learning
    • Consumers
      • GCS Monitor
      • Sqoop Executer
      • OPC UA
      • SFTP Monitor
      • MQTT Consumer
      • Video Stream Consumer
      • Eventhub Subscriber
      • Twitter Scrapper
      • Mongo ChangeStream
      • Rabbit MQ Consumer
      • AWS SNS Monitor
      • Kafka Consumer
      • API Ingestion and Webhook Listener
    • Producers
    • Transformations
    • Scripting
    • Scheduler
    • Alerts
  • Custom Components
  • Advance Configuration & Monitoring
  • Version Control
  • Use Cases
Powered by GitBook
On this page
  1. Components

Consumers

These are the real-time / Streaming component that ingests data or monitor for change in data objects from different sources to the pipeline.

GCS MonitorSqoop ExecuterOPC UASFTP MonitorMQTT ConsumerVideo Stream ConsumerEventhub SubscriberTwitter ScrapperMongo ChangeStreamRabbit MQ ConsumerAWS SNS MonitorKafka ConsumerAPI Ingestion and Webhook Listener
PreviousAutoML RunnerNextGCS Monitor