Data Pipeline
search
Ctrlk
Data Pipeline
  • Data Pipeline
  • Getting Started
  • Components
    • Adding Components to Workflow
    • Component Architecture
    • Component Base Configuration
    • Resource Configuration
    • Intelligent Scaling
    • Connection Validation
    • Readers
    • Writers
    • Machine Learning
    • Consumers
      • SFTP Monitor
      • MQTT Consumer
      • Video Consumer
      • Eventhub Subscriber
      • Twitter Scrapper
      • Mongo Change Stream
      • Rabbit MQ Consumer
      • AWS SNS Monitor
      • Kafka Consumer
      • Schema Validator
      • API Ingestion and Webhook Listener
    • Producers
    • Transformations
    • Scripting
    • Scheduler
  • Custom Components
  • Advance Configuration & Monitoring
  • Version Control
  • Jobs
  • Use Cases
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. Components

Consumers

These are the real-time / Streaming component that ingests data or monitor for change in data objects from different sources to the pipeline.

SFTP Monitorchevron-rightMQTT Consumerchevron-rightVideo Consumerchevron-rightEventhub Subscriberchevron-rightTwitter Scrapperchevron-rightMongo Change Streamchevron-rightRabbit MQ Consumerchevron-rightAWS SNS Monitorchevron-rightKafka Consumerchevron-rightSchema Validatorchevron-rightAPI Ingestion and Webhook Listenerchevron-right
PreviousAutoML Runnerchevron-leftNextSFTP Monitorchevron-right

Last updated 2 years ago