Data Pipeline
search
Ctrlk
  • Data Pipelinechevron-right
  • Getting Startedchevron-right
  • Componentschevron-right
    • Adding Components to Workflow
    • Component Architecture
    • Component Base Configuration
    • Resource Configuration
    • Intelligent Scaling
    • Connection Validation
    • Readerschevron-right
    • Writerschevron-right
    • Machine Learningchevron-right
    • Consumerschevron-right
      • SFTP Monitor
      • MQTT Consumer
      • Video Consumer
      • Eventhub Subscriber
      • Twitter Scrapper
      • Mongo Change Stream
      • Rabbit MQ Consumer
      • AWS SNS Monitor
      • Kafka Consumer
      • Schema Validator
      • API Ingestion and Webhook Listener
    • Producerschevron-right
    • Transformationschevron-right
    • Scriptingchevron-right
    • Scheduler
  • Custom Components
  • Advance Configuration & Monitoringchevron-right
  • Version Control
  • Jobschevron-right
  • Use Cases
gitbookPowered by GitBook
block-quoteOn this pagechevron-down
  1. Components

Consumers

These are the real-time / Streaming component that ingests data or monitor for change in data objects from different sources to the pipeline.

SFTP Monitorchevron-rightMQTT Consumerchevron-rightVideo Consumerchevron-rightEventhub Subscriberchevron-rightTwitter Scrapperchevron-rightMongo Change Streamchevron-rightRabbit MQ Consumerchevron-rightAWS SNS Monitorchevron-rightKafka Consumerchevron-rightSchema Validatorchevron-rightAPI Ingestion and Webhook Listenerchevron-right
PreviousAutoML Runnerchevron-leftNextSFTP Monitorchevron-right

Last updated 2 years ago