search

Testing Strategy

hashtag
Unit Testing

  • Test connectivity to source (CRM, Billing, Kafka).

  • Validate sample SQL extraction queries with small date ranges.

  • Test ClickHouse batch insert with dummy data.

  • Verify error handling by injecting bad records.

hashtag
Integration Testing

  • Run end-to-end ingestion from one telecom source → Raw → ABDR → Datamart.

  • Validate data accuracy (source vs. ClickHouse row counts).

  • Test partitioning & indexing with range queries.

hashtag
Performance Testing

  • Test with various data volumes

  • Monitor execution time and memory usage

  • Validate concurrent execution scenarios

Last updated