Kafka improvements #1156

Activity

1. de-sh

   added

   documentationImprovements or additions to documentationImprovements or additions to documentation

   enhancementNew feature or requestNew feature or request

   server

   on Feb 3, 2025
2. hippalus commented on Feb 3, 2025

   

   hippalus

   on Feb 3, 2025

   Contributor

   More actions

   @de-sh, items 3 and 4 have been completed. Additionally, @nitisht recommended moving the Python script located here to the Quest repository. This script can be enhanced to include test cases that verify the ingestion of Kafka messages and ensure that the number of events matches the expected count.

   Completed Items:

   3. Docker Improvements:

      • Added Docker Compose files for testing Kafka in distributed and standalone environments:
        • Distributed Test Environment
        • Standalone Test Environment
        • Dockerfile.kafka

   4. Metrics Collector:

      • Completed the KafkaMetricsCollector implementation:
        • Metrics Implementation

   IMHO: We can add the following items to this scope

   • Script Migration: Move the Kafka log stream generator script to the Quest repository for better maintainability and integration with existing test suites.
   • Test Cases: Add test cases to Quest to validate Kafka message ingestion and ensure the consistency of message counts etc.

   👍React with 👍1Reacted by Devdutt Shenoi
3. nitisht

   closed this as not plannedon May 16, 2026