Apache Kafka is a distributed event streaming platform for high-throughput, fault-tolerant pub/sub messaging, used for data pipelines and real-time processing.
It stores streams durably with partitions for scalability.
Use Kafka when:
Note: Tune partitions for parallelism.
Use idempotent producers.
Monitor with Kafka Manager.