Firstly, Kafka is a streaming platform which follows the pub/sub pattern for sending the messages/monitor the events
Kafka is generally used for two broad classes of applications:
In layman terms, Producer pushes the records into Kafka broker where consumer take those records and take action according to that message/event.
Kafka Architectural Overview
Topic in Kafka is nothing but a feed where a producer can push the records and consumer can get the records. Topics in Kafka are always multi-subscriber; that is, a topic can have zero, one, or many consumers that subscribe to the data written to it.
To make a topic fault tolerant and to handle the throughput, topic is maintained in different partitions. partitions can be in the same disk or in different disk.
Kafka Broker contains the cluster. Each Kafka Broker contains the topic log partitions. Connecting to one broker starts a client to the entire Kafka cluster. For failover, you want to start with at least three to five brokers. A Kafka cluster can have, 10, 100, or 1,000 brokers in a cluster if needed.
Kafka Broker Overview
To Configure the Apache Kafka in local machine and Run the server. Kafka Series Part 2