...

Big Data - Apache Kafka

Back to Course

Lesson Description


Lession - #450 Kafka Fundamental


Prior to moving deep into the Kafka, you should be aware of the main wordings like
  • topic
  • broker
  • producer and
  • consumer.
  • Zookeeper

    Describe Topic

    Kafka topics are the categories used to organize messages. Every topic has a name that is unique across the whole Kafka group. Messages are sent to and read from specific topics. As such, producers write data to topics, and consumers read information from topics.



    Broker

    A Broker is a Kafka server that runs in a Kafka Cluster. Kafka Brokers structure a group. The Kafka Cluster comprises of numerous Kafka Brokers on numerous servers. Merchant here and there allude to all the more an intelligent framework or as Kafka in general. . A produceris the one which distributes or composes information to the subjects inside various allotments. Makers consequently know that, what information ought to be kept in touch with which segment and merchant. The client doesn't need to indicate the agent and the segment.And to list the number of topics created within a broker, use '-list' command as: 'kafka-topics.



    Producer

    . A produceris the one which distributes or composes information to the subjects inside various allotments. Makers consequently know that, what information ought to be kept in touch with which segment and merchant. The client doesn't need to indicate the agent and the segment.



    Consumer

    Kafka customers are regularly important for a purchaser bunch . Whenever numerous customers are bought into a subject and have a place with a similar buyer bunch, every shopper in the gathering will get messages from an alternate subset of the partitions in the topic.kafka-console-consumer is a consumer command line that: read data from a Kafka topic. and write it to standard output (console>
    .





    Zookeeper

    Zookeeper is utilized in circulated frameworks for administration synchronization and as a naming registry. While working with Apache Kafka, ZooKeeper is essentially used to track the status with hubs in the Kafka group and keep s list of Kafka topics and messages.From the file, ports in use by kafka and zookeeper services can be identified. There should be java processes listening at these ports. a>
    Check the kafka port listed in the server. properties file with the netstat command, port 9092.
    Does Kafka 2.8 need ZooKeeper?
    We are excited to announce that 2.8 introduces an early-access look at Kafka without ZooKeeper!

    Kafka Manager is an open-source tool for managing Kafka. It can be used only through a web browser. In Kafka Manager, you can view the monitoring statistics and broker information of your Kafka clusters.

    What is Kafka monitoring?
    Kafka Monitor allows you to monitor a cluster using end-to-end pipelines to obtain vital statistics such as end-to-end latency, service availability and message loss rate.

    Mirrormaker of Apache Kafka GitHub-

    kafka interview questions for experienced and Kafka topic creation :

    Kafka y la muñeca viajera