Amazon MSK (Managed Kafka)
#174 · Level 3 · Modern architecture · Data and analyticsConcept
Section titled “Concept”Amazon MSK (Managed Streaming for Apache Kafka) is the managed version of Apache Kafka — a system for reliably exchanging huge amounts of moving data or events. In Kafka, producers send data into groups called topics, and consumers read from there. Servers called brokers store and distribute the data. MSK handles setting up, patching and monitoring these brokers. It can run in two forms — Provisioned and Serverless — and regular Kafka tools work as before.
Simple example
Section titled “Simple example”The country’s main news agency — hundreds of thousands of news items come in, and many newspapers each take what they need.
Why it’s needed
Section titled “Why it’s needed”Kafka is very popular but hard to run yourself. MSK handles that hard part.
Where it’s used
Section titled “Where it’s used”Event streaming in large companies, exchanging data between microservices.
Azure equivalent
Section titled “Azure equivalent”Azure Event Hubs (Kafka endpoint) / HDInsight Kafka
Learn more
Section titled “Learn more”For details and the latest information, see the official documentation: