Amazon Data Firehose
#172 · Level 3 · Modern architecture · Data and analyticsConcept
Section titled “Concept”Amazon Data Firehose takes in streaming data by itself and delivers it to S3, Redshift or other destinations — without any code. It is serverless, so you don’t have to manage servers or capacity yourself. Data can be sent directly, or brought in from Kinesis Data Streams or Amazon MSK. Firehose collects data for a short while and writes it to the destination in one go. Along the way, you can change the data with Lambda or convert it to a format like Parquet.
Simple example
Section titled “Simple example”A pipeline — pour water in at one end and it reaches the tank at the other end by itself.
Why it’s needed
Section titled “Why it’s needed”Writing and running your own code to get streaming data to where it is stored is a hassle.
Where it’s used
Section titled “Where it’s used”Storing app logs and click data directly in an S3 data lake.
Azure equivalent
Section titled “Azure equivalent”Azure Event Hubs Capture / Stream Analytics
Learn more
Section titled “Learn more”For details and the latest information, see the official documentation: