The article discusses the complexities of data stream processing, highlighting that many engineers entering the field often have backgrounds in batch processing or application development. It emphasizes the importance of recognizing various patterns in data streaming and the necessity to adapt previous knowledge to this new domain. Polak notes that while data streaming exists alongside other systems like batch processing and analytics, the overwhelming amount of data requires detailed attention and an understanding of how different applications interact with data, such as through Kafka or Redis.
When we think about it, data is everywhere. It's not only the data streaming. What happens to most of us is when we enter the data streaming world, we are already experienced engineers.
I'm very happy to share a little bit from what I've learned and what we've learned from our customers' journeys as well.
Collection
[
|
...
]