#kafka

[ follow ]
#iot
fromMedium
3 months ago
Scala

Spark Stateful Stream Deduplication

Implementing a deduplication mechanism is essential for maintaining data pipeline integrity in IoT data streams to manage duplicate events effectively.
fromHackernoon
1 year ago
JavaScript

The Streaming Bridges - A Kafka, RabbitMQ, MQTT and CoAP Example to Learn More | HackerNoon

Selecting the appropriate streaming system involves weighing high availability against data reliability, considering push and pull mechanisms.
Understanding the differences between Kafka and RabbitMQ is crucial for system design in data transmission protocols.
fromMedium
3 months ago
Scala

Spark Stateful Stream Deduplication

Implementing a deduplication mechanism is essential for maintaining data pipeline integrity in IoT data streams to manage duplicate events effectively.
fromHackernoon
1 year ago
JavaScript

The Streaming Bridges - A Kafka, RabbitMQ, MQTT and CoAP Example to Learn More | HackerNoon

Selecting the appropriate streaming system involves weighing high availability against data reliability, considering push and pull mechanisms.
Understanding the differences between Kafka and RabbitMQ is crucial for system design in data transmission protocols.
more#iot
fromHackernoon
7 years ago
JavaScript

Solve Concurrency Challenges with Spring's @Transactional Annotation | HackerNoon

This article explores microservice challenges in developing a Personal Finance Manager, emphasizing the complexity of accurate data processing.
fromInfoWorld
5 months ago
Business intelligence

3 data engineering trends riding Kafka, Flink, and Iceberg

Flink paired with Kafka offers a reliable data processing solution with low latency and high accuracy.
#scala
fromMedium
5 months ago
JavaScript

How to Use KafkaJsonSchemaSerializer in Scala with Case Classes?

KafkaJsonSchemaSerializer requires proper class structure and annotations for effective serialization in Scala.
fromMedium
9 months ago
Scala

Building an IoT Monitoring System with Spark Structured Streaming, Kafka and Scala

Developed IoT Smart Farm Monitoring system using Scala, Apache Spark Streaming, and Kafka for real-time data processing.
fromMedium
5 months ago
JavaScript

How to Use KafkaJsonSchemaSerializer in Scala with Case Classes?

KafkaJsonSchemaSerializer requires proper class structure and annotations for effective serialization in Scala.
fromMedium
9 months ago
Scala

Building an IoT Monitoring System with Spark Structured Streaming, Kafka and Scala

Developed IoT Smart Farm Monitoring system using Scala, Apache Spark Streaming, and Kafka for real-time data processing.
more#scala
fromwww.theguardian.com
6 months ago
Film

Alienation effect: why film-makers can't get enough of Franz Kafka

Soderbergh's Mr Kneff reimagines Kafka, embodying 1920s cinematic style while exploring themes of the era.
fromTechCrunch
7 months ago
Business intelligence

Confluent acquires streaming data startup WarpStream | TechCrunch

Confluent acquires WarpStream to enhance its streaming data service offerings with a 'bring your own cloud' model.
fromHackernoon
11 months ago
JavaScript

Kafka Message Testing: How to Write Integration Tests | HackerNoon

Effective integration testing for Kafka applications improves readability and maintainability.
Isolation and clear stages in testing enhance efficiency.
Message capture is crucial for accurate test results.
fromwww.npr.org
8 months ago
OMG science

This is genius: A new graphic novel imagines conversations between Einstein and Kafka

Ken Krimstein's 'Einstein in Kafkaland' explores Albert Einstein's pivotal year in Prague, combining biography with elements of historical fiction and whimsy.
fromDevOps.com
9 months ago
DevOps

Coralogix Extends Reach of Observability Platform to iOS Applications - DevOps.com

Coralogix added RUM capabilities for mobile apps using real-time streaming with Kafka, making error detection easier to enhance user experience.
fromNew Relic
11 months ago
Data science

Tuning Apache Kafka Consumers to maximize throughput and reduce costs

Detecting scenarios in Kafka metrics can help optimize consumer behavior.
[ Load more ]