DEV Community

# kafka

Discussions around Apache Kafka for building real-time data pipelines and streaming apps.

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Graceful Shutdown in Kafka: Understanding Shutdown Hooks and Thread Management

Graceful Shutdown in Kafka: Understanding Shutdown Hooks and Thread Management

Comments
8 min read
Wearable Data Pipelines: Scaling Real-Time Health Insights for Connected Devices

Wearable Data Pipelines: Scaling Real-Time Health Insights for Connected Devices

Comments
2 min read
Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems

Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems

Comments
10 min read
Data Processing Does Not Belong in the Message Broker

Data Processing Does Not Belong in the Message Broker

Comments
3 min read
ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant

ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant

Comments
4 min read
Mastering Event-Driven Systems with Kafka & Redpanda

Mastering Event-Driven Systems with Kafka & Redpanda

Comments
2 min read
Stateless Kafka-compatible brokers backed by object storage, k8s native

Stateless Kafka-compatible brokers backed by object storage, k8s native

Comments
1 min read
Kafka’s Broker As A Traffic Cop

Kafka’s Broker As A Traffic Cop

Comments
12 min read
Interesting links - December 2025

Interesting links - December 2025

Comments
13 min read
Stop Writing a Kafka Consumer for Every Topic – Make It Generic in .NET

Stop Writing a Kafka Consumer for Every Topic – Make It Generic in .NET

Comments
2 min read
Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring

Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring

Comments 1
10 min read
When Events Meet Clusters: Building Reactive Micro-services on Kubernetes

When Events Meet Clusters: Building Reactive Micro-services on Kubernetes

Comments
4 min read
New Tutorial: Microservices with NestJS, Kafka & Redis

New Tutorial: Microservices with NestJS, Kafka & Redis

1
Comments 1
1 min read
Under the Hood of the Beast: A Deep Dive into Apache Spark Architecture

Under the Hood of the Beast: A Deep Dive into Apache Spark Architecture

5
Comments
5 min read
The Big Data Showdown: Apache Spark vs. Hadoop in 2026

The Big Data Showdown: Apache Spark vs. Hadoop in 2026

5
Comments
4 min read
Apache Spark vs. Apache Kafka: The "Brain" and the "Nervous System" of Big Data

Apache Spark vs. Apache Kafka: The "Brain" and the "Nervous System" of Big Data

5
Comments
3 min read
Kafka Election Storm

Kafka Election Storm

Comments
1 min read
Popular tools used in ETL/ELT workflows

Popular tools used in ETL/ELT workflows

Comments
2 min read
We Migrated From Kafka to Redpanda — What Actually Happened

We Migrated From Kafka to Redpanda — What Actually Happened

Comments
4 min read
Even in the AI era, Clojure gives the biggest performance boost, with Jeremiah Via, The New York Times

Even in the AI era, Clojure gives the biggest performance boost, with Jeremiah Via, The New York Times

Comments
1 min read
Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance

Optimizing Kafka Tracing with OpenTelemetry: Boost Visibility & Performance

Comments
6 min read
Kafka MCP Server: Building a Real-Time Message Processing Integration

Kafka MCP Server: Building a Real-Time Message Processing Integration

Comments
12 min read
Interesting links - November 2025

Interesting links - November 2025

Comments
19 min read
🚀 Event-Driven Excellence: Integrating Kafka with Avro in a .NET Hosted Service

🚀 Event-Driven Excellence: Integrating Kafka with Avro in a .NET Hosted Service

Comments
9 min read
Building Event-Driven Microservices with Apache Kafka: A Practical Architecture for High-Scale Platforms

Building Event-Driven Microservices with Apache Kafka: A Practical Architecture for High-Scale Platforms

Comments
3 min read
loading...