Kafka Streams in Action: Event-driven Applications and Microservices

Everything you need to implement stream processing on Apache Kafka using Kafka Streams and the kqsIDB event streaming database.

Kafka Streams in Action, Second Edition guides you through setting up and maintaining your streaming processing with Kafka. Inside, you’ll find comprehensive coverage of not only Kafka Streams, but the entire toolbox you’ll need for effective streaming—from the components of the Kafka ecosystem, to Producer and Consumer clients, Connect, and Schema Registry.

In Kafka Streams in Action, Second Edition you’ll learn how to:

• Design streaming applications in Kafka Streams with the KStream and the Processor API
• Integrate external systems with Kafka Connect
• Enforce data compatibility with Schema Registry
• Build applications that respond immediately to events in either Kafka Streams or ksqlDB
• Craft materialized views over streams with ksqlDB

This totally revised new edition of Kafka Streams in Action has been expanded to cover more of the Kafka platform used for building event-based applications. You’ll also find full coverage of ksqlDB, an event streaming database that makes it a snap to create applications that respond immediately to events, such as real-time push and pull updates.

Foreword by Jun Rao.

Purchase of the print book includes a free eBook in PDF and ePub formats from Manning Publications.

About the technology

Enterprise applications need to handle thousands—even millions—of data events every day. With an intuitive API and flawless reliability, the lightweight Kafka Streams library has earned a spot at the center of these systems. Kafka Streams provides exactly the power and simplicity you need to manage real-time event processing or microservices messaging.

About the book

Kafka Streams in Action, Second Edition teaches you how to create event streaming applications on the amazing Apache Kafka platform. This thoroughly revised new edition now covers a wider range of streaming architectures and includes data integration with Kafka Connect. As you go, you’ll explore real-world examples that introduce components and brokers, schema management, and the other essentials. Along the way, you’ll pick up practical techniques for blending Kafka with Spring, low-level control of processors and state stores, storing event data with ksqlDB, and testing streaming applications.

What's inside

• Design efficient streaming applications
• Integrate external systems with Kafka Connect
• Enforce data compatibility with Schema Registry

About the reader

For Java developers. No knowledge of Kafka or streaming applications required.

About the author

Bill Bejeck is a Confluent engineer and a Kafka Streams contributor with over 15 years of software development experience. Bill is also a committer on the Apache Kafka? project.

Table of Contents

PART 1
1 Welcome to the Kafka event streaming platform
2 Kafka brokers
PART 2
3 Schema Registry
4 Kafka clients
5 Kafka ConnectPART 3
6 Developing Kafka Streams
7 Streams and state
8 The KTable API
9 Windowing and timestamps
10 The Processor API
11 ksqlDB
12 Spring kafka
13 Kafka Streams Interactive Queries
14 Testing