Explore Kafka Streams for real-time data processing. Learn Kafka concepts, CLI tools, complex topologies, and Spring Boot integration to build scalable, resilient applications.

kafka-streams-course.tar.gz

hello-world

stateless-topology

stateless-topology-test

stateful-topology

springboot

Kafka Streams is a Java library designed to develop applications and microservices tailored for real-time data stream processing. Harnessing Kafka’s capabilities, applications constructed using Kafka Streams exhibit exceptional scalability and fault tolerance. This versatile tool finds applications in various scenarios and domains.

The course starts with an introduction to Kafka Streams. Next, you will learn important Kafka concepts and gain experience using Kafka CLI tools. Then, you will learn how to build complex Kafka Streams topologies using stateless operators, error handling, and stateful operations. Finally, you will learn how to integrate Kafka Streams in Spring Boot applications, including using Spring’s monitoring and metrics capabilities.

After completing this course, you can build data-intensive real-time stream processing applications and microservices using Kafka Streams, enabling you to build powerful, resilient, and scalable products.

Kafka Streams for Software Developers

plugins {
    id 'java'
    id 'org.springframework.boot' version '2.7.15'
    id 'io.spring.dependency-management' version '1.0.15.RELEASE'
}

group = 'io.github.stavshamir'
version = '0.0.1-SNAPSHOT'

java {
    sourceCompatibility = '11'
}

repositories {
    mavenCentral()
}

dependencies {
    implementation 'org.springframework.boot:spring-boot-starter'
    implementation 'org.apache.kafka:kafka-streams'
    implementation 'org.springframework.kafka:spring-kafka'
    testImplementation 'org.springframework.boot:spring-boot-starter-test'
    testImplementation 'org.springframework.kafka:spring-kafka-test'
}

tasks.named('test') {
    useJUnitPlatform()
}


import React from 'react';
import { shallow, configure } from 'enzyme';
import Adapter from 'enzyme-adapter-react-16';

configure({ adapter: new Adapter() });

import HelloWorld from './app';

var TestResult = function() {
    this.succeeded = false;
    this.reason = "";
    this.input = "";
    this.expected_output = "";
    this.actual_output = "";
}

export const executeTests = function() {

  var results = [];

  result = new TestResult();
  result.input = 'HelloWorld Component';
  result.expected_output = "span containing text 'Hello World'"

  let wrapper = shallow(<HelloWorld />);

  // Call your Challenge function here.

  let type = wrapper.type();
  let testSuccessful = true;
  let failureReason;

  if (type !== 'span') {
    testSuccessful = false;
    failureReason = "You need to render exactly one span HTML element";
  } else if (wrapper.props().children != "Hello World") {
     testSuccessful = false;
     failureReason = "You have rendered wrong message in your span element";
  }

  result.actual_output = wrapper.html();

  if (testSuccessful) {
    result.succeeded = true;
    result.reason = "Succeeded"
  } else {
    result.succeeded = false;
    result.reason = failureReason;
  }

  results.push(result);

  return results;
}


React

Dart

GoJS React

Typescript React

Vue.js

Learn how to setup a Spring Boot application with classic Kafka Streams integration.

Kafka Streams Overview

Building Our Kafka Tool Belt

Stateless Processing

Error Handling

Stateful Processing

Setting up a Streaming Data Pipeline With Kafka

Kafka Streams with Spring Boot

Build an Order Processing Kafka Streams Application

Wrap Up

Classic Integration: Project Setup

Project setup