Kafka Introduction
  • Welcome!
  • Apache Kafka in 5 minutes
  • Course Objectives
  • Important Message
Code Download
  • Code Download
====== Kafka Fundamentals ======
  • Kafka Fundamentals
Kafka Theory
  • Kafka Theory Overview
  • Topics, Partitions and Offsets
  • Brokers and Topics
  • Topic Replication
  • Producers and Message Keys
  • Consumers & Consumer Groups
  • Consumer Offsets & Delivery Semantics
  • Kafka Broker Discovery
  • Zookeeper
  • Kafka Guarantees
  • Theory Roundup
  • Quiz on Theory
Starting Kafka
  • Important: Starting Kafka
  • FAQ for Setup Problems
  • Mac OS X - Download and Setup Kafka in PATH
  • Mac OS X - Using brew
  • Mac OS X - Start Zookeeper and Kafka
  • Mac OS X - Summary
  • Linux - Download and Setup Kafka in PATH
  • Linux - Start Zookeeper and Kafka
  • Linux - Summary
  • Windows - Download Kafka and PATH Setup
  • Windows - Start Zookeeper & Kafka
  • Windows - Summary
CLI (Command Line Interface) 101
  • CLI Introduction
  • WINDOWS WARNING: PLEASE READ
  • Kafka Topics CLI
  • Kafka Console Producer CLI
  • Kafka Console Consumer CLI
  • Kafka Consumers in Group
  • Kafka Consumer Groups CLI
  • Resetting Offsets
  • CLI Options that are good to know
  • What about UIs? Conduktor
  • Conduktor - Demo
  • KafkaCat as a replacement for Kafka CLI
  • Quiz on CLI
Kafka Java Programming 101
  • Intro to Kafka Programming
  • Installing Java 8 & IntelliJ Community Edition
  • Creating Kafka Project
  • Java Producer
  • Java Producer Callbacks
  • Java Producer with Keys
  • Java Consumer
  • Java Consumer inside Consumer Group
  • Java Consumer Seek and Assign
  • Client Bi-Directional Compatibility
  • Configuring Producers and Consumers
  • Quiz on Java Programming 101
===== Kafka Real World Project =====
  • Real World Project Overview
  • Real World Exercise
Kafka Twitter Producer & Advanced Configurations
  • Producer and Advanced Configurations Overview
  • Twitter Setup
  • Producer Part 1 - Writing Twitter Client
  • Producer Part 2 - Writing the Kafka Producer
  • Producer Configurations Introduction
  • acks & min.insync.replicas
  • retries, delivery.timeout.ms & max.in.flight.requests.per.connection
  • Idempotent Producer
  • Producer Part 3 - Safe Producer
  • Producer Compression
  • Producer Batching
  • Producer Part 4 - High Throughput Producer
  • Producer Default Partitions and Key Hashing
  • [Advanced] max.block.ms and buffer.memory
  • Quiz on Producer Configurations
  • Refactoring the Project
Kafka ElasticSearch Consumer & Advanced Configurations
  • Consumer and Advanced Configuration Overview
  • Setting up ElasticSearch in the Cloud
  • ElasticSearch 101
  • Consumer Part 1 - Setup Project
  • Consumer Part 2 - Write the Consumer & Send to ElasticSearch
  • Delivery Semantics for Consumers
  • Consumer Part 3 - Idempotence
  • Consumer Poll Behaviour
  • Consumer Offset Commit Strategies
  • Consumer Part 4 - Manual Commit of Offsets
  • Consumer Part 5 - Performance Improvement using Batching
  • Consumer Offsets Reset Behaviour
  • Consumer Part 6 - Replaying Data
  • Consumer Internal Threads
  • Quiz on Consumer Configurations
===== Kafka Ecosystem & Real-World Architectures =====
  • Kafka in the Real World