Course Overview and Introduction
  • Course Overview
  • Important Message
Code Download
  • Code Download
Kafka Quick Setup in AWS
  • What is AWS CloudFormation
  • Target Architecture and Setup
  • Create AWS Account & Cost of Tutorial
  • [Hands-On] Deploy Zookeeper Using CloudFormation
  • [Hands-On] Deploy Kafka Using CloudFormation
  • [Hands-On] Overview of our Zookeeper Cluster
  • [Hands-On] Overview of our Kafka Cluster
  • [Hands-On] Stopping the Kafka Cluster
Kafka Administration Setup
  • [Hands-On] Overview and Setup of Monitoring Machine
  • IMPORTANT: Security
  • [Hands-On] Setup Zoonavigator
  • [Hands-On] Setup Kafka Manager
  • [Hands-On] Setup Kafka Monitor
  • Commands Cheat Sheet
Kafka Monitoring Setup: Grafana + Prometheus
  • Overview of Monitoring
  • [Hands-On] Setting up Prometheus + Kafka Broker 1
  • [Exercise] Broker 2 & 3 Prometheus Setup
  • [Solution] Broker 2 & 3 Prometheus Setup
  • [Exercise] Zookeeper & Prometheus Setup
  • [Solution] Zookeeper & Prometheus Setup
  • [Hands-On] Setup Grafana on Administration Server
  • [Hands-On] Setup Kafka Dashboard on Grafana
  • Important Metrics to monitor
  • [Hands-On] Adding Graphs to Grafana
  • [Exercise] Adding more graphs to Grafana
  • [Solution] Adding more graphs to Grafana
  • Find Grafana dashboard in the code
  • What about monitoring Kafka Connect, Kafka Streams, etc?
  • [Hands-On] Observing Grafana when we kill a broker
  • Considerations to make the setup production-ready
Kafka Operations
  • [Hands-On] Install Jolokia Agent on Broker 1
  • [Exercise] Install Jolokia on Broker 2 & 3
  • [Solution] Install Jolokia on Broker 2 & 3
  • [Hands-On] Install Rolling Restart Script
  • [Hands-On] Run Roll Restart Script
  • [Hands-On] Updating Configurations 1st method (rolling restart)
  • [Hands-On] Updating Configurations 2nd method (kafka-configs command)
  • [Hands-On] Rebalancing Partitions using plain commands and JSON
  • [Hands-On] Rebalancing Partitions using Kafka Manager
  • [Hands-On] Rebalancing Partitions using LinkedIn tools
  • [Hands-On] Increasing Replication Factor using plain commands and JSON
  • [Hands-On] Increasing Replication Factor using LinkedIn tools
  • [Hands-On] Adding Broker 4 using CloudFormation
  • [Exercise] Moving partitions over to Broker 4 using the CLI tools
  • [Solution] Moving partitions over to Broker 4 using the CLI tools
  • [Hands-On] Replacing a Broker keeping EBS Volume
  • [Hands-On] Replacing a Broker losing an EBS Volume
  • Removing a Broker Overview
  • [Exercise] Remove Broker 4
  • [Solution] Remove Broker 4
Kafka Cluster Upgrade
  • Upgrading a Kafka Cluster Overview
  • [Advanced] Zero Copy, Up and Down Conversions
  • [Hands-On] Kafka Broker Upgrade Step 1
  • [Hands-On] Kafka Broker Upgrade Step 2
  • [Hands-On] Kafka Broker Upgrade Step 3
  • [Hands-On] Kafka Broker Upgrade Step 4
  • [Hands-On] Kafka Broker Upgrade Step 5
Next Steps
  • Cleaning up AWS
  • Next Steps & Congratulations!
  • THANK YOU!
  • Bonus Lecture: Student Special Coupons for my Other courses