Introduction
  • Course Objective
  • About Me
  • Introduction Agenda
  • Prerequisites
  • Components
  • Introduction to Spark
  • Introduction to Kafka
  • Introduction to Cassandra
  • Real-time Fraud Detection Architecture
Real-time Fraud Detection Demonstration
  • Agenda
  • Install VirtualBox and Image
  • Code Setup
  • Start Servers
  • Run Spark Jobs from Intellij
  • Clean Up
  • Airflow Configuration
  • Build Project and Start Servers
  • Airflow Automation
Code Walkthrough
  • Agenda
  • Project Structure
  • Spark Initial Import Job
  • Spark ML Job
  • Spark Streaming Initialization and Consumption
  • Spark Streaming Processing and Prediction
  • Spark Streaming Exactly Once Semantics
  • Spark Streaming Grace-full Shutdown
  • Kafka Producer
  • Fraud Alert Dashboard
  • Airflow Automation
  • Course Conclusion