Introduction to Flink
  • Flink Introduction
  • Announcement
  • Batch Processing Vs Stream Processing
  • Hadoop Vs Streaming Engines (Spark & Flink)
  • Spark Vs Flink
  • Flink Architecture/Ecosystem
  • Flink's programming model | Flow of a Flink program
  • Installing Flink
Transformation operations of DataSet API
  • Default Code structure of a Flink Program
  • WordCount using Map, Flatmap, Filter, groupby | Part 1
  • WordCount using Map, Flatmap, Filter, groupby | Part 2
  • Joins - Inner join
  • Joins - Left, Right & Full Outer Join
  • Join Hints for Optimization (Exclusive feature)
DataStream API Operations
  • Data Sources & Sinks of Datastream API
  • First program using Datastream API
  • Reduce Operation
  • Fold Operation
  • Aggregation Operations in Flink
  • Split Operation
  • Iterate Operator
  • Assignment 1
Windows in Flink
  • Introduction to Windowing
  • Window Assigners
  • Various Time Notions of Windows in Flink
  • Tumbling Windows Implementation
  • Sliding Windows Implementation
  • Session Windows Implementation
  • Global Windows Implementation
Triggers & Evictors
  • Triggers in Windows
  • Evictors for Windows
Watermarks and Late elements
  • Watermarks, Late Elements & Allowed Lateness
  • How to generate Watermarks
  • Quiz 1
State, Checkpointing and Fault tolerance
  • What is a State in Flink
  • Checkpointing and Barrier Snapshoting
  • Incremental Checkpointing (New Feature)
  • Types of States
  • Value State Implementation
  • List State Implementation
  • Reducing State Implementation
  • Assignment
  • Managed Operator State Implementation
  • Implement Checkpointing in a Flink Program
  • The Broadcast State Implementation
  • Queryable State (Beta Version)
Interacting with Real-Time Data using Kafka
  • Getting Twitter data using its APIs
  • Adding Kafka to Flink as a Data source
Case Study 1 - Twitter data analysis using Flink
  • Twitter data analysis using Flink
Case Study 2 - Bank Real-Time Fraud detection
  • Identifying Fraud transactions in Real-Time
Case Study 3 - Stock data processing in Real-Time
  • Stock Real-Time Data Processing | Part 1
  • Stock Real-Time Data Processing | Part 2
Table & Sql API | Relational APIs of Flink
  • Introduction to Table & Sql API
  • How to register a Table in Relational APIs
  • Writing Queries in Table & Sql API
  • Quiz 2
Gelly API for Graph Processing
  • What is a Graph
  • Calculate Friends of Friends of a Person using GELLY Api
BONUS
  • Bonus lecture