DATA ENGINEERING

Transformation Amazon Athena and AWS Glue using DBT

Building a Modern Data Lakehouse with dbt, Amazon Athena, and AWS Glue

Airflow Pipeline for PostgreSQL-BigQuery

Simple Airflow ELT Pipeline for PostgreSQL-BigQuery

DBT Snowflake Model

Design and Build DBT for Snowflake Model

IDX Stock App: Real-Time Data Streaming with Kafka Raft

IDX Stock — Real Time Data Streaming with Kafka Raft

Real-Time Data Processing with Flink and Kafka

Consuming Kafka Topics using Python Flink Table API

IDX Stock App: Real-Time Stock Prediction with Flink Machine Learning

IDX Stock — Real Time Data Prediction with Flink-Kafka-MongoDB

Multi Threading Web Crawler