Sagar M

Major Projects

Scalable Financial Data Pipeline with Real-Time Reporting and Visualization

Built a fully automated, serverless ETL pipeline using AWS services (Lambda, S3, Glue, Athena) to process large-scale financial usage data across multiple sources. Integrated Amazon Redshift for optimized querying and Tableau dashboards for real-time business reporting. Set up CI/CD with GitLab and managed infrastructure using Terraform, ensuring scalable, low-latency performance with clean, production-ready code and high data reliability.

USA

Cloud & Data Services:

Amazon S3
Athena
AWS Lambda
Glue

Infrastructure & Automation:

GitLab CI/CD
Terraform

Programming & Query Languages:

Python
SQL

Databases & Storage:

S3 Bucket

Data Visualization:

Tableau Dashboards

AI:

ETL Pipelines
Glue Jobs
Lambda Functions

Centralized Data Observability Platform for Metadata Governance and Reliability

Designed and implemented core modules for a unified data observability platform, enabling metadata profiling, secure querying, and pipeline governance across 25+ data connectors. Built Airflow-based ingestion pipelines, integrated systems like Snowflake and Databricks, and developed Trino-FastAPI-powered query management. Streamlined deployment with Docker and AWS CI/CD, enforced licensing with Keygen, and maintained modular code while collaborating via GitHub and Jira for efficient product delivery.

USA

Cloud:

AWS

Core Stack:

Airflow
FastAPI
Python
SQL

Database:

MySQL
Snowflake

DevOps & Tools:

CI/CD
Docker

Snowflake Native Application for Real-Time Data Profiling and Quality Monitoring

Developed a Snowflake-native application from the ground up to perform real-time data profiling and rule-based quality checks within the Snowflake ecosystem. Leveraged Streamlit for UI and Snowflake for computation and storage. Designed a structured architecture for storing profiling results, rules, and execution logs. Enabled both manual and scheduled validations, integrated policy enforcement workflows, and built user-facing features for monitoring, customization, and seamless in-app governance.

USA

Platform:

Snowflake

Core Stack:

Python
SQL
Streamlit

Role-Based Health Analytics Dashboard for Injury & Recovery Insights

Designed and built a role-based, multi-client Tableau dashboard to track workplace injuries, treatment progress, and recovery bottlenecks. Integrated drill-down body map visualizations and dynamic time-based filters for detailed trend analysis. Developed ranking sheets highlighting top recovery barriers and optimizing user experience through stakeholder collaboration. Implemented secure access control and environment segmentation, ensuring scalable and compliant deployment.

Australia