Satvik Jadhav, Data Engineer
TECHNICAL SKILLS
Data Engineering: Data Warehousing/Modeling, Airflow, Delta Lake, CICD, Docker, Terraform, dbt
Big Data: Apache Spark, Apache Druid, Apache Superset, Apace Kafka
Cloud: Redshift, Amazon ECS, Amazon EMR, Looker
Programming: Python, SQL (Postgres, Redshift), Shell Scripting, Git
EXPERIENCE
Data Engineer | Ocean Technologies Group October 10, 2022 - Present
  • Architected scalable data pipelines using Airflow, Azure Data Factory, and AWS EMR for centralized data storage in Postgres, S3, and Apache Druid.
  • Utilized containerization with AWS ECS to implement open-source data infrastructure tools like Druid and Superset, reducing data infrastructure costs by $6000/month.
  • Enhanced query performance by 30% and reduced stored function run time by 80-90% through optimizing Facts/Dimensions tables, significantly accelerating data retrieval and updates.
  • Deployed Data Lakehouse (DeltaLake) using S3, AWS EMR, and PySpark, improving data availability and organization.
  • Implemented CICD using Liquibase for database versioning, reducing deployment errors by 25% and ensuring data consistency for critical projects.
Data Analyst/Engineer | Greenlight Planet March 1, 2021 - October 7, 2022
  • Created and maintained Airflow workflows for spark jobs and EMR clusters, cutting data processing downtime by 20% and improving system reliability.
  • Optimized Redshift queries using appropriate distribution and sort keys to improve CPU usage from 100% to 50% - 65%
  • Minimized Redshift resource consumption by migrating data processing to an AWS EMR cluster, resulting in monthly cost savings of up to $1000
  • Mentor Analysts in use of LookML and SQL, and conduct company wide presentations for the same
  • Decreased data load cycle time by two hours using incremental loading techniques on large datasets in Redshift and AWS EMR.
  • Developed an alerting system in Python which reduced query blockage on Looker by 40% and ensured uninterrupted data analysis and reporting for improved business decision-making.
PROJECTS
Musify June, 2022 - September, 2022
  • An end to end data engineering project made with Kafka, Spark Streaming, dbt, Docker, Airflow, Terraform, GCP and much more
Algo Trading Dec, 2020 - Dec, 2021
  • Algo Trading Futuers and Options via Discord and Broker's API
  • All scripts are hosted on Python Anywhere for 24/7 avalibility, and are automated
  • Set up multiple scripts for automated signal generation; which is then output to Discord
  • Created multiple Discord Bots to track different strategies' trade and log the same
  • Use of Github and Git for version control
EDUCATION
Punjab Engineering College, Chandigarh 2016 - 2020
B.Tech