"A Data Technology Enthusiast with a Flair for Seamless Integration π"
Hello! I'm a Data Engineer passionate about solving real-world problems using cutting-edge technology.
I love diving into random data facts and turning discoveries into storiesβwhether itβs through infographics, data analysis, or building pipelines. I let the data decide the adventure! πΊοΈ
I am also a Mechatronics Engineer currently pursuing my masterβs degree in Big Data. My journey bridges the realms of data engineering and industrial automation, with projects spanning:
- π οΈ Building scalable ETL pipelines: Turning chaotic data into meaningful insights at scale.
- π€ Designing and programming PLC systems: Bringing industrial automation to life with precision and logic.
- π Creating interactive dashboards: Telling stories with data, one visualization at a time.
- π¨ Crafting eye-catching infographics: Transforming numbers into memorable, impactful visuals.
- π³ Exploring cutting-edge tech: From Docker and Apache Airflow to PostgreSQL, Iβm always leveling up my toolkit.
- βοΈ Integrating IaaS solutions: Navigating the clouds of AWS, GCP, and Snowflake to deliver seamless infrastructure.
- Programming Languages: Python, SQL, JSON (structure and processing)
- Data Engineering Tools: Apache Airflow, Docker, PostgreSQL, APIs (OpenLibrary, Google Books, Slack), Google Cloud Console
- Data Analysis & Visualization: Matplotlib, Seaborn, Jupyter Notebooks, Looker Studio, Power BI
- ETL Processes: Robust pipeline creation, validation, and logging
- Automation: PLC programming (Rockwell Automation), HMI screen generation
- Version Control: Git/GitHub
- Soft Skills: Problem-solving, storytelling through data, adaptable to new tools and platforms
A scalable ETL pipeline crafted using Docker for portability, featuring Python, Airflow for orchestration, and PostgreSQL as the data repository. This pipeline extracts, transforms, and loads book data from OpenLibrary and Google Books APIs, while integrating Slack notifications for real-time updates. README written in Ye Old English!
βοΈ Key Features:
- Robust validation steps to ensure data integrity.
- Comprehensive logging for debugging and monitoring.
- Unit-tested to guarantee reliability. View Project Repository
A statistical exploration of whale strandings across the USA over a span of 10 years. This project uses Jupyter Notebooks to document findings, with visualizations powered by Matplotlib and Seaborn. Inspired by curiosity about animal behavior, this analysis delves into whether claims of "animal suicide tendencies" hold measurable truth.
π Highlights:
- Descriptive statistics for actionable insights.
- Visualization techniques to highlight trends and patterns.
- Curiosity-driven exploration into animal phenomena. View Project Repository
An automated pipeline designed for data extraction, transformation, and visualization of NFL game stats and schedules. Built with Python, this project incorporates tools like Excel, Google APIs, and Looker Studio to create dynamic dashboards. The pipeline features a portable HTML dashboard for monitoring progress and uses email notifications to keep stakeholders informed. View Project Repository
π Key Features:
- Web scraping for live data extraction.
- Cloud integration using Google Cloud credentials and APIs.
- Rigorous logging and validations for end-to-end reliability.
View Project Repository
A Python-powered automation tool designed to generate HMI screens and manipulate XML files, streamlining workflows in automotive plants. This project enhances productivity by automating repetitive tasks and reducing human error. π§ Key Features:
- Automated XML transformation for seamless HMI development.
- Tailored for efficiency in industrial automation.
- Accelerates deployment cycles in high-demand environments.
View Project Repository
Explore a collection of infographics crafted on diverse topics, blending creativity and analytical insights. These visualizations aim to communicate complex data in an engaging and digestible format.
π View Infographics Collection
---π‘ Fun Fact: I enjoy merging tech worlds, whether it's integrating data pipelines with PLCs or experimenting with niche tools to see how far they can go! π»β‘π€
π― On a Mission: To empower decisions with clean, reliable data and automate repetitive tasks into oblivion. π§ββοΈβ¨