I am a Data Analytics professional with extensive experience in producing and consuming data, specializing in the end-to-end journey of data as a product to generate actionable business insights. Throughout my career, I have worked as a BI Analyst, Data Analyst, and Data & Analytics Engineer, focusing on Data Visualization, ETL, Data Modeling, and leveraging technologies such as Google Cloud Platform, Google BigQuery, Apache Beam, AirFlow, SQL, Power BI, and Looker Studio.

Currently, I work as a software and data engineer, developing data solutions. In my free time, I contribute to the Open Source community by creating libraries for Python developers, building end-to-end data applications, and advancing observability practices with OpenTelemetry, distributing these solutions through GitHub Packages and Google Cloud Platform.

• Python (FastAPI, Flask)
• SQL with technologies: BigQuery, MySQL, MSSQL, Postgress, PL/SQL)
• Golang

• Google Cloud Platform
• Docker
• GitHub Actions
• CI/CD

• Apache Airflow
• Apache Spark
• Apache Beam
• ETL/ELT
• Data Modeling
• Data Warehousing
• Data Lakehouse

• Power BI
• Looker Studio
• Data Analysis

• LinkedIn
• Website

• api-to-dataframe - Python library that simplifies obtaining data from API endpoints by converting them directly into Pandas DataFrames. This library offers robust features, including retry strategies for failed requests.

• currency-quote - Complete solution for extracting currency pair quotes data with comprehensive testing, parameter validation, flexible configuration management, Hexagonal Architecture, CI/CD pipelines, code quality tools, and detailed documentation.

• data-pipeline-async - Pipeline for processing and consuming streaming data from Pub/Sub, integrating with Dataflow for real-time data processing

• data-pipeline-sync - ETL Process for Currency Quotes Data" project is a complete solution dedicated to extracting, transforming and loading (ETL) currency quote data. This project uses several advanced techniques and architectures to ensure the efficiency and robustness of the ETL process.

• Medium Article - Having a personal website is the best engineering project you can do for yourself.

⭐️ From IvanildoBarauna