Marcos Camargo
About Marcos Camargo
Marcos Camargo is a Data Engineer with extensive experience in deploying Apache Airflow and managing ETL and ELT integrations. He currently works at Sinch and has a background in data engineering and scientific research, utilizing various cloud technologies and tools.
Work at Sinch
Marcos Camargo has been employed at Sinch as a Data Engineer since 2021. In this role, he has led a near real-time data lake project, utilizing technologies such as EMR, Kafka, Spark, Delta, Trino, and Terraform. His responsibilities include deploying Apache Airflow with various executors for orchestrating ETL and ELT integrations. He also focuses on maintaining GCP Data Lake and ensures compliance with data governance and privacy standards, including GDPR and LGPD.
Education and Expertise
Marcos Camargo studied at Universidade de São Paulo, where he earned a Bachelor's degree in Computer Science from 2015 to 2019. His education provided a strong foundation in data engineering principles and practices. He actively engages in Python development for ETLs, APIs, and machine learning products, and is currently enhancing his skills in Scala and Apache Spark to further his expertise in big data.
Background
Before joining Sinch, Marcos worked at Wavy Global as a Data Engineer from 2019 to 2021. He also gained experience as a Junior Data Engineer at Birdie for five months in 2019 and as a Data Science Intern at the same company for eleven months from 2018 to 2019. Earlier in his career, he was involved in scientific research at CNPq, focusing on image classification from 2016 to 2017.
Technical Skills and Tools
Marcos Camargo has extensive experience with various data engineering tools and platforms. He utilizes Google Cloud Platform (GCP) tools such as BigQuery, Cloud Storage, PubSub, Dataflow, and Data Studio. Additionally, he employs AWS services like S3, EMR, Glue, and CloudWatch in his projects. His technical skill set includes deploying services and APIs using Docker containers and Kubernetes, integrated with CI/CD pipelines.
Data Integration and Governance
In his current role and previous positions, Marcos has worked on integrating various data sources, including both relational and non-relational databases. He maintains a focus on data governance and privacy best practices, ensuring compliance with regulations such as GDPR and LGPD. His experience in developing batch data integration from an event-driven architecture using Kafka and BigQuery further demonstrates his capabilities in this area.