Pedro águas Marques
About Pedro águas Marques
Pedro Águas Marques is a Data Engineer based in Lisbon, Portugal, currently employed at Carpe Data since 2022. He has a background in software engineering and data science, with previous roles at Forecast IT, Gympass, and Vodafone.
Work at Carpe Data
Pedro águas Marques has been employed at Carpe Data as a Data Engineer since 2022. In this role, he has implemented a scalable data pipeline orchestration system that manages 10TB of data. He has developed new data pipeline steps in Scala to integrate additional data sources into a 40TB pipeline. Additionally, he has automated data pipelines that handle over 50TB of data, involving more than 500 steps using Airflow. Pedro utilizes Agile methodology, conducting retrospectives after each sprint to enhance team performance and project outcomes.
Previous Experience in Data Science and Engineering
Before joining Carpe Data, Pedro worked at Gympass as a Data Scientist from 2021 to 2022. He also held a position at Vodafone as a Web Services Developer for two months in 2020. Earlier in his career, he worked at Forecast IT - Sistemas de Informação as a Software Engineer for five months in 2017. His diverse experience in data science and engineering has equipped him with a broad skill set applicable to various data-driven projects.
Education and Expertise
Pedro holds a Bachelor of Engineering in Computer Engineering from the University of Lisbon, which he completed from 2017 to 2020. He furthered his education at Instituto Superior Técnico, where he earned a Master of Engineering in Computer Science with a specialization in Artificial Intelligence from 2020 to 2022. His academic background provides a strong foundation in both theoretical and practical aspects of data engineering and computer science.
Technical Skills and Tools
In his role as a Data Engineer, Pedro has developed proficiency in various technical skills and tools. He has experience with Scala for developing data pipeline steps and utilizes Airflow for automating complex data pipelines. His work involves managing large volumes of data, demonstrating his capability in handling scalable data solutions. Pedro's expertise in Agile methodology further enhances his effectiveness in collaborative project environments.