Madhavan Sidharthan
About Madhavan Sidharthan
Madhavan Sidharthan is a Senior Data Engineer at Transamerica, where he has worked since 2022. He has extensive experience in data engineering, specializing in application development using Spark, Hadoop, and Azure Data Factory.
Work at Transamerica
Madhavan Sidharthan has been employed at Transamerica as a Senior Data Engineer since 2022. In this role, he has developed strong analytical skills to analyze reports for investments in multiple private firms. His position is remote, allowing him to contribute effectively from the United States.
Previous Experience in Data Engineering
Prior to his current role, Madhavan worked at Blu Omega as a Senior Data Engineer from 2021 to 2022, also in a remote capacity. He has experience as a Data Engineer at GRAX from 2017 to 2019 in New Orleans, Louisiana, and at Hilton Memphis from 2019 to 2021, where he held a similar position. Additionally, he worked at Jhon Deere Equipment Private Limited as a Data Engineer from 2015 to 2017 in Moline, Illinois.
Education and Expertise
Madhavan Sidharthan earned a Bachelor's degree in Computer Science from New England College, completing his studies from 2011 to 2015. He possesses extensive expertise in designing and developing applications using technologies such as Apache Hadoop, Cloudera, and Hortonworks. He is also highly proficient in Spark, Scala, and PySpark.
Technical Skills and Projects
Madhavan has demonstrated proficiency in implementing data pipelines using Azure Data Factory, integrating it with various data sources. He has developed Python scripts to automate the ETL process utilizing Apache Airflow and CRON scripts on Unix operating systems. His experience includes successfully migrating data from traditional databases to Hadoop and NoSQL databases.