Sai Sridhar Reddy Palli
About Sai Sridhar Reddy Palli
Sai Sridhar Reddy Palli is a Senior Data Engineer with extensive experience in data processing and integration, currently working at Benefitfocus since 2022. He has a background in Spark and Hadoop development, data warehousing, and advanced analytics, having previously held positions at Teladoc Health, Harvard Pilgrim Health Care, and Mu Sigma Inc.
Work at Benefitfocus
Currently, Sai Sridhar Reddy Palli serves as a Senior Data Engineer at Benefitfocus, a position he has held since 2022. In this role, he focuses on engineering scalable data processing solutions using Databricks. He is involved in orchestrating complex data workflows with Airflow to ensure robust automation and efficiency in data handling. His expertise includes managing and integrating data warehousing with Snowflake for advanced analytics, contributing to the company's data-driven initiatives.
Previous Experience at Teladoc Health
Prior to his current role, Sai worked at Teladoc Health as a Spark & Hadoop Developer from 2020 to 2021. During his tenure in Purchase, New York, he performed Hive and Spark tuning, utilizing partitioning and bucketing concepts in parquet files. His work contributed to optimizing data processing and enhancing the performance of data workflows within the organization.
Background in Data Engineering
Sai has a diverse background in data engineering, having previously worked at Harvard Pilgrim Health Care as an Oracle PL/SQL Developer from 2018 to 2020. His responsibilities included administering RDBMS operations with Oracle to ensure data integrity. Additionally, he developed PySpark scripts for data implementation pipelines, showcasing his proficiency in various data processing technologies.
Education and Expertise
Sai earned his Bachelor's degree in Computer Science from Shanmugha Arts, Science, Technology and Research Academy, completing his studies from 2011 to 2015. His educational background laid the foundation for his expertise in data engineering and analytics. He has developed a strong skill set in technologies such as Hadoop, Spark, and Airflow, and has experience working with data on platforms like HDFS and S3.
Technical Skills and Projects
Throughout his career, Sai has demonstrated proficiency in various technical skills, including the creation of complex Hive queries for reporting insights and the engineering of data processing workflows using Spark SQL and DataFrames. He has also leveraged the Oozie workflow engine for scheduling tasks and developed multi-level sub workflows with Oozie Coordinators for claims loading to Hive tables. His work reflects a strong understanding of data integration and processing methodologies.