Jia Hao Chuah
About Jia Hao Chuah
Jia Hao Chuah is a Big Data Engineer with experience at FINRA and DePaul University, where he has worked on optimizing ETL pipelines and developing data processing solutions. He specializes in using AWS services and SparkSQL for handling large datasets and ensuring data quality.
Work at DePaul University
Jia Hao Chuah has been serving as a Graduate Assistant at DePaul University since 2019. In this role, he has contributed to various projects and initiatives within the Greater Chicago Area. His responsibilities include assisting with research and academic support, which has provided him with valuable experience in the field of data engineering.
Work at FINRA
Since 2020, Jia Hao Chuah has been employed as a Big Data Engineer at FINRA. In this capacity, he collaborates with business analysts and quality control teams to design data pipelines and create business requirement documents. His work involves developing and maintaining Big Data pipelines that process high-volume market data, ensuring compliance with SEC regulatory rules.
Technical Skills and Expertise
Jia Hao Chuah specializes in optimizing ETL pipeline performances by configuring EMR instances and employing techniques such as memory tuning and customized partitioners. He utilizes SparkSQL and Hive scripts for large data processing and has experience with Amazon AWS services, including S3, EMR, Lambda, and Redshift, to build ETL and Jenkins pipelines.
Data Quality and Testing
In his role at FINRA, Jia Hao Chuah performs data quality and unit testing using Python and SQL scripts. He audits results using tools such as AquaDataStudio and DataBricks. Additionally, he configures data quality control pipeline settings with AWS Lambda and employs AWS Athena for creating data visualization dashboards.
Agile Development Involvement
Jia Hao Chuah actively participates in Agile development methodology at FINRA. He uses Bitbucket for version control and Jira for task tracking, which enhances collaboration and project management within his team.