Abhishek Khandelwal
About Abhishek Khandelwal
Abhishek Khandelwal is a Lead Data Engineer at AirAsia, specializing in Vertica implementation and Teradata performance tuning. He has extensive experience in data pipeline automation and containerization technologies.
Work at AirAsia
Abhishek Khandelwal has been serving as the Lead Data Engineer at AirAsia since 2021. In this role, he is responsible for overseeing various data engineering tasks, including the implementation of data solutions and managing data workflows. His position is based in Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia. His contributions include developing and deploying data pipelines, ensuring efficient data handling processes, and providing post-production support.
Data Engineering Expertise
Abhishek Khandelwal has extensive experience in end-to-end Vertica implementation, which encompasses installation, upgrades, development, deployment, and performance tuning. He has a strong background in Teradata systems, focusing on query performance tuning and utilizing tools such as TASM, DBQL, and Viewpoint. His proficiency extends to Teradata utilities, including BTEQ, Fast Export, Fast Load, Multi Load, TPUMP, and TPT, which are essential for data export and load operations.
CI/CD and Automation Skills
Abhishek has created CI/CD pipelines using GitLab to automate the deployment of data pipelines. This automation enhances the efficiency and reliability of data operations, allowing for quicker updates and deployments. His experience in containerization environments, specifically with Docker and Kubernetes, further supports his ability to manage and deploy applications in a scalable manner.
Technical Knowledge and Tools
Abhishek Khandelwal possesses in-depth knowledge of the Spark Framework and its architecture, including Spark SQL. He has also implemented a proof of concept using Apache Flume to assess its feasibility for a project. Additionally, he is familiar with scheduling tools such as Airflow, Control-M, and Crontab, which are critical for managing data workflows and ensuring timely data processing.