Dipin Hora
About Dipin Hora
Dipin Hora is a Manager and Principal Engineer specializing in Data Platforms at Movable Ink, with extensive experience in data engineering and architecture across various companies. He has a strong background in optimizing data systems and has led significant migrations and improvements in data management processes.
Current Role at Movable Ink
Dipin Hora serves as the Manager and Principal Engineer for the Data Platform at Movable Ink since 2019. In this role, he focuses on optimizing data architecture and improving data management processes. He has implemented a comprehensive multi-region data and BI strategy, transforming existing data systems into a unified source of truth. His contributions include managing relationships between AWS Redshift and PostgreSQL teams, which has led to significant cost savings for the organization.
Previous Experience in Data Engineering
Dipin Hora has extensive experience in data engineering and architecture. He worked at Ipreo as a Data Engineer for nine months and later at Citi as a System Architect for Trade Data Warehouse. His tenure at Slalom Consulting as a Senior Data Engineer and at Wallaroo Labs as a Lead Software Engineer further solidified his expertise in data systems. Additionally, he served as a Solutions Architect at VerticalServe, where he contributed to various data solutions.
Technical Contributions and Innovations
Dipin Hora has made significant technical contributions throughout his career. He created a unit and integration test framework for Apache Airflow using Python, AWS Redshift, EMR, and S3. He successfully migrated a multi-terabyte self-hosted PostgreSQL database to AWS Aurora, improving system performance during critical periods. His implementation of a novel caching solution for SQL queries resulted in substantial reductions in load and latency.
Education and Academic Background
Dipin Hora completed his high school education at Bronx High School of Science, achieving a High School Diploma from 1994 to 1998. He then attended New York University, where he studied Computer Science with Honors, along with minors in Philosophy and Studio Art, earning a Bachelor of Arts degree from 1999 to 2002.
Achievements in Data Management
Throughout his career, Dipin Hora has achieved notable improvements in data management and infrastructure costs. He successfully designed Redshift schemas and ETL jobs that support a scale of 2 PB and handle tens of billions of messages daily. His optimizations and architectural improvements have led to a 15% reduction in company-wide infrastructure costs.