Manoj Das
About Manoj Das
Manoj Das is a Senior Data Engineer with extensive experience in data processing and analytics. He has worked at Softcrylic since 2017 and previously held positions at Tata Consultancy Services and Cognizant, contributing to various data engineering projects.
Work at Softcrylic
Manoj Das has been employed at Softcrylic as a Senior Data Engineer since 2017. In this role, he has contributed to various projects, including the development of a config-driven file processing framework in Python. This framework is designed to efficiently handle CSV, Excel, and text files with headers and footers. Additionally, he has developed a Spark structured streaming application utilizing Kafka and Spark 3.0.1, which provides streaming data to the digital AI team. His work at Softcrylic emphasizes the integration of advanced data engineering practices and tools.
Previous Experience at Tata Consultancy Services
Before joining Softcrylic, Manoj Das worked at Tata Consultancy Services as a Software Developer from 2011 to 2014. During his three years at TCS, he was involved in building a scalable analytics and insights platform. This platform was aimed at identifying potential avenues for revenue increase and debt reduction, showcasing his ability to contribute to significant business objectives through data-driven solutions.
Experience at Cognizant
Manoj Das served as a Senior Data Engineer at Cognizant from 2014 to 2017. His three years at Cognizant allowed him to further develop his expertise in data engineering. He worked on various projects that enhanced data processing and analytics capabilities, preparing him for his current role at Softcrylic. His experience at Cognizant contributed to his skills in managing large datasets and optimizing data workflows.
Education and Expertise
Manoj Das holds a Master of Computer Applications (MCA) degree from ITER, Bhubaneswar, Odisha, where he studied from 2008 to 2011. Prior to that, he earned a Bachelor of Science (BS) in Physics from Ravenshaw University, studying from 2005 to 2008. His foundational education includes ten years at SASS, Taladanda, Odisha, from 1993 to 2003. This educational background provides him with a strong understanding of computer applications and analytical skills relevant to his work in data engineering.
Technical Projects and Contributions
Throughout his career, Manoj Das has been involved in several technical projects that demonstrate his capabilities as a data engineer. He designed Redshift Spectrum to query external data from Redshift, enhancing query performance and cost optimization. He also created and automated Airflow DAGs for transferring large files from multiple warehouse SFTP servers to an S3 data lake, which included a Slack notification service for daily data sync status between RDS and Redshift. Additionally, he developed an application in Bash script and Avro file format to manage frequent schema changes in the Hive metastore.