Amit Agarwal
About Amit Agarwal
Amit Agarwal is a Principal Engineer specializing in Distributed AI Cloud Platform and Infrastructure at Modular, with previous experience at Microsoft where he held various engineering roles focused on AI and cloud technologies. He has a strong background in optimizing AI inference runtimes and developing large-scale deep learning frameworks.
Work at Modular
Amit Agarwal currently serves as Principal Engineer for the Distributed AI Cloud Platform & Infra at Modular. He has been in this role since 2022, contributing to the development and optimization of cloud-based AI solutions. His work focuses on enhancing infrastructure capabilities to support distributed AI applications, ensuring robust performance and scalability.
Previous Experience at Microsoft
Amit Agarwal has extensive experience at Microsoft, where he held several key positions. He worked as a Principal Engineer/Manager for the Azure AI Platform and Cognitive Services from 2018 to 2022. Prior to this, he served as a Principal Software Engineer in Speech Services and AI & Research, contributing to significant advancements in AI technologies. His tenure at Microsoft also included roles as Senior Software Engineer and Senior SDE, where he focused on parallel computing platforms.
Education and Expertise
Amit Agarwal earned a Master of Science in Computer Science with a focus on Programming Languages and Systems from the University of California, Los Angeles, in 2008. He also holds a Bachelor of Technology in Computer Science and Engineering from the National Institute of Technology Warangal, obtained in 2002. His educational background supports his expertise in AI, cloud computing, and software engineering.
Achievements in AI Development
Amit Agarwal has made significant contributions to AI development during his career. He was a founding member and development lead of Microsoft's deep-learning framework CNTK, which facilitates large-scale distributed deep-learning training. He also optimized Microsoft Speech and OCR AI inference runtimes, achieving over 10x price/performance improvements. Additionally, he led the development of real-time Speech Recognition services for Microsoft Teams, enhancing operational efficiency.
Early Career and Technical Roles
Before joining Microsoft, Amit Agarwal worked at Mentor Graphics India Pvt. Ltd. as Lead Engineer in FPGA Incubation and as Senior Member Technical Staff in Expedition PCB Layout and Routing. His early career included roles focused on advanced systems and parallel computing, where he developed foundational skills in software engineering and technical leadership.