Wu Ji Peng
About Wu Ji Peng
Wu Ji Peng is a Bigdata Development Engineer currently working at 上海久耶 and Telenav. He has led significant transformations in data infrastructure and contributed to the open-source community.
Title at Shanghai久耶
Wu Ji Peng is currently employed as a Bigdata Development Engineer at 上海久耶 in China Shanghai. In this role, he has been instrumental in leading the transformation of the company's data infrastructure from an offline Hive platform to a real-time HBase platform.
Role at Telenav
Wu Ji Peng also holds the position of Bigdata Development Engineer at Telenav, where he works in Shanghai, China. His responsibilities include developing and implementing solutions for matching business address data with a standard four-level address database using Python machine learning libraries combined with Spark.
Education and Expertise
Wu Ji Peng studied 高分子材料 at 盐城工学院 and achieved a 学士 degree. He has extensive expertise in big data technologies, particularly in transforming data infrastructure, designing data warehouse models, and integrating data analytics tools.
Major Projects and Contributions
Wu Ji Peng has made significant contributions to various projects. He designed the data warehouse model for HBase and integrated Saiku with Phoenix for enhanced data analytics. He authored multiple patches and solutions for Apache Phoenix and Spark, addressing critical issues like memory leaks and data synchronization problems. He also developed shell scripts for semi-automated operations and Spark Job submissions, improving the efficiency of the big data platform.
Open-Source Community Involvement
Wu Ji Peng is actively involved in the open-source community, contributing to platforms like Apache JIRA and GitHub. His contributions include addressing issues in projects like Maxwell and DBeaver. His expertise in resolving operational issues such as Spark job anomalies and MySQL data synchronization delays has ensured high reliability and zero data loss for the platforms he works on.