Inference Systems Backend Engineer - ARK Large Model Platform (Singapore)

Responsibilities
About the Team The Applied Machine Learning (AML) - Enterprise team provides machine learning platform products on VolcanoEngine with cloud native resource scheduling system which intelligently orchestrates different tasks and jobs with minimised costs of every experiment and maximised resource utilisation, rich modelling tools including customised machine learning tasks and web IDE, and multi-framework high performance model inference services. In 2021, through VolcanoEngine, we released this machine learning infrastructure to the public, to provide more enterprises with reduced costs of computation power, lower barriers to machine learning engineering and deeper developments in AI capabilities. Responsibilities -Responsible for the development and performance optimization of the Volcano Engine large model training and inference systems, including but not limited to model computation optimization, tuning thousand-GPU training clusters, distributed LLM inference sys...