Software Engineer vLLM
Series A Start-up and leading developer and maintainer of vLLM.
As a Software Engineer specializing in vLLM, you will be at the forefront of innovation and addressing critical challenges in model performance and efficiency. Your expertise in machine learning and high-performance computing will directly influence the development of a cutting-edge software platform, playing a pivotal role in the future of AI deployment and utilization.
Responsibilities:
- Develop robust Python and C++ code, focusing on vLLM systems, high-performance machine learning primitives, performance analysis and modeling, and numerical methods.
- Review code and contribute to the development of best practices within the team.
- Work closely with machine learning teams to optimize neural network performance in our engine.
Requirements:
- Extensive experience in writing high-performance code for GPUs and deep knowledge of GPU hardware.
- BS, MS, or PhD in computer science.
- Proficiency in mathematical software, especially linear algebra or signal processing.
- Expertise in modern C++ and Python.
- Experience with PyTorch.
- Proficiency in tensor computations.
- In-depth understanding of deep neural network models and techniques.
