Entry Level
Software Engineer-AI/ML, Inference Team - AWS Neuron
Amazon · Seattle, Washington, USA
About this role
- Contribute core serving features to open-source inference frameworks such as vLLM and SGLang — implementing and upstreaming support for continuous batching, paged attention, quantization, and distributed inference on Neuron.
Sign up free to open the full description on Amazon's careers page
Skills mentioned
JavaC++C#CUDALLMAWSMachine Learning