1.54M jobs liveBrowse

Principal Machine Learning Infrastructure Engineer, Ads & Discovery at Roblox · Katori

Asks for

The ad says“You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining tool-agnostic and focused on achieving step-function improvements in model quality, throughput, latency, reliability, and cost.”
The ad says“You will investigate model, data, and systems tradeoffs end to end—from data pipelines and distributed training to low-latency inference and production serving. This includes designing efficient KV-cache strategies, applying pruning and quantization, optimizing GPU utilization and memory efficiency, and developing custom kernels where needed.”
The ad says“You will investigate model, data, and systems tradeoffs end to end—from data pipelines and distributed training to low-latency inference and production serving. This includes designing efficient KV-cache strategies, applying pruning and quantization, optimizing GPU utilization and memory efficiency, and developing custom kernels where needed.”
The ad says“Lead strategic planning and roadmap execution of scalable production-ready ML systems including model training, data pipelines, feature engineering and model inference.”
The ad says“You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining tool-agnostic and focused on achieving step-function improvements in model quality, throughput, latency, reliability, and cost.”
The ad says“You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining tool-agnostic and focused on achieving step-function improvements in model quality, throughput, latency, reliability, and cost.”
The ad says“You will investigate model, data, and systems tradeoffs end to end—from data pipelines and distributed training to low-latency inference and production serving. This includes designing efficient KV-cache strategies, applying pruning and quantization, optimizing GPU utilization and memory efficiency, and developing custom kernels where needed.”
The ad says“5+ years of experience designing, building, and deploying large-scale machine learning systems in production environments.”
The ad says“You will co-design models and systems, working at the intersection of model architecture and ML infrastructure, partnering closely with core modelers, data and AI infrastructure engineers, and product teams to push the boundaries of large-scale training and serving. Your work will span recommendation, search, and agentic applications, including large transformer architectures, LLMs, generative rankers, and efficient offline and online content-understanding systems.”
The ad says“Lead strategic planning and roadmap execution of scalable production-ready ML systems including model training, data pipelines, feature engineering and model inference.”
The ad says“You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining tool-agnostic and focused on achieving step-function improvements in model quality, throughput, latency, reliability, and cost.”
The ad says“You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining tool-agnostic and focused on achieving step-function improvements in model quality, throughput, latency, reliability, and cost.”

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators.

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there.

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

With Roblox Ads & Discovery business growing at a rapid rate, we are building large scale ads machine learning infrastructure to deliver more value to our users and our advertisers.

As a Machine Learning Infrastructure Engineer, you’ll build scalable, reliable, and high-performance infrastructure that powers ML systems across our organization. You’ll operate at the scales of hundreds of billions of engagements, and redefine how we deliver performance ads to hundreds of millions of users.

You will:

You will co-design models and systems, working at the intersection of model architecture and ML infrastructure, partnering closely with core modelers, data and AI infrastructure engineers, and product teams to push the boundaries of large-scale training and serving. Your work will span recommendation, search, and agentic applications, including large transformer architectures, LLMs, generative rankers, and efficient offline and online content-understanding systems.
You will investigate model, data, and systems tradeoffs end to end—from data pipelines and distributed training to low-latency inference and production serving. This includes designing efficient KV-cache strategies, applying pruning and quantization, optimizing GPU utilization and memory efficiency, and developing custom kernels where needed.
You are comfortable working across modern ML systems technologies such as FSDP, vLLM, SGLang, CUDA, distributed training frameworks, inference engines, and GPU kernels, while remaining tool-agnostic and focused on achieving step-function improvements in model quality, throughput, latency, reliability, and cost.
Lead strategic planning and roadmap execution of scalable production-ready ML systems including model training, data pipelines, feature engineering and model inference.
Own the architecture, establish engineering best practices of scalability, reliability, and cost-effectiveness of ML infrastructure (e.g., training, serving, feature).
Work closely with data scientists, ML engineers, platform teams, and product stakeholders to design, implement, and operate robust ML platforms that accelerate model development and deployment.
Stay abreast of industry trends in machine learning and infrastructure to ensure the adoption of leading-edge technologies and practices.

You have:

5+ years of experience designing, building, and deploying large-scale machine learning systems in production environments.
3+ years of experience tech leading ML infrastructure engineers
Strong communication skills and a collaborative approach to problem solving.
BS, MS, or Ph.D. in Computer Science, Engineering, or equivalent experience.

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits as described on this page.

Annual Salary Range

$295,250—$345,040 USD

Roles that are based in an office are onsite Tuesday, Wednesday, and Thursday, with optional presence on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations to candidates with qualifying disabilities or religious beliefs during the recruiting process.

For US based roles only, please note the Company may not be able to employ candidates for this role who have United States work authorization related to certain U.S. visa categories, or support future H-1B sponsorship at this time.