MLOps Engineer

ABOUT CLIENT

Our client is a leading research company specializing in technology innovation

JOB DESCRIPTION

Develop and maintain training and inference pipelines using PyTorch, which includes DDP support, mixed precision, checkpointing, experiment versioning, and reproducible evaluation workflows.
Take ownership of and advance inference serving infrastructure using vLLM and SGLang, with a focus on debugging issues in inference stacks like tool call parsers and reasoning parsers, and optimizing for throughput and latency.
Create and sustain robust tooling in Python and C++ to aid the complete training lifecycle, from data ingestion to model release.
Optimize compute workloads for bare-metal environments, encompassing CPU/GPU utilization, memory bandwidth, and I/O throughput.
Address low-level networking issues, distributed training errors, and hardware bottlenecks across NCCL, MPI, and high-speed interconnects like InfiniBand and RoCE.
Set up and manage ML environments, covering containers, package management, GPU drivers, and runtime configurations.
Establish CI/CD patterns for AI workloads, encompassing training, evaluation, quantization, and model release workflows.
Integrate monitoring, alerting, anomaly detection, and incident response for both training jobs and inference services.
Contribute to shared platform capabilities across reliability, observability, and cost management.
Develop and maintain scalable runtime infrastructure for model-backed services and APIs, including support for LLM-backed APIs, MCP servers, and agentic systems.

JOB REQUIREMENT

Proficiency in PyTorch internals, including DDP, FSDP, mixed precision training, TorchScript, and torch.compile.
Strong programming skills in Python and C++, with the ability to understand and modify unfamiliar codebases.
Solid understanding of computer science basics including data structures, concurrency, operating systems, and memory management.
Practical experience with vLLM and SGLang for production inference serving, serving quantized models such as FP8, INT8, and NVFP4.
Experience with RLHF and PPO training pipelines, including frameworks like veRL and TRL, and integration of reward models.
Solid understanding of distributed training setups, networking, and interconnects including NCCL, MPI, InfiniBand, and RoCE.
Experience in debugging and optimizing bare-metal Linux servers, including kernel parameters, NUMA topology, and GPU driver configuration.
Familiarity with job schedulers such as Airflow and experience in operating production-grade distributed infrastructure.
Strong understanding of containerized and cloud-native environments using Docker and Kubernetes.
Familiarity with ML compiler stacks such as LLVM, MLIR, TensorRT, or XLA.
Knowledge of model quantization techniques and deployment optimization, including GPTQ, AWQ, and bitsandbytes.
Contributions to open source ML projects, including PyTorch, vLLM, SGLang, or related inference and training tooling.
Experience with infrastructure-as-code tools such as Ansible, Terraform, or Nix for reproducible cluster setup.
Experience with custom or on-premise deployments, local clusters, or edge inference.
Familiarity with observability stacks like Prometheus, Grafana, or OpenTelemetry applied to training and inference workloads.
Experience building infrastructure for agentic systems including secure tool access, orchestration, and isolation boundaries.
Passion for clean, well-documented code and detail-oriented engineering.

WHAT'S ON OFFER

Work remotely in an environment that promotes open-source collaboration
Enjoy 14 days of leave and unlimited sick days
Access to GPUs, AI credits, opportunities for fast career progression, and other perks.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Machine Learning, Devops

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Onsite, Remote

Job ID:

J01855

Status:

Close

Related Job:

Product Engineer (Flutter)

Ho Chi Minh - Viet Nam

Product

  • Flutter

Own products and features from beginning to end - originate ideas, understand the strategy and goals behind them, ship to production with real users, iterate on feedback, and stay responsible for their ongoing success. Scope features and projects, including writing handover / technical design documents (as built) - the person who built a feature is the best person to document it. Improve application performance - ship technical improvements that make the product faster, more stable, and ready to scale. Sweat the UI and interaction details - crafting a clean, pleasant experience is a daily habit, not an afterthought. Improve how we work, not just what we build: refine development processes, drive improvements in code quality and engineering best practices - and hold a zero-bug standard: bugs get fixed promptly, not stockpiled in a backlog. Work closely with designers to craft thoughtful UX/UI - ship and own the basic experience using the design system, deciding when to bring in design to polish - and collaborate with the Customer Success team to learn how the product is actually being used. Bring a tester's mindset - testing is part of building, not someone else's job. You own the quality of what you ship and stand behind it.

Negotiation

View details

Featured Job

Product Engineer (Web)

Ho Chi Minh - Viet Nam

Product

  • Angular
  • Typescript

Own products and features from beginning to end - originate ideas, understand the strategy and goals behind them, ship to production with real users, iterate on feedback, and stay responsible for their ongoing success. Scope features and projects, including writing handover / technical design documents (as built) - the person who built a feature is the best person to document it. Improve application performance - ship technical improvements that make the product faster, more stable, and ready to scale. Improve how we work, not just what we build: refine development processes, drive improvements in code quality and engineering best practices - and hold a zero-bug standard: bugs get fixed promptly, not stockpiled in a backlog. Work closely with designers to craft thoughtful UX/UI - ship and own the basic experience using the design system, deciding when to bring in design to polish - and collaborate with the Customer Success team to learn how the product is actually being used. Bring a tester's mindset - testing is part of building, not someone else's job. You own the quality of what you ship and stand behind it.

Negotiation

View details

Principal Engineer (Java)

Ho Chi Minh - Viet Nam

Product

  • Java

Provide hands-on leadership to the design, development, and deployment of technical solutions; Collaborate with other NAB's technology leaders towards improving and fulfilling the NAB technical direction; Evangelise and promote Java best practices; Be passionate about Java and understand how to implement advancement for existing or new systems; Lead and conduct training to empower engineers on sufficient programming skills; Design, develop, review, implement, and manage Java application code and services for the production and pre-release environments; Design, develop, review, implement, and manage continuous integration, build management and deployment scripts, systems, and any code as required; Participate in Agile software development, prototyping, and code review with international development teams to build scalable microservices-based products and APIs using Java technologies on AWS or Azure cloud architecture; Understand the requirements of the customer or business and utilize this knowledge to develop applications that are consistent with this; Work with delivery teams to achieve success through development using CI/CD and DevOps practices, processes, and tooling; Provide robust coding practices, solid unit/component test coverage, and debugging code; Fulfil other tasks as assigned by your People Leader and/or authorized representative of NAB Vietnam from time to time.

Negotiation

View details