MLOps Engineer

ABOUT CLIENT

Our client is a leading research company specializing in technology innovation

JOB DESCRIPTION

Develop and maintain training and inference pipelines using PyTorch, which includes DDP support, mixed precision, checkpointing, experiment versioning, and reproducible evaluation workflows.
Take ownership of and advance inference serving infrastructure using vLLM and SGLang, with a focus on debugging issues in inference stacks like tool call parsers and reasoning parsers, and optimizing for throughput and latency.
Create and sustain robust tooling in Python and C++ to aid the complete training lifecycle, from data ingestion to model release.
Optimize compute workloads for bare-metal environments, encompassing CPU/GPU utilization, memory bandwidth, and I/O throughput.
Address low-level networking issues, distributed training errors, and hardware bottlenecks across NCCL, MPI, and high-speed interconnects like InfiniBand and RoCE.
Set up and manage ML environments, covering containers, package management, GPU drivers, and runtime configurations.
Establish CI/CD patterns for AI workloads, encompassing training, evaluation, quantization, and model release workflows.
Integrate monitoring, alerting, anomaly detection, and incident response for both training jobs and inference services.
Contribute to shared platform capabilities across reliability, observability, and cost management.
Develop and maintain scalable runtime infrastructure for model-backed services and APIs, including support for LLM-backed APIs, MCP servers, and agentic systems.

JOB REQUIREMENT

Proficiency in PyTorch internals, including DDP, FSDP, mixed precision training, TorchScript, and torch.compile.
Strong programming skills in Python and C++, with the ability to understand and modify unfamiliar codebases.
Solid understanding of computer science basics including data structures, concurrency, operating systems, and memory management.
Practical experience with vLLM and SGLang for production inference serving, serving quantized models such as FP8, INT8, and NVFP4.
Experience with RLHF and PPO training pipelines, including frameworks like veRL and TRL, and integration of reward models.
Solid understanding of distributed training setups, networking, and interconnects including NCCL, MPI, InfiniBand, and RoCE.
Experience in debugging and optimizing bare-metal Linux servers, including kernel parameters, NUMA topology, and GPU driver configuration.
Familiarity with job schedulers such as Airflow and experience in operating production-grade distributed infrastructure.
Strong understanding of containerized and cloud-native environments using Docker and Kubernetes.
Familiarity with ML compiler stacks such as LLVM, MLIR, TensorRT, or XLA.
Knowledge of model quantization techniques and deployment optimization, including GPTQ, AWQ, and bitsandbytes.
Contributions to open source ML projects, including PyTorch, vLLM, SGLang, or related inference and training tooling.
Experience with infrastructure-as-code tools such as Ansible, Terraform, or Nix for reproducible cluster setup.
Experience with custom or on-premise deployments, local clusters, or edge inference.
Familiarity with observability stacks like Prometheus, Grafana, or OpenTelemetry applied to training and inference workloads.
Experience building infrastructure for agentic systems including secure tool access, orchestration, and isolation boundaries.
Passion for clean, well-documented code and detail-oriented engineering.

WHAT'S ON OFFER

Work remotely in an environment that promotes open-source collaboration
Enjoy 14 days of leave and unlimited sick days
Access to GPUs, AI credits, opportunities for fast career progression, and other perks.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Machine Learning, Devops

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Onsite, Remote

Salary:

Negotiation

Job ID:

J01855

Status:

Close

Related Job:

Locomotion Research Engineer

Others - Singapore

Product

Create and train RL locomotion policies for various movement types Establish and maintain simulation environments using custom actuator models to replicate hardware characteristics Implement domain randomization strategy to address simulation-to-reality discrepancies Validate and fine-tune locomotion controllers in simulation and physical platforms Utilize Data Engine telemetry data to refine simulation parameters Collaborate with different teams on issues related to locomotion performance Contribute to open-source releases of locomotion models, training code, and simulation assets

Negotiation

View details

Featured Job

Staff Engineer, Firmware

Others - Singapore

Product

  • Firmware
  • C/C++

Create the firmware stack for a new project from the ground up, including selecting the operating system, setting up the toolchain, and developing the board support package. Develop firmware for real-time processing units across the project's hardware platform. Establish and maintain embedded Linux environments for onboard computing, including BSP setup, device tree configuration, kernel driver development, and userspace/kernel interfaces. Create and maintain low-level drivers for various components such as actuators, sensors, IMUs, and communication buses (CAN, EtherCAT, SPI, I2C, UART). Design real-time control loops with specific latency and determinism requirements. Work closely with different engineering teams to co-design hardware and firmware interfaces. Develop tooling for firmware flashing, diagnostics, and in-field debugging. Set and uphold firmware architecture standards, code quality practices, and review processes within the team. Contribute to the hardware setup for new releases of the project, starting from schematic review through validation.

Negotiation

View details

iOS Engineer - GSaaS

Ho Chi Minh - Viet Nam

Product

  • iOS
  • Swift
  • Objective-C

Creating and managing essential features for various services (Message, Mail, Drive, Notes, Survey, etc.) Ensuring the stability of services and providing ongoing support Working closely with diverse teams to oversee the development of services from start to finish Constantly enhancing app performance, usability, and reliability with a focus on the user experience

Negotiation

View details