Director Engineering – Software Engineering and AI Inferencing Platforms

ABOUT CLIENT

Our client is a leading technology company specializing in graphics processing units (GPUs) and artificial intelligence (AI).

JOB DESCRIPTION

Lead and expand engineering teams in Vietnam across system software, data science, and AI platforms.
Drive the creation, structure, and delivery of high-performance system software platforms that support AI products and services.
Collaborate with global teams across Machine Learning, Inference Services, and Hardware/Software integration to guarantee performance, reliability, and scalability.
Oversee the development and optimization of AI delivery platforms in Vietnam, including NIMs, Blueprints, and other flagship services.
Collaborate with open-source and enterprise data and workflow ecosystems to advance accelerated AI factory, data science, and data engineering workloads.
Promote continuous integration, continuous delivery, and engineering best practices across multi-site R&D Centers.
Work with product management and other stakeholders to ensure enterprise readiness and customer impact.
Establish and implement standard processes for large-scale, distributed system testing including stress, scale, failover, and resiliency testing.
Ensure security and compliance testing aligns with industry standards for cloud and data center products.
Mentor and develop talent within the organization, fostering a culture of quality and continuous improvement.

JOB REQUIREMENT

Computer Science, Computer Engineering, or related field Bachelor's, Master's, or PhD.
15+ years software engineering experience, 6+ years in senior leadership roles.
Managed large, high-performing software teams and delivered complex AI/ML or data-driven products.
Expertise in cloud, data, and accelerated computing technologies (e.g., Spark, Kubernetes, Dask, Python ecosystem, CUDA).
Experience collaborating with open-source communities and enterprise partners.
Strong leadership, communication, and cross-functional coordination skills.
Strategic mindset with hands-on technical depth in AI, system software, or largescale data platforms.
Experience building and scaling AI/ML Inferencing platforms from concept to production.
Background in GPU programming, CUDA optimization, or system performance engineering.
Deep understanding of microservices, distributed systems, and high-performance data architectures.
Contributions to open-source projects or developer ecosystems.
Knowledge of deep learning, RAG, embeddings, or modern text search frameworks.

WHAT'S ON OFFER

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Management, Backend, Devops, Data Engineering, Cloud, AI

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Onsite

Salary:

Negotiation

Job ID:

J01972

Status:

Active

Related Job:

Platform Lead

Others - Singapore

Product

  • Backend
  • Devops
  • Data Engineering

Architect and scale distributed systems that handle petabytes of sensory, telemetry, and control data across cloud and edge environments, connecting fleets of robots in real time. Design and build the API Platform, delivering high reliability, world class developer experience, and production grade multimodal AI capabilities via intuitive APIs and SDKs. Build large scale training and inference platforms for multimodal foundation models powering robot autonomy, teleoperation, and developer integrations. Design data ingestion and streaming pipelines connecting robot fleets to the cloud in real time, covering video, LiDAR, joint states, and audio. Manage and evolve a modern cloud native infrastructure stack using Kubernetes, Docker, and infrastructure as code tooling. Ensure platform reliability through telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery mechanisms. Lead infrastructure decisions spanning distributed storage, consensus protocols, GPU orchestration, network reliability, and API security. Collaborate across ML, robotics, and product teams to support hardware in the loop simulation, policy rollout, continuous learning, and CI/CD workflows. Implement secure APIs with fine grained access control, usage metering, rate limiting, and billing integration as we scale to serve millions of users.

Negotiation

View details

Embedded Software Engineer (Chinese Speaking)

Ho Chi Minh - Viet Nam

Outsource

  • Embedded

Create, maintain, and enhance complex embedded software components as per technical and business needs. Conduct software requirement engineering by validating and analyzing customer requirements. Integrate software components and merge them into a unified build. Develop and implement test cases to verify software functionality and ensure it meets quality standards. Adhere to established software development processes and coding standards to produce reliable code for embedded systems. Use debugging and analysis tools to troubleshoot software defects and performance issues. Provide guidance to junior engineers on technical tasks, coding practices, and problem-solving. Contribute to technical reviews and knowledge-sharing sessions within the team. Ensure compliance with industry standards, regulatory requirements, and quality frameworks relevant to assigned projects.

Negotiation

View details

Senior Backend Engineer (Python/AWS)

Ho Chi Minh - Viet Nam

Outsource

  • Python

Our company, with expert teams in Berlin and Ho Chi Minh City, provides innovative software solutions for startups and leading enterprise businesses in Germany. The team in Berlin and Ho Chi Minh City collaborates to develop high-quality solutions. We are seeking a Senior Backend Engineer (Python/AWS) to join our team in Ho Chi Minh City. This role is ideal for team players interested in building an international career as a product builder as well as a coder. Developing and maintaining scalable backend services using Python for a live product Designing and implementing robust $1ESTful APIs and backend systems following industry best practices Leading the design and development of cloud-native backend solutions on AWS (e.g., ECS, SQS, SNS) Driving the architecture and scalability of backend systems for reliability, performance, and maintainability Defining and enforcing coding standards, testing strategies, and best practices across the backend codebase Implementing and overseeing observability practices, including monitoring, logging, and alerting Collaborating closely with frontend engineers, QA, DevOps, and product stakeholders to deliver high-quality solutions Conducting code reviews, technical design reviews, and architectural discussions Leading troubleshooting and root-cause analysis of complex production issues Mentoring junior and mid-level engineers and supporting their technical growth Contributing to technical documentation, system design documentation, and knowledge sharing Staying up to date with emerging technologies and driving technical innovation within the team

Negotiation

View details