Director Engineering – Software Engineering and AI Inferencing Platforms

ABOUT CLIENT

Our client is a leading technology company specializing in graphics processing units (GPUs) and artificial intelligence (AI).

JOB DESCRIPTION

Lead and expand engineering teams in Vietnam across system software, data science, and AI platforms.
Drive the creation, structure, and delivery of high-performance system software platforms that support AI products and services.
Collaborate with global teams across Machine Learning, Inference Services, and Hardware/Software integration to guarantee performance, reliability, and scalability.
Oversee the development and optimization of AI delivery platforms in Vietnam, including NIMs, Blueprints, and other flagship services.
Collaborate with open-source and enterprise data and workflow ecosystems to advance accelerated AI factory, data science, and data engineering workloads.
Promote continuous integration, continuous delivery, and engineering best practices across multi-site R&D Centers.
Work with product management and other stakeholders to ensure enterprise readiness and customer impact.
Establish and implement standard processes for large-scale, distributed system testing including stress, scale, failover, and resiliency testing.
Ensure security and compliance testing aligns with industry standards for cloud and data center products.
Mentor and develop talent within the organization, fostering a culture of quality and continuous improvement.

JOB REQUIREMENT

Computer Science, Computer Engineering, or related field Bachelor's, Master's, or PhD.
15+ years software engineering experience, 6+ years in senior leadership roles.
Managed large, high-performing software teams and delivered complex AI/ML or data-driven products.
Expertise in cloud, data, and accelerated computing technologies (e.g., Spark, Kubernetes, Dask, Python ecosystem, CUDA).
Experience collaborating with open-source communities and enterprise partners.
Strong leadership, communication, and cross-functional coordination skills.
Strategic mindset with hands-on technical depth in AI, system software, or largescale data platforms.
Experience building and scaling AI/ML Inferencing platforms from concept to production.
Background in GPU programming, CUDA optimization, or system performance engineering.
Deep understanding of microservices, distributed systems, and high-performance data architectures.
Contributions to open-source projects or developer ecosystems.
Knowledge of deep learning, RAG, embeddings, or modern text search frameworks.

WHAT'S ON OFFER

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Management, Backend, Devops, Data Engineering, Cloud, AI

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Onsite

Salary:

Negotiation

Job ID:

J01972

Status:

Active

Related Job:

Senior Data Analyst, Anti-spoofing Operation

Ho Chi Minh - Viet Nam

Product

  • Data Analyst

Lead and develop analytical initiatives to address fraud detection challenges, from problem definition through implementation, monitoring, and continuous optimization. Spearhead strategic efforts to combat emerging fraud patterns and develop innovative detection approaches through data analysis, testing, and impact measurement. Design and implement production-grade data pipelines, automated workflows, and advanced analytical frameworks using statistical methods, machine learning, and geospatial analysis. Conduct in-depth analyses of complex fraud operations and develop behavioral analytics systems. Translate technical findings into actionable recommendations for leadership, product teams, and engineering. Lead compliance analytics initiatives and define evaluation metrics for new features. Provide technical guidance and mentorship, establish best practices, and contribute to hiring top talent in analytics.

Negotiation

View details

Senior Software Engineer, Machine Learning

Ho Chi Minh - Viet Nam

Product

  • Machine Learning

Building and maintaining high-scale ML pipelines using big data technologies (Spark, BigQuery, Delta Lake), writing reliable, testable, and maintainable production-ready code. Leveraging modern ML platforms like Vertex AI or Databricks to orchestrate workflows and optimizing models for both batch/offline training and real-time/streaming inference with a focus on low latency. Gaining a deep understanding of specific domain challenges (e.g., fraud detection, location spoofing) to engineer better features and network-level intelligence that go beyond algorithms. Championing best practices in software engineering, including CI/CD, automated testing, code reviews, and documentation to ensure ML systems are built to software engineering standards, not just research scripts. Acting as a technical lead for projects, defining milestones and ensuring on-time delivery, mentoring Data Scientists on engineering best practices, and collaborating with other engineers to integrate models into the wider platform.

Negotiation

View details

Software Engineer (Java)

Ho Chi Minh - Viet Nam

Product

  • Java
  • Spring Boot

Develop and maintain scalable backend applications using Java and Spring Boot. Enhance existing services and build new ones to meet changing business needs. Ensure high code quality through unit testing, debugging, and performance optimization. Contribute to design and architecture discussions, balancing technical depth with business value. Collaborate with cross-functional teams (QA, DevOps, Analysts, Product Owners) across different locations. Participate in code reviews and uphold development standards and documentation quality. Support release planning, deployment, and post-production analysis. Guide junior engineers and participate in internal knowledge-sharing initiatives. Stay updated on emerging technologies, microservice design patterns, and cloud-native practices. Promote automation, CI/CD, and DevOps principles for improved development efficiency. Proactively identify technical debt and suggest refactoring or optimization strategies.

Negotiation

View details