Senior System Software Engineer - AI Data Platform - Inference Factory

ABOUT CLIENT

Our client is a leading technology company specializing in graphics processing units (GPUs) and artificial intelligence (AI).

JOB DESCRIPTION

Create infrastructure and tools to automate complex software processes effectively.
Improve performance: Deploy advanced test harnesses, benchmarking frameworks, and analytical tools to thoroughly evaluate and enhance the performance and efficiency of software and hardware platforms.
Utilize expertise in operating systems, kernel internals, device drivers, memory management, storage, networking, and high-speed interconnects to construct and troubleshoot high-performance systems.
Collaborate with engineering teams to comprehend requirements and deliver efficient solutions.
Establish performance objectives, assess feedback, analyze data, and continually enhance system reliability.
Shape technical strategies: Contribute to developing technical strategies and roadmaps for platform automation initiatives to ensure they are in line with company goals and industry best practices.

JOB REQUIREMENT

Required: Bachelor's or equivalent experience in Computer Science, Computer Engineering, or a related technical field, or Master's degree or equivalent experience in a similar field.
Minimum 5 years of industry experience in software development, focusing on infrastructure, distributed systems, automation, and/or performance engineering.
Proficiency in System-Level Programming: Proven ability to develop robust tools and automation using programming languages such as C++, Python, or Go.
Thorough Understanding of System Software: Experience with operating system internals, device drivers, memory management, and debugging performance issues in complex compute applications.
Distributed Systems Expertise: Experience in designing, building, and operating large-scale distributed systems, with knowledge of networking protocols, cluster management, and high-performance interconnects.
Automation and CI/CD Proficiency: Experience building and maintaining automated testing, benchmarking, and continuous integration/continuous deployment pipelines.
Strong Problem-Solving and Analytical Skills: Outstanding analytical, problem-solving, and debugging skills, with a track record of resolving complex technical challenges.
Collaboration and Communication Skills: Excellent interpersonal and communication skills, with the ability to articulate complex technical concepts to diverse audiences and collaborate effectively across teams.
Preferred qualifications
Experience optimizing performance for AI/Machine Learning workloads, especially inference applications, on diverse hardware platforms.
Prior experience building or contributing to large-scale compute infrastructure solutions in cloud environments or on-premises data centers.
Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes.
Knowledge of performance profiling tools and methodologies for hardware and software systems.
Track record of driving significant efficiency gains or architectural improvements in large-scale systems.

WHAT'S ON OFFER

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Devops, C/C++, Python, Golang

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Hybrid

Job ID:

J02058

Status:

Close

Related Job:

AI Solution Architect

Ho Chi Minh - Viet Nam


Outsource

  • AI
  • Architect
  • Cloud

Take charge of client discovery and solution workshops, evaluating AI implementation opportunities and transforming business requirements into achievable technical strategies. Develop secure, scalable, and cost-effective architectural solutions utilizing LLMs, RAG, agents, data integrations, and cloud technology. Oversee or offer guidance in PoC development, review design and code, and provide support in key technical decisions throughout project delivery. Assist in scoping solutions, drafting technical proposals, delivering presentations, and estimating project requirements for potential clients. Offer leadership in AI integration by mentoring teams in AI-driven development, coding agents, evaluation techniques, and establishing reusable engineering workflows. Establish standard architectures, repeatable patterns, governing guidelines, and success metrics for AI projects.

Negotiation

View details

AI Engineer Lead

Ho Chi Minh - Viet Nam


Outsource

  • AI
  • Python

Spearhead the development and deployment of various applications, pipelines, and workflows tailored for financial services applications. Take charge of critical technical determinations related to model choices, design of retrieval systems, workflow structuring, integration strategies, cost considerations, and latency issues. Develop methodologies for evaluation and regression testing, utilizing data analysis and failure diagnostics to enhance the effectiveness of solutions. Ensure that deployed solutions adhere to production standards encompassing reliability, security, observability, data security, and audit trails. Transform business, risk, and compliance prerequisites into actionable technical solutions in collaboration with clients and internal partners. Provide guidance to engineers, fostering the adoption of standardized AI engineering practices, frameworks, and development methodologies.

Negotiation

View details

Senior Engineer Manager - Technology Risk

Ho Chi Minh - Viet Nam


Product

  • Management
  • Backend
  • Data Engineering
  • Devops

Develop and implement a cohesive roadmap for strategic execution based on the company's strategic ambitions Coordinate and oversee multiple engineering teams within the organization to achieve desired outcomes Collaborate with various internal teams, including technology, risk, business, and product teams, to ensure requirements are met before and after project delivery Take responsibility for both the development and ongoing operational support of applications in production Manage cyber security updates, ensuring software versions are up to date and infrastructure is patched regularly Monitor and control investment delivery to maintain alignment between different domains and optimize spending Facilitate collaboration between engineering and risk domain experts to achieve strategic technology goals

Negotiation

View details