Senior System Software Engineer - AI Data Platform - Inference Factory

ABOUT CLIENT

Our client is a leading technology company specializing in graphics processing units (GPUs) and artificial intelligence (AI).

JOB DESCRIPTION

Create infrastructure and tools to automate complex software processes effectively.
Improve performance: Deploy advanced test harnesses, benchmarking frameworks, and analytical tools to thoroughly evaluate and enhance the performance and efficiency of software and hardware platforms.
Utilize expertise in operating systems, kernel internals, device drivers, memory management, storage, networking, and high-speed interconnects to construct and troubleshoot high-performance systems.
Collaborate with engineering teams to comprehend requirements and deliver efficient solutions.
Establish performance objectives, assess feedback, analyze data, and continually enhance system reliability.
Shape technical strategies: Contribute to developing technical strategies and roadmaps for platform automation initiatives to ensure they are in line with company goals and industry best practices.

JOB REQUIREMENT

Required: Bachelor's or equivalent experience in Computer Science, Computer Engineering, or a related technical field, or Master's degree or equivalent experience in a similar field.
Minimum 5 years of industry experience in software development, focusing on infrastructure, distributed systems, automation, and/or performance engineering.
Proficiency in System-Level Programming: Proven ability to develop robust tools and automation using programming languages such as C++, Python, or Go.
Thorough Understanding of System Software: Experience with operating system internals, device drivers, memory management, and debugging performance issues in complex compute applications.
Distributed Systems Expertise: Experience in designing, building, and operating large-scale distributed systems, with knowledge of networking protocols, cluster management, and high-performance interconnects.
Automation and CI/CD Proficiency: Experience building and maintaining automated testing, benchmarking, and continuous integration/continuous deployment pipelines.
Strong Problem-Solving and Analytical Skills: Outstanding analytical, problem-solving, and debugging skills, with a track record of resolving complex technical challenges.
Collaboration and Communication Skills: Excellent interpersonal and communication skills, with the ability to articulate complex technical concepts to diverse audiences and collaborate effectively across teams.
Preferred qualifications
Experience optimizing performance for AI/Machine Learning workloads, especially inference applications, on diverse hardware platforms.
Prior experience building or contributing to large-scale compute infrastructure solutions in cloud environments or on-premises data centers.
Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes.
Knowledge of performance profiling tools and methodologies for hardware and software systems.
Track record of driving significant efficiency gains or architectural improvements in large-scale systems.

WHAT'S ON OFFER

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Devops, C/C++, Python, Golang

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Hybrid

Job ID:

J02058

Status:

Close

Related Job:

Backend Engineer

Ho Chi Minh - Viet Nam


Product

  • Typescript
  • NodeJS
  • Python
  • AI

Build the core gateway: a unified, OpenAI-compatible API in front of multiple providers (OpenAI, Anthropic, Google, plus self-hosted and OSS models). Own provider routing and reliability: load balancing, automatic failover, and cost and latency-aware routing. Build billing and metering that is correct, not approximate: per-request token accounting, usage ledgers, cost attribution per team, user, and key, budgets, and spend limits. Ship org controls: API key management, per-team and per-user quotas, rate limiting, and RBAC. Handle streaming and performance: low-overhead proxying, streaming responses, connection handling, and caching where it helps. Contribute to the Jan Agent and connect it to the router: route its model and tool calls through the gateway, and make agent traffic first-class in metering, controls, and observability. Make deliberate speed-versus-correctness calls: move fast where iteration is cheap, refuse to cut corners where a bug means a bad charge or a leaked key, and pay down debt on your own initiative.

Negotiation

View details

AI Transformation Lead

Ho Chi Minh - Viet Nam


Outsource

  • AI

Develop a 3-year AI transformation roadmap aligned with business goals in IT outsourcing, product development, and ODC services. Prioritize highest-impact AI use cases in the organization using a build-vs-buy-vs-partner framework. Establish AI governance for model selection, cost management, data privacy, IP protection, and ethical AI guidelines. Implement AI-assisted development workflows for 1,000+ engineers, including AI code generation, review, automated testing, and AI-powered debugging. Drive adoption of AI orchestration platforms to automate repetitive engineering tasks. Create internal AI skills/training programs and a culture of continuous AI experimentation. Measure and report on productivity gains, quality improvements, and time-to-market acceleration from AI adoption. Collaborate with product teams to define AI features for various products. Lead the development of AI Copilots, intelligent assistants, and autonomous agents embedded within products. Guide the architecture of an Ontology-Based AI ERP/MES Platform, including Knowledge Graphs, GraphRAG, and Multi-Agent Systems. Identify new AI-powered product opportunities in logistics, manufacturing, and supply chain to create new revenue streams. Advocate for AI internally, communicate the vision, celebrate wins, and address concerns across all levels. Partner with HR to define new AI-focused roles and refine hiring criteria. Collaborate with ODC/Client Delivery teams to package and sell AI capabilities to existing and new clients. Represent the company externally in conferences, thought leadership, and talent branding to position the company as an AI leader in the IT services industry.

Negotiation

View details

Senior Business Analyst

Ho Chi Minh - Viet Nam


Product

  • Business Analyst

Act as a bridge between business teams and development/system teams Conduct workshops, interviews, and requirement sessions Analyze and document business requirements Create and maintain comprehensive Business Analysis Documentation Collaborate with UX/UI, development, and QA teams Support translation of business requirements into high-level functional specifications Work on projects related to stocks, bonds, derivatives, fund, and settlement processes Analyze and support enhancements for broker trading systems Collaborate with operation and business teams to solve issues related to trading functions Use AI tools to draft and refine requirement documents, user stories, and test cases Manage and track requirements throughout the project lifecycle Work closely with development and QA/testing teams Contribute to designing and reviewing test conditions Provide guidance and on-the-job support to junior BAs or new team members Share domain knowledge and contribute to internal knowledge bases and reusable BA templates

Negotiation

View details