Senior System Software Engineer - AI Data Platform - Inference Factory

ABOUT CLIENT

Our client is a leading technology company specializing in graphics processing units (GPUs) and artificial intelligence (AI).

JOB DESCRIPTION

Create infrastructure and tools to automate complex software processes effectively.
Improve performance: Deploy advanced test harnesses, benchmarking frameworks, and analytical tools to thoroughly evaluate and enhance the performance and efficiency of software and hardware platforms.
Utilize expertise in operating systems, kernel internals, device drivers, memory management, storage, networking, and high-speed interconnects to construct and troubleshoot high-performance systems.
Collaborate with engineering teams to comprehend requirements and deliver efficient solutions.
Establish performance objectives, assess feedback, analyze data, and continually enhance system reliability.
Shape technical strategies: Contribute to developing technical strategies and roadmaps for platform automation initiatives to ensure they are in line with company goals and industry best practices.

JOB REQUIREMENT

Required: Bachelor's or equivalent experience in Computer Science, Computer Engineering, or a related technical field, or Master's degree or equivalent experience in a similar field.
Minimum 5 years of industry experience in software development, focusing on infrastructure, distributed systems, automation, and/or performance engineering.
Proficiency in System-Level Programming: Proven ability to develop robust tools and automation using programming languages such as C++, Python, or Go.
Thorough Understanding of System Software: Experience with operating system internals, device drivers, memory management, and debugging performance issues in complex compute applications.
Distributed Systems Expertise: Experience in designing, building, and operating large-scale distributed systems, with knowledge of networking protocols, cluster management, and high-performance interconnects.
Automation and CI/CD Proficiency: Experience building and maintaining automated testing, benchmarking, and continuous integration/continuous deployment pipelines.
Strong Problem-Solving and Analytical Skills: Outstanding analytical, problem-solving, and debugging skills, with a track record of resolving complex technical challenges.
Collaboration and Communication Skills: Excellent interpersonal and communication skills, with the ability to articulate complex technical concepts to diverse audiences and collaborate effectively across teams.
Preferred qualifications
Experience optimizing performance for AI/Machine Learning workloads, especially inference applications, on diverse hardware platforms.
Prior experience building or contributing to large-scale compute infrastructure solutions in cloud environments or on-premises data centers.
Familiarity with containerization and orchestration technologies, such as Docker and Kubernetes.
Knowledge of performance profiling tools and methodologies for hardware and software systems.
Track record of driving significant efficiency gains or architectural improvements in large-scale systems.

WHAT'S ON OFFER

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Devops, C/C++, Python, Golang

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Hybrid

Salary:

Negotiation

Job ID:

J02058

Status:

Active

Related Job:

PreSales Solutions Engineer

Ho Chi Minh - Viet Nam

Product

  • Presale
  • System
  • Google Cloud

PreSales Support: Collaborating with the Sales team to understand client needs and develop tailored solutions using Google Maps and Google Cloud services. This involves conducting technical presentations, product demonstrations, and creating proof of concepts (POCs) for prospective clients, as well as contributing to proposals and RFP responses with detailed technical information. Post-Sales Support: Leading the technical implementation of Google Maps and Google Cloud services, ensuring smooth deployment and integration. Providing ongoing technical support and troubleshooting for clients after implementation, working closely with cross-functional teams to ensure client satisfaction and build long-term relationships. Technical Expertise: Staying up-to-date with the latest Google Maps and Google Cloud technologies, serving as a subject matter expert (SME) for both internal teams and clients. Integrating new features and services into client solutions and providing guidance on best practices. Collaboration: Working closely with Sales, Product, Infrastructure, Data, and Engineering teams to align solutions with client needs and company goals. Mentoring junior team members and contributing to training initiatives.

Negotiation

View details

Technical Lead

Ho Chi Minh - Viet Nam

Product

  • NodeJS
  • Python

Leading the backend development team, providing technical direction, mentorship, and best practices. Designing and implementing scalable, secure, and high-performance microservices-based architectures. Architecting and implementing agentic AI workflows and RAG (Retrieval-Augmented Generation) systems for personalized user interactions and automated coaching features. Overseeing data pipelines and infrastructure required for real-time AI model inference within a microservices-based environment. Collaborating with stakeholders to align on requirements and delivery timelines. Optimizing application performance, monitoring system reliability, and proactively troubleshooting issues. Advocating for CI/CD pipelines, automated testing, and robust version control strategies. Documenting key architectural decisions, APIs, and processes for internal use.

Negotiation

View details

Featured Job

Chief Technology Officer

Ha Noi - Viet Nam

Product

  • Cloud
  • Backend

Planning & designing overall system architecture: Creating a Technology Roadmap for a Game Server system with high concurrency and low latency for global players. Cost optimization: Deciding on the strategy for using Cloud infrastructure (AWS, GCP, Azure) or Hybrid Cloud to balance performance and operational expenses. High-level consultation: Participating in the Executive Board to address the relationship between speed-to-market of features and system stability. Tech-stack selection: Evaluating and finalizing programming languages (Go, C++, Java, Node.js) and processing models (Microservices vs Monolith) suitable for the complex logic of the game. Scalability solution: Directing the development of Auto-scaling, Load Balancing mechanisms, and managing Player State on large clusters. Data management: Designing Database structure (SQL/NoSQL) and Cache system (Redis, Memcached) to handle billions of queries daily without congestion. Ensuring Uptime: Building real-time monitoring and alerting systems to maintain 99.99% Availability. Network security: Implementing solutions to combat DDoS attacks, game fraud (Anti-cheat), and comprehensive user data security. Infrastructure & CI/CD: Standardizing automatic deployment processes to ensure game updates (Hotfix/Update) do not disrupt players. Deployment strategy & Optimization: Developing plans to optimize Cloud Services costs (AWS/GCP/Azure), evaluating the use of Spot Instances, Reserved Instances, or Private Cloud solutions to save operational budget. Meanwhile, establishing 24/7 monitoring and incident response systems.

Negotiation

View details