Lead Data Engineer

ABOUT CLIENT

Our client is a global technology company that specializes in providing innovative IT solutions for the financial services industry

JOB DESCRIPTION

Design, create, and maintain scalable data infrastructure, which includes data lakes, pipelines, and metadata repositories, to ensure accurate and timely delivery of data to stakeholders.
Collaborate with data scientists to develop and maintain data models, integrate data sources, and facilitate machine learning workflows and experimentation environments.
Build and enhance large-scale, batch, and real-time data processing systems to improve operational efficiency and align with business goals.
Use Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoring.
Utilize AWS services like S3, Glue, EC2, and Lambda to manage data storage and compute resources, striving for high performance, scalability, and cost-effectiveness.
Implement comprehensive testing and validation methods to guarantee the reliability, accuracy, and security of data processing workflows.
Keep updated on the latest industry best practices and emerging technologies in data engineering and data science to suggest innovative solutions and enhancements.

JOB REQUIREMENT

Core Expertise: Proficiency in Python for data processing and scripting (pandas, pyspark), workflow automation (Apache Airflow), and experience with cloud computing services (Glue, S3, EC2, Lambda).
Containerization & Orchestration: Experience working with Kubernetes and Docker for managing containerized environments in the cloud.
Data Engineering Tools: Hands-on experience with columnar and big data databases (Athena, Redshift, Vertica, Hive/Hadoop), along with version control systems like Git.
Cloud Services: Strong familiarity with cloud services for data processing and management.
CI/CD Pipeline: Experience with CI/CD tools for continuous integration and deployment.
Data Engineering Focus (75%): Expertise in building and managing robust data architectures and pipelines for large-scale data operations.
Data Science Support (25%): Ability to support data science workflows, including collaboration on data preparation, feature engineering, and enabling experimentation environments.
Langchain Experience: Familiarity with Langchain for building data applications involving natural language processing or conversational AI frameworks.
Advanced Data Science Tools: Experience with machine learning environments.
Big Data & Analytics: Familiarity with both RDBMS and NoSQL databases.
BI Tools: Experience with enterprise BI tools.
Messaging & Event Streaming: Familiarity with distributed messaging systems for event streaming.
Monitoring & Logging: Experience with monitoring and log management tools.
Data Privacy and Security: Knowledge of best practices for ensuring data privacy and security, particularly in large data infrastructures.

WHAT'S ON OFFER

Offers competitive salary
Salary bands are reviewed annually
Provides 13th-month salary pro rata based on employee's length of service
Monthly lunch allowance of 700,000 VND per employee
Covers monthly parking fee for employee motorbikes
Conducts performance evaluation once a year for performance bonuses and salary increments
Provides private health insurance including accident, outpatient, in-patient, maternity, and dental for permanent employees after 2-month probation
Offers expense claim for eyewear and annual health check-ups
Provides a maximum of 18-day vacation leave per year, with the option to carry over 5 days until the following year
Grants an additional annual leave day for every two-year anniversary
Allocates annual fund for fitness activities based on team's vote
Offers a range of healthy snacks, tea, coffee, milk, and beer on tap
Conducts company townhall meetings every 6 weeks
Engages in CSR activities as per company's CSR guideline
Offers onsite tour/training courses at other offices and client's destination overseas where applicable.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data Engineering, Management

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Hybrid

Job ID:

J02046

Status:

Close

Related Job:

Senior Full-Stack Engineer (AI Service Desk)

Ho Chi Minh - Viet Nam

Outsource

Design and develop backend services and APIs using C# and .NET technologies Build modern frontend applications and dashboard interfaces using React Develop scalable integrations between operational systems, analytics services, and reporting layers Full-stack development experience across frontend and backend systems Work closely with engineering and product teams to translate business requirements into technical solutions Improve application performance, maintainability, and scalability Participate in technical discussions, code reviews, and architecture decisions Contribute to engineering standards and development best practices

Negotiation

View details

Senior AI DevSecOps Engineer

Ho Chi Minh - Viet Nam

Product

  • Devops
  • AWS
  • Azure
  • Security

Management of CI/CD Pipeline: Ensure automation, security, and scalability across all stages of the development lifecycle. Infrastructure & Security: Design and implement secure multi-cloud infrastructure solutions leveraging cloud services, containerization, and orchestration tools. Policy as Code: Define and enforce security and compliance policies across Kubernetes clusters using OPA or Kyverno, ensuring guardrails are automated and auditable. AI & Platform Automation: Drive the adoption of AI-powered tools and workflows to automate infrastructure operations, optimize CI/CD pipelines, accelerate root cause analysis, improve security posture, and enhance engineering productivity. Observability & Alerting: Build and maintain a comprehensive observability stack with proactive alerting, dashboards, and runbooks for critical business flows and security events. Secret & Credential Management: Design and enforce secrets management practices across all environments ensuring zero hardcoded credentials in codebases and pipelines. Incident Response & On-Call: Own and continuously improve incident response processes, define runbooks, lead post-mortems, track MTTR, and participate in on-call rotation to maintain platform reliability and SLO adherence. Threat Modelling & Penetration Testing: Conduct regular threat modelling sessions with engineering teams and coordinate or perform penetration testing activities to proactively identify attack surfaces before they reach production. Code Security: Conduct regular code reviews and static/dynamic analysis to identify and remediate security vulnerabilities. Compliance and Best Practices: Ensure compliance with industry standards and best practices. Collaboration: Collaborate with development, operations, and security teams to foster a culture of automation and security-first thinking. Mentorship: Mentor junior engineers and other team members on security best practices. Documentation: Maintain thorough and up-to-date documentation of security policies, procedures, and incident reports. Trend Scouting: Stay updated with the latest trends in technology and AI to integrate innovative solutions into our processes.

Negotiation

View details

Senior Data Engineer (C++, Python, AI/LLM)

Ho Chi Minh - Viet Nam

Outsource

  • Data Engineering
  • C/C++
  • Python

Refine a wide array of structured and unstructured data to produce high-quality datasets for quantitative analysis and financial engineering. Improve data integrity and quality by creating validation tools and frameworks to assess the effectiveness of data enrichment pipelines. Gain expertise in machine learning, deep learning, and emerging AI/LLM applications, and analyze the underlying dynamics and behaviors in the data. Derive insights from large-scale datasets and collaborate with research teams to pinpoint opportunities for tradable signals. Create utility tools to automate software development, testing, deployment, and monitoring workflows. Offer technical support to global researchers, including diagnosing technical issues, troubleshooting Python and C++ code, and suggesting scalable fixes and improvements. Troubleshoot and resolve issues in C++ applications and data pipelines with a strong focus on performance, stability, correctness, and maintainability. Investigate and implement AI/LLM-based solutions to enhance data processing, workflow efficiency, troubleshooting, documentation, and research support processes.

Negotiation

View details