Lead Data Engineer

JOB DESCRIPTION

Architect, develop, and maintain scalable data infrastructure, including data lakes, pipelines, and metadata repositories, ensuring the timely and accurate delivery of data to stakeholders.
Work closely with data scientists to build and support data models, integrate data sources, and support machine learning workflows and experimentation environments.
Develop and optimize large-scale, batch, and real-time data processing systems to enhance operational efficiency and meet business objectives.
Leverage Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoring.
Utilize AWS services such as S3, Glue, EC2, and Lambda to manage data storage and compute resources, ensuring high performance, scalability, and cost-efficiency.
Implement robust testing and validation procedures to ensure the reliability, accuracy, and security of data processing workflows.
Stay informed of industry best practices and emerging technologies in both data engineering and data science to propose optimizations and innovative solutions.

JOB REQUIREMENT

Required Skills
Core Expertise: Proficiency in Python for data processing and scripting (pandas, pyspark), workflow automation (Apache Airflow), and experience with AWS services (Glue, S3, EC2, Lambda).
Containerization & Orchestration: Experience working with Kubernetes and Docker for managing containerized environments in the cloud.
Data Engineering Tools: Hands-on experience with columnar and big data databases (Athena, Redshift, Vertica, Hive/Hadoop), along with version control systems like Git.
Cloud Services: Strong familiarity with AWS services for cloud-based data processing and management.
CI/CD Pipeline: Experience with CI/CD tools such as Jenkins, CircleCI, or AWS CodePipeline for continuous integration and deployment.
Data Engineering Focus (75%): Expertise in building and managing robust data architectures and pipelines for large-scale data operations.
Data Science Support (25%): Ability to support data science workflows, including collaboration on data preparation, feature engineering, and enabling experimentation environments.
Nice-to-have requirements
Langchain Experience: Familiarity with Langchain for building data applications involving natural language processing or conversational AI frameworks.
Advanced Data Science Tools: Experience with AWS Sagemaker or Databricks for enabling machine learning environments.
Big Data & Analytics: Familiarity with both RDBMS (MySQL, PostgreSQL) and NoSQL (DynamoDB, Redis) databases.
BI Tools: Experience with enterprise BI tools like Tableau, Looker, or PowerBI.
Messaging & Event Streaming: Familiarity with distributed messaging systems like Kafka or RabbitMQ for event streaming.
Monitoring & Logging: Experience with monitoring and log management tools such as the ELK stack or Datadog.
Data Privacy and Security: Knowledge of best practices for ensuring data privacy and security, particularly in large data infrastructures.

WHAT'S ON OFFER

Competitive salary
Salary band per level are reviewed once per year
13th month salary pro rata depending on the employee's length of service (within a calender year), paid with the December salary
Monthly lunch allowance: 700, 000 VND/employee
Parking: Company covers the monthly parking fee for employee motorbikes
Performance evaluation is once per year, for 2 purposes: > Performance bonus > Salary increments
Private health insurance: including accident, outpatient, in-patient, maternity, and dental for all permanent employees who pass 2-month probation.
Optical: expense claim for eyewear
Annual health check-ups.
Maximum 18-day vacation leave/year (with the ability to carry over 05 days till 31st March of the following year)
Adding one more annual leave day for each two-year anniversary.
Healthy lifestyle
Sports and hobby clubs: company has an annual fund for fitness activities, which is allocated per month as team's vote.
Range of healthy snacks, tea, coffee, milk and beer on tap
Company townhall: each 6 weeks
CSR activities: as per company's CSR guideline
Onsite tour/training courses at other offices and client's destination overseas (where applicable).

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data Engineering, Management

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Hybrid

Salary:

Negotiation

Job ID:

J02046

Status:

Active

Related Job:

Technical Lead (Java)

Ho Chi Minh, Ha Noi - Viet Nam

Outsource

#Technical Leadership Lead and mentor a team of backend engineers across multiple functional domains. Provide technical direction and ensure alignment with architecture standards and engineering best practices. Review solution designs, code quality, and implementation approaches - promoting clean architecture, resilient microservices, and AI-enhanced development patterns. Guide the team in diagnosing complex technical challenges, using both traditional analysis and AI-powered debugging or observability tools. Support planning, estimation, and technical decision-making within the engineering team. Backend Architecture & Development Design and develop backend services using Java and modern backend frameworks (e.g., Spring Boot). Define and implement microservices-based architecture and API-driven systems. Ensure backend services are scalable, secure, resilient, and maintainable. Drive best practices in backend development, including maintainable system design, automated testing, code quality, API governance, performance optimization and documentation. Work closely with DevOps teams to support CI/CD pipelines, incorporate intelligent automation, and ensure stable, secure deployment environments. Integrate AI-assisted development practices into coding, testing, documentation, code reviews, and defect prevention workflows. #Banking & Payment Domain Design backend systems supporting banking products and financial transaction processing. Build and maintain services related to payments, card processing, financial operations, and core banking functions. Ensure backend implementations comply with financial industry standards and security requirements. Collaborate with business and product teams to translate banking and financial requirements into technical solutions. #Client Collaboration & Delivery Work directly with client stakeholders, architects, and product owners to understand business processes, requirements and define technical solutions. Challenge and clarify requirements with curiosity dig deep into the "why" behind business needs. Participate in architecture discussions and technical workshops with client teams. Communicate technical designs, trade-offs, and solutions clearly to both engineering teams and non-technical stakeholders. Support project delivery by ensuring technical risks are identified and mitigated early.

Negotiation

View details

Full-stack Lead (Android, Java)

Ho Chi Minh, Ha Noi - Viet Nam

Outsource

  • Android

#Role Summary Lead the design and development of high-quality Android applications for banking projects in an Agile/Scrum environment Own the technical architecture and provide hands-on leadership across the full development lifecycle, from solution design to production deployment Drive scalable, secure, and high-performance mobile solutions aligned with modern Android best practices and enterprise standards Act as the technical authority for the Android domain, guiding the team on architecture, coding standards, and engineering excellence Contribute to backend/service integration and support end-to-end solution delivery as a full-stack Android technical leader when required Actively leverage AI tools to improve team productivity, code quality, testing coverage, and technical documentation Collaborate closely with cross-functional stakeholders, Solution Architects, and Delivery Leadership while mentoring and growing the Android engineering team#Key Activities Define and own the mobile architecture, technical roadmap, and engineering standards for Android applications Lead the design and development of complex, enterprise-grade Android solutions using Kotlin and Java Provide hands-on contribution to critical features, technical spikes, performance optimization, and integration layers Drive the adoption of Clean Architecture, MVVM, Jetpack Compose, and modularization strategies Review and approve technical designs, pull requests, and implementation approaches Ensure seamless integration with backend services, APIs, and external enterprise platforms Contribute to API design discussions and support backend collaboration for end-to-end delivery Establish and enforce best practices for code quality, testing strategy, CI/CD, and release management Identify technical risks, propose mitigation plans, and support delivery planning and estimations Coach and mentor Android developers, conduct technical training, and support career development Work closely with Product Owners, Scrum Masters, QA, DevOps, and Architects to ensure successful delivery

Negotiation

View details

Windows Engineer (C++/C#) - GSaaS

Ho Chi Minh - Viet Nam

Product

  • C/C++

Develop and maintain applications using C# (WinUI framework) and C++ (Qt framework and Win32 API). Participate in the company's software development projects and collaborate with cross-functional teams on software architecture. Develop new features according to requirements, provide development documentation, and participate in code reviews. Troubleshoot, debug, and optimize performance for existing software features and applications. Write high-quality, testable code, ensuring adherence to high code quality standards. Research and integrate new technologies to enhance software products. Mentor junior developers and contribute to team knowledge sharing.

Negotiation

View details