Lead Data Engineer

ABOUT CLIENT

Our client is a global technology company that specializes in providing innovative IT solutions for the financial services industry

JOB DESCRIPTION

Design, create, and maintain scalable data infrastructure, which includes data lakes, pipelines, and metadata repositories, to ensure accurate and timely delivery of data to stakeholders.
Collaborate with data scientists to develop and maintain data models, integrate data sources, and facilitate machine learning workflows and experimentation environments.
Build and enhance large-scale, batch, and real-time data processing systems to improve operational efficiency and align with business goals.
Use Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoring.
Utilize AWS services like S3, Glue, EC2, and Lambda to manage data storage and compute resources, striving for high performance, scalability, and cost-effectiveness.
Implement comprehensive testing and validation methods to guarantee the reliability, accuracy, and security of data processing workflows.
Keep updated on the latest industry best practices and emerging technologies in data engineering and data science to suggest innovative solutions and enhancements.

JOB REQUIREMENT

Core Expertise: Proficiency in Python for data processing and scripting (pandas, pyspark), workflow automation (Apache Airflow), and experience with cloud computing services (Glue, S3, EC2, Lambda).
Containerization & Orchestration: Experience working with Kubernetes and Docker for managing containerized environments in the cloud.
Data Engineering Tools: Hands-on experience with columnar and big data databases (Athena, Redshift, Vertica, Hive/Hadoop), along with version control systems like Git.
Cloud Services: Strong familiarity with cloud services for data processing and management.
CI/CD Pipeline: Experience with CI/CD tools for continuous integration and deployment.
Data Engineering Focus (75%): Expertise in building and managing robust data architectures and pipelines for large-scale data operations.
Data Science Support (25%): Ability to support data science workflows, including collaboration on data preparation, feature engineering, and enabling experimentation environments.
Langchain Experience: Familiarity with Langchain for building data applications involving natural language processing or conversational AI frameworks.
Advanced Data Science Tools: Experience with machine learning environments.
Big Data & Analytics: Familiarity with both RDBMS and NoSQL databases.
BI Tools: Experience with enterprise BI tools.
Messaging & Event Streaming: Familiarity with distributed messaging systems for event streaming.
Monitoring & Logging: Experience with monitoring and log management tools.
Data Privacy and Security: Knowledge of best practices for ensuring data privacy and security, particularly in large data infrastructures.

WHAT'S ON OFFER

Offers competitive salary
Salary bands are reviewed annually
Provides 13th-month salary pro rata based on employee's length of service
Monthly lunch allowance of 700,000 VND per employee
Covers monthly parking fee for employee motorbikes
Conducts performance evaluation once a year for performance bonuses and salary increments
Provides private health insurance including accident, outpatient, in-patient, maternity, and dental for permanent employees after 2-month probation
Offers expense claim for eyewear and annual health check-ups
Provides a maximum of 18-day vacation leave per year, with the option to carry over 5 days until the following year
Grants an additional annual leave day for every two-year anniversary
Allocates annual fund for fitness activities based on team's vote
Offers a range of healthy snacks, tea, coffee, milk, and beer on tap
Conducts company townhall meetings every 6 weeks
Engages in CSR activities as per company's CSR guideline
Offers onsite tour/training courses at other offices and client's destination overseas where applicable.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data Engineering, Management

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Hybrid

Job ID:

J02046

Status:

Close

Related Job:

Product Engineer (Flutter)

Ho Chi Minh - Viet Nam

Product

  • Flutter

Own products and features from beginning to end - originate ideas, understand the strategy and goals behind them, ship to production with real users, iterate on feedback, and stay responsible for their ongoing success. Scope features and projects, including writing handover / technical design documents (as built) - the person who built a feature is the best person to document it. Improve application performance - ship technical improvements that make the product faster, more stable, and ready to scale. Sweat the UI and interaction details - crafting a clean, pleasant experience is a daily habit, not an afterthought. Improve how we work, not just what we build: refine development processes, drive improvements in code quality and engineering best practices - and hold a zero-bug standard: bugs get fixed promptly, not stockpiled in a backlog. Work closely with designers to craft thoughtful UX/UI - ship and own the basic experience using the design system, deciding when to bring in design to polish - and collaborate with the Customer Success team to learn how the product is actually being used. Bring a tester's mindset - testing is part of building, not someone else's job. You own the quality of what you ship and stand behind it.

Negotiation

View details

Featured Job

Product Engineer (Web)

Ho Chi Minh - Viet Nam

Product

  • Angular
  • Typescript

Own products and features from beginning to end - originate ideas, understand the strategy and goals behind them, ship to production with real users, iterate on feedback, and stay responsible for their ongoing success. Scope features and projects, including writing handover / technical design documents (as built) - the person who built a feature is the best person to document it. Improve application performance - ship technical improvements that make the product faster, more stable, and ready to scale. Improve how we work, not just what we build: refine development processes, drive improvements in code quality and engineering best practices - and hold a zero-bug standard: bugs get fixed promptly, not stockpiled in a backlog. Work closely with designers to craft thoughtful UX/UI - ship and own the basic experience using the design system, deciding when to bring in design to polish - and collaborate with the Customer Success team to learn how the product is actually being used. Bring a tester's mindset - testing is part of building, not someone else's job. You own the quality of what you ship and stand behind it.

Negotiation

View details

Principal Engineer (Java)

Ho Chi Minh - Viet Nam

Product

  • Java

Provide hands-on leadership to the design, development, and deployment of technical solutions; Collaborate with other NAB's technology leaders towards improving and fulfilling the NAB technical direction; Evangelise and promote Java best practices; Be passionate about Java and understand how to implement advancement for existing or new systems; Lead and conduct training to empower engineers on sufficient programming skills; Design, develop, review, implement, and manage Java application code and services for the production and pre-release environments; Design, develop, review, implement, and manage continuous integration, build management and deployment scripts, systems, and any code as required; Participate in Agile software development, prototyping, and code review with international development teams to build scalable microservices-based products and APIs using Java technologies on AWS or Azure cloud architecture; Understand the requirements of the customer or business and utilize this knowledge to develop applications that are consistent with this; Work with delivery teams to achieve success through development using CI/CD and DevOps practices, processes, and tooling; Provide robust coding practices, solid unit/component test coverage, and debugging code; Fulfil other tasks as assigned by your People Leader and/or authorized representative of NAB Vietnam from time to time.

Negotiation

View details