Senior/ Lead Data Engineer (Data Platform / MLOps)

JOB DESCRIPTION

You will be responsible for managing, designing, and enhancing data systems and workflows that drive key business decisions. The role is focused 75% on data engineering, involving the construction and optimization of data pipelines and architectures, and 25% on supporting data science initiatives through collaboration with data science teams for machine learning workflows and advanced analytics. You will leverage technologies like Python, Airflow, Kubernetes, and AWS to deliver high-quality data solutions.
Architect, develop, and maintain scalable data infrastructure, including data lakes, pipelines, and metadata repositories, ensuring the timely and accurate delivery of data to stakeholders.
Work closely with data scientists to build and support data models, integrate data sources, and support machine learning workflows and experimentation environments.
Develop and optimize large-scale, batch, and real-time data processing systems to enhance operational efficiency and meet business objectives.
Leverage Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoring.
Utilize AWS services such as S3, Glue, EC2, and Lambda to manage data storage and compute resources, ensuring high performance, scalability, and cost-efficiency.
Implement robust testing and validation procedures to ensure the reliability, accuracy, and security of data processing workflows.
Stay informed of industry best practices and emerging technologies in both data engineering and data science to propose optimizations and innovative solutions.

JOB REQUIREMENT

7-8+ years of dedicated experience as a Data Engineer.
Core Expertise: Proficiency in Python for data processing and scripting (pandas, pyspark), workflow automation (Apache Airflow), and experience with AWS services (Glue, S3, EC2, Lambda).
Containerization & Orchestration: Experience working with Kubernetes and Docker for managing containerized environments in the cloud.
Data Engineering Tools: Hands-on experience with columnar and big data databases (Athena, Redshift, Vertica, Hive/Hadoop), along with version control systems like Git.
Cloud Services: Strong familiarity with AWS services for cloud-based data processing and management.
CI/CD Pipeline: Experience with CI/CD tools such as Jenkins, CircleCI, or AWS CodePipeline for continuous integration and deployment.
Data Engineering Focus (75%): Expertise in building and managing robust data architectures and pipelines for large-scale data operations.
Data Science Support (25%): Ability to support data science workflows, including collaboration on data preparation, feature engineering, and enabling experimentation environments.
Nice-to-have requirements:
Langchain Experience: Familiarity with Langchain for building data applications involving natural language processing or conversational AI frameworks.
Advanced Data Science Tools: Experience with AWS Sagemaker or Databricks for enabling machine learning environments.
Big Data & Analytics: Familiarity with both RDBMS (MySQL, PostgreSQL) and NoSQL (DynamoDB, Redis) databases.
BI Tools: Experience with enterprise BI tools like Tableau, Looker, or PowerBI.
Messaging & Event Streaming: Familiarity with distributed messaging systems like Kafka or RabbitMQ for event streaming.
Monitoring & Logging: Experience with monitoring and log management tools such as the ELK stack or Datadog.
Data Privacy and Security: Knowledge of best practices for ensuring data privacy and security, particularly in large data infrastructures.

WHAT'S ON OFFER

Competitive salary
13th-month salary guarantee
Performance bonus
Professional English course for employees
Premium health insurance
Extensive annual leave

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Hybrid

Salary:

Negotiation

Job ID:

J01942

Status:

Close

Related Job:

Senior Product Manager

Ho Chi Minh, Ha Noi - Viet Nam

Product

  • Product Management

We are looking for a Senior Product Manager, Monetization to define and own the product strategy, and lead the development of initiatives that drive sustainable revenue growth for our marketplace. You will be responsible for optimizing the existing revenue product portfolio and launching new monetization opportunities that deliver value to agents, renters, and the platform.You'll work closely with engineers, designers, analysts, and business stakeholders to drive monetization growth at scale.This role is based flexibly in Hanoi or Ho Chi Minh City. Monetization Strategy: Define and own the monetization product strategy for the marketplace, focusing on helping customers sell or rent their properties more effectively while driving sustainable revenue growth for the platform. Product Development: Optimize the current monetization product portfolio such as listing products, pricing tools, and subscription offerings …, and create new products to unlock new monetization opportunities. Experimentation & Optimization: Design and run experiments to validate hypotheses, measure impact, and continuously improve monetization outcomes. Cross-Functional Collaboration: Work closely with Marketing, Sales, Finance, Pricing teams to ensure seamless execution and successful adoption of product initiatives. Market & User Insights: Conduct in-depth analysis of the competitive landscape, user behavior, and property business models to identify and prioritize monetization and growth opportunities. Stakeholder Communication: Clearly communicate product vision, performance, and roadmap updates to senior leadership and key cross-functional stakeholders.

Negotiation

View details

DevOps Engineer

Ha Noi - Viet Nam

Outsource

  • Devops

Client Consulting: Directly engage with clients to design solutions and implement DevSecOps practices. Tool Deployment & Configuration: Deploy, install, and configure DevSecOps and CI/CD tools, including: Container Orchestration: Kubernetes, OpenShift Source Code Management: GitLab, GitHub Automation Tools: Jenkins, GitLab CI Artifact Management: Nexus, JFrog Code Scanning: SonarQube, Semgrep, BlackDuck, Coverity Observability Solutions: Deploy, install, and configure logging, monitoring, and tracing systems. CI/CD Pipeline Development: Build and optimize CI/CD pipelines for application delivery. Operational Support: Provide ongoing operational and administrative support for DevSecOps tools and solutions. Research & Innovation: Conduct R&D on emerging technologies in DevOps, DevSecOps, Cloud-Native, and AI.

Negotiation

View details

Testing - Senior BD

Ho Chi Minh - Viet Nam

Recruiting & Payroll services, Human Resource Services

This is template To design, document and implement complex technical solutions for various type/size systems, and fully aware the integration, maintenance and migration aspects To be the escalation point for technical issues of all software development projects performed in a location (with the same competence)

Negotiation

View details