Senior/Lead Data Engineer

ABOUT CLIENT

Our client is a global technology company that specializes in providing innovative IT solutions for the financial services industry

JOB DESCRIPTION

Implement technical infrastructure for compliance initiatives such as SOC 2 and GDPR, including building systems for a future data catalog and managing data access.
Design and develop scalable data pipelines for batch and event-driven data ingestion to facilitate real-time analytics and machine learning feature capabilities.
Establish foundational patterns for data quality monitoring, including automated freshness and integrity checks for critical data assets to enhance trust and reliability in the data.
Proactively lead the migration of analytical workloads from a shared production cluster to a scalable cloud data warehouse, such as Snowflake.

JOB REQUIREMENT

At least 7 years of experience in data engineering, emphasizing the construction and management of core data platforms.
Specialization in Modern Data Warehousing: Proven expertise in designing, constructing, and maintaining robust and scalable data warehouses such as Snowflake, BigQuery, or Redshift.
Proficiency in Event-Driven Architectures: Hands-on experience with real-time data processing technologies and patterns (e.g., Kafka, Kinesis, Flink, Spark Streaming).
Extensive Knowledge of Database Operations: Strong comprehension of database performance tuning, monitoring, disaster recovery, and the operational considerations of large-scale data systems.
Experience with Data Governance & Compliance: Hands-on involvement in creating technical solutions to meet compliance requirements like SOC 2 or GDPR, including data access controls and cataloging.
Pragmatic Problem-Solving Skills: Demonstrated ability to select appropriate solutions without over-engineering, while ensuring robustness in a startup environment. Proficiency in SQL and Python.
AWS Experience: Familiarity with core AWS services used in a platform context (RDS, S3, IAM, Kinesis, etc.). Experience using dbt (Data Build Tool) for data transformations in a production environment is highly desirable.
Infrastructure as Code Experience: Familiarity with tools such as Terraform for managing data infrastructure.
Experience in a Startup Environment: Comfortable working in an ambiguous and fast-paced setting.

WHAT'S ON OFFER

Generous salary package
Additional month's salary
Performance-based bonuses
Access to professional English training
Comprehensive health insurance
Ample annual leave opportunities

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data Engineering, Python, AWS

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Job ID:

J00685

Status:

Close

Related Job:

Senior Engineer Manager - Technology Risk

Ho Chi Minh - Viet Nam

Product

  • Management
  • Backend
  • Data Engineering
  • Devops

Develop and implement a cohesive roadmap for strategic execution based on the company's strategic ambitions Coordinate and oversee multiple engineering teams within the organization to achieve desired outcomes Collaborate with various internal teams, including technology, risk, business, and product teams, to ensure requirements are met before and after project delivery Take responsibility for both the development and ongoing operational support of applications in production Manage cyber security updates, ensuring software versions are up to date and infrastructure is patched regularly Monitor and control investment delivery to maintain alignment between different domains and optimize spending Facilitate collaboration between engineering and risk domain experts to achieve strategic technology goals

Negotiation

View details

Data Engineer

Ho Chi Minh - Viet Nam

Outsource

  • Data Engineering

Develop, test, and manage batch and streaming data pipelines on various cloud platforms like Snowflake, AWS Redshift, and Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Import data from various sources such as client APIs, SaaS platforms, event streams, and databases into secure cloud storage and warehouse layers. Create transformation logic using SQL and Python and deploy tested, well-documented models in dbt. Establish datasets and dashboards in Sigma for easy querying by business users and AI systems. Prepare and deliver data for AI applications, including feature tables, embeddings, and retrieval datasets, and provide access to data through controlled APIs and MCP servers. Utilize AI programming tools and automated workflows to enhance development efficiency, testing, and documentation, ensuring accuracy in the output. Set up data quality assessments, monitoring, and alerts, and develop automated procedures for diagnosing pipeline failures with AI support. Record details about pipelines, schemas, and data structures for the benefit of other teams and AI systems. Engage in code assessments and sprint planning within an agile, globally distributed team.

Negotiation

View details

Senior/ Lead Data Engineer

Ho Chi Minh - Viet Nam

Outsource

  • Data Engineering

Develop pipelines on various cloud platforms such as Google Cloud Platform, AWS, and Snowflake for large enterprises. Create data models using dbt and make them accessible through layers that can be easily queried by analysts and applications. Construct data products that support automated systems, including layers for retrieval, pipelines for embedding, and interfaces for tools that agents use. Create workflows where agents oversee pipelines, address issues, conduct tests, and suggest improvements. Collaborate with teams from different backgrounds to hasten pipeline development, testing, and migration from older systems, ensuring that all changes are thoroughly checked before implementation. Establish and uphold data engineering standards for automation, continuous integration/continuous deployment (CI/CD), infrastructure as code, testing, and monitoring through code reviews. Take charge of data quality, data lineage, security, and cost management on various platforms, ensuring proper access controls and audit trails. Provide guidance to Data Engineers, evaluate their work, and serve as the representative for the data engineering team in technical conversations. Transform client business needs into technical designs and estimates for new projects.

Negotiation

View details