Senior DevOps (Data Platform)

ABOUT CLIENT

Our client is using new technology to develop products for the banking industry

JOB DESCRIPTION

Managing workloads on EC2 clusters using DataBricks/EMR for efficient data processing
Collaborating with stakeholders to implement a Data Mesh architecture for multiple closely related enterprise entities
Utilizing Infrastructure as Code (IaC) tools for defining and managing data platform user access
Implementing role-based access control (RBAC) mechanisms to enforce least privilege principles
Collaborating with cross-functional teams to design, implement, and optimize data pipelines and workflows
Utilizing distributed engines such as Spark for efficient data processing and analysis
Establishing operational best practices for data warehousing tools
Managing storage technologies to meet business requirements
Troubleshooting and resolving platform-related issues
Staying updated on emerging technologies and industry trends
Documenting processes, configurations, and changes for comprehensive system documentation.

JOB REQUIREMENT

Proficiency in infrastructure provisioning tools like AWS CloudFormation and Terraform
Familiarity with source control concepts and tools like Gitlab/Git flow and branches
Knowledge of at least one programming language, such as Python or Bash
Experience with distributed compute engines like Spark
Understanding of data platforms or orchestration tools such as Databricks and Airflow
Strong working knowledge of AWS services like IAM, VPC, EC2, RDS, DynamoDB, DMS, and S3
Familiarity with CI/CD tools and configuration management tools
Embraces a DevOps mindset with a focus on automation and operational excellence
Proficient in English with effective communication skills for both technical and business teams
Strong problem-solving abilities and logical thinking
Self-learning and curious attitude
Possession of AWS Data Engineer Associate or DevOps Professional Certifications
Enthusiastic about technology
Capable of working independently and as part of a team
Comfortable with ambiguity
Committed to usability and speed
Eager to present ideas to peers and management.

WHAT'S ON OFFER

Company offers meal and parking benefits.
Full benefits and probationary salary provided.
Insurance coverage as per Vietnamese labor law and premium health care for employees and their families.
Work environment is values-driven, international, and agile in nature.
Opportunities for overseas travel related to training and work.
Participation in internal Hackathons and company events such as team building, coffee runs, and blue card activities.
Additional benefits include a 13th-month salary and performance bonuses.
Employees receive 15 days of annual leave and 3 days of sick leave per year.
Work-life balance with a 40-hour workweek from Monday to Friday.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Devops, Spark

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Hybrid

Job ID:

J01916

Status:

Close

Related Job:

Senior Engineer Manager - Technology Risk

Ho Chi Minh - Viet Nam


Product

  • Management
  • Backend
  • Data Engineering
  • Devops

Develop and implement a cohesive roadmap for strategic execution based on the company's strategic ambitions Coordinate and oversee multiple engineering teams within the organization to achieve desired outcomes Collaborate with various internal teams, including technology, risk, business, and product teams, to ensure requirements are met before and after project delivery Take responsibility for both the development and ongoing operational support of applications in production Manage cyber security updates, ensuring software versions are up to date and infrastructure is patched regularly Monitor and control investment delivery to maintain alignment between different domains and optimize spending Facilitate collaboration between engineering and risk domain experts to achieve strategic technology goals

Negotiation

View details

Data Engineer

Ho Chi Minh - Viet Nam


Outsource

  • Data Engineering
  • Python

Develop, test, and manage batch and streaming data pipelines on various cloud platforms like Snowflake, AWS Redshift, and Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Import data from various sources such as client APIs, SaaS platforms, event streams, and databases into secure cloud storage and warehouse layers. Create transformation logic using SQL and Python and deploy tested, well-documented models in dbt. Establish datasets and dashboards in Sigma for easy querying by business users and AI systems. Prepare and deliver data for AI applications, including feature tables, embeddings, and retrieval datasets, and provide access to data through controlled APIs and MCP servers. Utilize AI programming tools and automated workflows to enhance development efficiency, testing, and documentation, ensuring accuracy in the output. Set up data quality assessments, monitoring, and alerts, and develop automated procedures for diagnosing pipeline failures with AI support. Record details about pipelines, schemas, and data structures for the benefit of other teams and AI systems. Engage in code assessments and sprint planning within an agile, globally distributed team.

Negotiation

View details

Senior/ Lead Data Engineer

Ho Chi Minh - Viet Nam


Outsource

  • Data Engineering
  • Python
  • Cloud

Develop pipelines on various cloud platforms such as Google Cloud Platform, AWS, and Snowflake for large enterprises. Create data models using dbt and make them accessible through layers that can be easily queried by analysts and applications. Construct data products that support automated systems, including layers for retrieval, pipelines for embedding, and interfaces for tools that agents use. Create workflows where agents oversee pipelines, address issues, conduct tests, and suggest improvements. Collaborate with teams from different backgrounds to hasten pipeline development, testing, and migration from older systems, ensuring that all changes are thoroughly checked before implementation. Establish and uphold data engineering standards for automation, continuous integration/continuous deployment (CI/CD), infrastructure as code, testing, and monitoring through code reviews. Take charge of data quality, data lineage, security, and cost management on various platforms, ensuring proper access controls and audit trails. Provide guidance to Data Engineers, evaluate their work, and serve as the representative for the data engineering team in technical conversations. Transform client business needs into technical designs and estimates for new projects.

Negotiation

View details