Senior Big Data Engineer

JOB DESCRIPTION

Design, Develop and enhancement Big Data Systems such as data warehouse, data lake
Designing and develop big data applications
Creating data processing frameworks
Extracting data and isolating data clusters
Doing POC & present about Big Data solutions for new project
Troubleshooting application bugs
Maintaining the data security
Develop and update technical documentation
Develop testing scripts and analyzing results

JOB REQUIREMENT

At least 5 years of experience in the relevant technologies
Bachelor degree in IT/ Computer Science or relevant background
Experience in the Hadoop ecosystem and its components: HDFS, Yarn, MapReduce, Apache Spark (Python/Scala), Apache Sqoop, Apache Impala, Apache Avro, Apache Flume, Apache Kafka
Preferred: having certificate CCA175 – Spark and Hadoop Developer
Designed and developed ETL process
Experienced in Unix with Scripting experience is preferred
Should have strong knowledge on concepts of data warehousing models, data ingestion patterns, data quality and data governance
Experience on the Hadoop systems with good understanding and knowledge of Hadoop cluster
Good at English communication skills

WHAT'S ON OFFER

Working in one of the Best Places to Work in Vietnam
Join a dynamic and fast growing global company (English-speaking environment)
13th-month salary bonus + attractive performance bonus (you'll love it!) + annual performance appraisal
100% monthly basic salary and mandatory social insurances in 2-month probation
Onsite opportunities: short-term and long-term assignments
15++ days of annual leave + 1 day of birthday leave
Premium health insurance for employee and 02 family members
Flexible working time
Lunch and parking allowance
Various training on hot-trend technologies/ foreign language (English/Chinese/Japanese) and soft-skills
Fitness & sport activities: football, badminton, yoga, Aerobic
Free in-house entertainment facilities and snack
Join in various team building, company trip, year-end party, tech talks and a lot of charity events

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data Engineering, Big Data

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Job ID:

J01277

Status:

Close

Related Job:

AI Engineer Lead

Ho Chi Minh - Viet Nam


Outsource

  • AI
  • Python

Spearhead the development and deployment of various applications, pipelines, and workflows tailored for financial services applications. Take charge of critical technical determinations related to model choices, design of retrieval systems, workflow structuring, integration strategies, cost considerations, and latency issues. Develop methodologies for evaluation and regression testing, utilizing data analysis and failure diagnostics to enhance the effectiveness of solutions. Ensure that deployed solutions adhere to production standards encompassing reliability, security, observability, data security, and audit trails. Transform business, risk, and compliance prerequisites into actionable technical solutions in collaboration with clients and internal partners. Provide guidance to engineers, fostering the adoption of standardized AI engineering practices, frameworks, and development methodologies.

Negotiation

View details

Senior Engineer Manager - Technology Risk

Ho Chi Minh - Viet Nam


Product

  • Management
  • Backend
  • Data Engineering
  • Devops

Develop and implement a cohesive roadmap for strategic execution based on the company's strategic ambitions Coordinate and oversee multiple engineering teams within the organization to achieve desired outcomes Collaborate with various internal teams, including technology, risk, business, and product teams, to ensure requirements are met before and after project delivery Take responsibility for both the development and ongoing operational support of applications in production Manage cyber security updates, ensuring software versions are up to date and infrastructure is patched regularly Monitor and control investment delivery to maintain alignment between different domains and optimize spending Facilitate collaboration between engineering and risk domain experts to achieve strategic technology goals

Negotiation

View details

Data Engineer

Ho Chi Minh - Viet Nam


Outsource

  • Data Engineering
  • Python

Develop, test, and manage batch and streaming data pipelines on various cloud platforms like Snowflake, AWS Redshift, and Google Cloud Platform (BigQuery, Dataflow, Pub/Sub, Cloud Composer). Import data from various sources such as client APIs, SaaS platforms, event streams, and databases into secure cloud storage and warehouse layers. Create transformation logic using SQL and Python and deploy tested, well-documented models in dbt. Establish datasets and dashboards in Sigma for easy querying by business users and AI systems. Prepare and deliver data for AI applications, including feature tables, embeddings, and retrieval datasets, and provide access to data through controlled APIs and MCP servers. Utilize AI programming tools and automated workflows to enhance development efficiency, testing, and documentation, ensuring accuracy in the output. Set up data quality assessments, monitoring, and alerts, and develop automated procedures for diagnosing pipeline failures with AI support. Record details about pipelines, schemas, and data structures for the benefit of other teams and AI systems. Engage in code assessments and sprint planning within an agile, globally distributed team.

Negotiation

View details