Senior Big Data Engineer

JOB DESCRIPTION

Design, Develop and enhancement Big Data Systems such as data warehouse, data lake
Designing and develop big data applications
Creating data processing frameworks
Extracting data and isolating data clusters
Doing POC & present about Big Data solutions for new project
Troubleshooting application bugs
Maintaining the data security
Develop and update technical documentation
Develop testing scripts and analyzing results

JOB REQUIREMENT

At least 5 years of experience in the relevant technologies
Bachelor degree in IT/ Computer Science or relevant background
Experience in the Hadoop ecosystem and its components: HDFS, Yarn, MapReduce, Apache Spark (Python/Scala), Apache Sqoop, Apache Impala, Apache Avro, Apache Flume, Apache Kafka
Preferred: having certificate CCA175 – Spark and Hadoop Developer
Designed and developed ETL process
Experienced in Unix with Scripting experience is preferred
Should have strong knowledge on concepts of data warehousing models, data ingestion patterns, data quality and data governance
Experience on the Hadoop systems with good understanding and knowledge of Hadoop cluster
Good at English communication skills

WHAT'S ON OFFER

Working in one of the Best Places to Work in Vietnam
Join a dynamic and fast growing global company (English-speaking environment)
13th-month salary bonus + attractive performance bonus (you'll love it!) + annual performance appraisal
100% monthly basic salary and mandatory social insurances in 2-month probation
Onsite opportunities: short-term and long-term assignments
15++ days of annual leave + 1 day of birthday leave
Premium health insurance for employee and 02 family members
Flexible working time
Lunch and parking allowance
Various training on hot-trend technologies/ foreign language (English/Chinese/Japanese) and soft-skills
Fitness & sport activities: football, badminton, yoga, Aerobic
Free in-house entertainment facilities and snack
Join in various team building, company trip, year-end party, tech talks and a lot of charity events

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

outsourcing, Germany company

Technical Skills:

Data Engineering, Big Data

Location:

Ho Chi Minh - Viet Nam

Salary:

Negotiation

Job ID:

J01277

Status:

Close

Related Job:

Software Engineer - WQPlanner

Ho Chi Minh, Ha Noi - Viet Nam

product, Investment Management

Participate in development and maintenance of both backend and frontend services in Java, Python, ReactJS. Participate in development and maintenance of services to work with third parties such as: Kafka, Kubernetes, Airflow, Elasticsearch, etc. Participate in development and maintenance of monitoring services using Prometheus, Sentry, Alerta, etc. Coordinate with stake holders such as pure infrastructure team, business team, etc. to resolve crossing issues. Participate in designing distributed system architecture for systems and services.

Negotiation

View details

Data Engineer

Ho Chi Minh - Viet Nam

Outsourcing

  • Data Engineering
  • Python

This is a highly unique opportunity for a Data Engineer to join a new and rapidly growing team. In this role you will partner with our close-knit team of quantitative researchers, data engineers, technologists and data sourcing colleagues to analyze and enrich a broad range of structured and unstructured big data. Enriching a wide range of structured and unstructured data into datasets. Enhancing data quality & integrity by developing validation tools to measure the effectiveness of data enrichment. Becoming a domain expert on different deep learning and machine earning applications, analyzing & understanding the underlying dynamics and behaviors within the data. Develop insights based on the data and collaborate with the research team to generate tradable signals. Developing the utility tools that can further automate the software development, testing and deployment workflow. Using your expertise to provide technical support for global researchers, including diagnosing root causes of technical problems and proposing solutions to developers.

Negotiation

View details

QA Engineer (Data Testing)

Ho Chi Minh - Viet Nam

Outsourcing

  • Manual Test
  • Automation Test

Validate the accuracy, completeness, and consistency of output through data pipeline, ensuring it meets business requirements and quality standards. Develop and maintain automation test cases using Python and/or Java to streamline data validation processes. Work closely with data engineers, supporters, and other team to identify and resolve data-related issues. Participate in discussions, provide updates, and collaborate with team members in English during daily work.

Negotiation

View details