Senior Data Engineer

JOB DESCRIPTION

About the Role/position
The ideal candidate is an experienced data pipeline builder and data wrangler, will act as technical data engineering expert in international team (multilocation). He/she will actively participate in optimizing data systems or building them from the ground up for our oversee customers.
Responsibilities:
The Data engineer will be responsible for:
Develop and maintain data pipelines using ETL processes.
Work closely with data science team to implement data analytics pipelines.
Maintain security and data privacy, working closely with data protection officer.
Implement scalable architectural models for data processing and storage.
Build functionality for data ingestion from multiple heterogeneous sources in batch & realtime mode.
Help in scoping, estimation, and planning to for various projects in the enterprise.
Provide technical support to project teams as needed.

JOB REQUIREMENT

Must have Technical Requirements / Qualifications
B.S. in Computer Science, related fields or commensurate work experience.
5+ years of relevant data engineering experience like Hadoop, Spark, Hive, HDFS, Pig… and ETL with large amounts of data.
Experience on complex regulatory data integration projects.
Solid knowledge and experience of data processing languages, such as SQL, Python, and/or Scala.
Hand on experience with real-time data stream platforms such as Kafka and Spark Streaming.
Experience on creating Slowly Changing Dimension type data tables in Hive using Spark framework.
Knowledge and experience on both relational databases (Oracle), NoSQL databases (e.g. MongoDB) and strong SQL querying skills, Performance Tuning are required.
Experience on Data Warehouse such as Teradata SQL, Informatica, Unix and Control-M.
Experience of data visualisation tools (e.g Tableau, Quantexa and SAS).
Knowledge of at least one cloud environment (Azure, GCP, AWS, IBM)
Agile based delivery knowledge
Excellent English communication – verbal, written, and presentation skills; adept at communicating and managing stakeholders at all levels.
Strong teambuilding skills and teamwork orientation.
Strong creative problem-solving skills.
Nice to have Technical Requirements / Qualifications
Knowledge or experience on Azure Modern Data Warehouse platform (e.g., Azure Data Lake, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks Delta Lake, etc).
AZ-900: Microsoft Azure Fundamentals.
Azure Data Engineer – Associate.

WHAT'S ON OFFER

Competitive salary, health insurance covered for employee and dependents
Working on international projects. Professional and dynamic working environment
Achieving valuable experience with variety projects, new technologies and hundreds of talents
Receiving training opportunities including many technical seminars and soft skill training courses
Good opportunity for promotion through regular performance review system
Hybrid work

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsourcing

Technical Skills:

Data Engineering, ETL/ELT

Location:

Ho Chi Minh - Viet Nam

Salary:

Negotiate

Job ID:

J01225

Status:

Close

Related Job:

Software Engineer - WQPlanner

Ho Chi Minh, Ha Noi - Viet Nam

product, Investment Management

Participate in development and maintenance of both backend and frontend services in Java, Python, ReactJS. Participate in development and maintenance of services to work with third parties such as: Kafka, Kubernetes, Airflow, Elasticsearch, etc. Participate in development and maintenance of monitoring services using Prometheus, Sentry, Alerta, etc. Coordinate with stake holders such as pure infrastructure team, business team, etc. to resolve crossing issues. Participate in designing distributed system architecture for systems and services.

Negotiation

View details

Data Engineer

Ho Chi Minh - Viet Nam

Outsourcing

  • Data Engineering
  • Python

This is a highly unique opportunity for a Data Engineer to join a new and rapidly growing team. In this role you will partner with our close-knit team of quantitative researchers, data engineers, technologists and data sourcing colleagues to analyze and enrich a broad range of structured and unstructured big data. Enriching a wide range of structured and unstructured data into datasets. Enhancing data quality & integrity by developing validation tools to measure the effectiveness of data enrichment. Becoming a domain expert on different deep learning and machine earning applications, analyzing & understanding the underlying dynamics and behaviors within the data. Develop insights based on the data and collaborate with the research team to generate tradable signals. Developing the utility tools that can further automate the software development, testing and deployment workflow. Using your expertise to provide technical support for global researchers, including diagnosing root causes of technical problems and proposing solutions to developers.

Negotiation

View details

QA Engineer (Data Testing)

Ho Chi Minh - Viet Nam

Outsourcing

  • Manual Test
  • Automation Test

Validate the accuracy, completeness, and consistency of output through data pipeline, ensuring it meets business requirements and quality standards. Develop and maintain automation test cases using Python and/or Java to streamline data validation processes. Work closely with data engineers, supporters, and other team to identify and resolve data-related issues. Participate in discussions, provide updates, and collaborate with team members in English during daily work.

Negotiation

View details