Senior Data Engineer

JOB DESCRIPTION

About the Role/position
The ideal candidate is an experienced data pipeline builder and data wrangler, will act as technical data engineering expert in international team (multilocation). He/she will actively participate in optimizing data systems or building them from the ground up for our oversee customers.
Responsibilities:
The Data engineer will be responsible for:
Develop and maintain data pipelines using ETL processes.
Work closely with data science team to implement data analytics pipelines.
Maintain security and data privacy, working closely with data protection officer.
Implement scalable architectural models for data processing and storage.
Build functionality for data ingestion from multiple heterogeneous sources in batch & realtime mode.
Help in scoping, estimation, and planning to for various projects in the enterprise.
Provide technical support to project teams as needed.

JOB REQUIREMENT

Must have Technical Requirements / Qualifications
B.S. in Computer Science, related fields or commensurate work experience.
5+ years of relevant data engineering experience like Hadoop, Spark, Hive, HDFS, Pig… and ETL with large amounts of data.
Experience on complex regulatory data integration projects.
Solid knowledge and experience of data processing languages, such as SQL, Python, and/or Scala.
Hand on experience with real-time data stream platforms such as Kafka and Spark Streaming.
Experience on creating Slowly Changing Dimension type data tables in Hive using Spark framework.
Knowledge and experience on both relational databases (Oracle), NoSQL databases (e.g. MongoDB) and strong SQL querying skills, Performance Tuning are required.
Experience on Data Warehouse such as Teradata SQL, Informatica, Unix and Control-M.
Experience of data visualisation tools (e.g Tableau, Quantexa and SAS).
Knowledge of at least one cloud environment (Azure, GCP, AWS, IBM)
Agile based delivery knowledge
Excellent English communication – verbal, written, and presentation skills; adept at communicating and managing stakeholders at all levels.
Strong teambuilding skills and teamwork orientation.
Strong creative problem-solving skills.
Nice to have Technical Requirements / Qualifications
Knowledge or experience on Azure Modern Data Warehouse platform (e.g., Azure Data Lake, Synapse Analytics, Azure Data Factory, Azure Databricks, Databricks Delta Lake, etc).
AZ-900: Microsoft Azure Fundamentals.
Azure Data Engineer – Associate.

WHAT'S ON OFFER

Competitive salary, health insurance covered for employee and dependents
Working on international projects. Professional and dynamic working environment
Achieving valuable experience with variety projects, new technologies and hundreds of talents
Receiving training opportunities including many technical seminars and soft skill training courses
Good opportunity for promotion through regular performance review system
Hybrid work

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsourcing

Technical Skills:

Data Engineering, ETL/ELT

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Salary:

Negotiate

Job ID:

J01225

Status:

Close

Related Job:

Senior SAP FI Consultant

Ho Chi Minh - Viet Nam


outsourcing, Germany company

  • SAP

Lead a team of Finance specialists onsite and assist in configuring the solution (must have hands-on configuration experience). Provides guidance in the definition of solution design practices and standards that link back to SAP best practices. Understand the customer business processes and the IT landscape rapidly and able to foresee the likely challenges Ability to lead and facilitate design workshops (Blueprint), assessments, planning sessions. Work with customer business teams & project teams effectively Translates business goals into appropriate solutions while assessing feasibility and optimization of the solution. Conduct work effort estimation and develop work plans. Develops and maintains working relationships with a diverse group of business, functional and technical teams. Adhere to project plans, tasks, and deliverable; identifies dependencies and resource requirements.

Negotiation

View details

Senior Product Manager

Ho Chi Minh, Ha Noi - Viet Nam


No.1 Construction Tech company in Japan

  • Product Management

#The Opportunity: As the promoter of product development projects at the company, you will gain experience in project management and development direction, working with the business department from project definition to requirements definition, development, testing, and release. In the future, you will be responsible for product management of the company's products.#Job Scope: This is an important position that involves understanding the characteristics of users of the service and driving product development projects while balancing the needs of product, sales, customer success, and engineers. #Product Management: Define the scope, objectives, and goals of product development. Build the product structure and process, create and promote schedules. #Development Direction: Working with product managers to organize requirements, design business processes, and define requirements. Creating and executing test and release plans. Creating explanatory materials for internal/customer use. Verifying post-release effectiveness and reporting. Create and maintain comprehensive product documentation #Development Environment: Backend: Ruby on Rails, Go, AWS, Elasticsearch, MySQL, DynamoDB, Redis, Terraform (IaC), OIDC (Authentication). Frontend: Next.js/React.js, Typescript, Vue.js/Nuxt.js. Mobile App: Kotlin, Swift, Flutter. CI/CD & DevOps: Docker, Kubernetes, CodePipeline, CodeBuild, CircleCI, GitHub Actions. Monitoring & Tools: Datadog, Sentry, Bugsnag, Swagger, ZenHub, Figma

Negotiation

View details

Senior/ Lead Data Engineer (Data Platform / MLOps)

Ho Chi Minh, Ha Noi - Viet Nam


Information Technology & Services

You will be responsible for managing, designing, and enhancing data systems and workflows that drive key business decisions. The role is focused 75% on data engineering, involving the construction and optimization of data pipelines and architectures, and 25% on supporting data science initiatives through collaboration with data science teams for machine learning workflows and advanced analytics. You will leverage technologies like Python, Airflow, Kubernetes, and AWS to deliver high-quality data solutions. Architect, develop, and maintain scalable data infrastructure, including data lakes, pipelines, and metadata repositories, ensuring the timely and accurate delivery of data to stakeholders. Work closely with data scientists to build and support data models, integrate data sources, and support machine learning workflows and experimentation environments. Develop and optimize large-scale, batch, and real-time data processing systems to enhance operational efficiency and meet business objectives. Leverage Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoring. Utilize AWS services such as S3, Glue, EC2, and Lambda to manage data storage and compute resources, ensuring high performance, scalability, and cost-efficiency. Implement robust testing and validation procedures to ensure the reliability, accuracy, and security of data processing workflows. Stay informed of industry best practices and emerging technologies in both data engineering and data science to propose optimizations and innovative solutions.

Negotiation

View details