Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.
Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.
At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.
Experience in large scale deployment and performance tuning.
Experience with schema design and dimensional data modeling
Experience with non-relational and relational databases (MySQL, MongoDB)
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with data pipeline and workflow management tool
Fluent written and spoken English.
Strong analytical and problem-solving skills.
Bonus Points if You
Have experience with Delta Lake technology.
Good Docker/Kubernetes knowledge is a plus.
Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.
We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.
We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.
We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.
We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.
We care about giving back to the communities in which we live and work. We supports a  broad range of community initiatives through donations and employee volunteer activities.
We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Salary:

Negotiation

Job ID:

J01078

Status:

Close

Related Job:

Software Engineer - WQPlanner

Ho Chi Minh, Ha Noi - Viet Nam

product, Investment Management

Participate in development and maintenance of both backend and frontend services in Java, Python, ReactJS. Participate in development and maintenance of services to work with third parties such as: Kafka, Kubernetes, Airflow, Elasticsearch, etc. Participate in development and maintenance of monitoring services using Prometheus, Sentry, Alerta, etc. Coordinate with stake holders such as pure infrastructure team, business team, etc. to resolve crossing issues. Participate in designing distributed system architecture for systems and services.

Negotiation

View details

Data Engineer

Ho Chi Minh - Viet Nam

Outsourcing

  • Data Engineering
  • Python

This is a highly unique opportunity for a Data Engineer to join a new and rapidly growing team. In this role you will partner with our close-knit team of quantitative researchers, data engineers, technologists and data sourcing colleagues to analyze and enrich a broad range of structured and unstructured big data. Enriching a wide range of structured and unstructured data into datasets. Enhancing data quality & integrity by developing validation tools to measure the effectiveness of data enrichment. Becoming a domain expert on different deep learning and machine earning applications, analyzing & understanding the underlying dynamics and behaviors within the data. Develop insights based on the data and collaborate with the research team to generate tradable signals. Developing the utility tools that can further automate the software development, testing and deployment workflow. Using your expertise to provide technical support for global researchers, including diagnosing root causes of technical problems and proposing solutions to developers.

Negotiation

View details

QA Engineer (Data Testing)

Ho Chi Minh - Viet Nam

Outsourcing

  • Manual Test
  • Automation Test

Validate the accuracy, completeness, and consistency of output through data pipeline, ensuring it meets business requirements and quality standards. Develop and maintain automation test cases using Python and/or Java to streamline data validation processes. Work closely with data engineers, supporters, and other team to identify and resolve data-related issues. Participate in discussions, provide updates, and collaborate with team members in English during daily work.

Negotiation

View details