Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.

Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.

Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.

Monitoring performance and advising any necessary infrastructure changes.

Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.

At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.

Experience in large scale deployment and performance tuning.

Experience with schema design and dimensional data modeling

Experience with non-relational and relational databases (MySQL, MongoDB)

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

Experience with data pipeline and workflow management tool

Fluent written and spoken English.

Strong analytical and problem-solving skills.

Bonus Points if You

Have experience with Delta Lake technology.

Good Docker/Kubernetes knowledge is a plus.

Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.

We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.

We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.

We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.

We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.

We care about giving back to the communities in which we live and work. We supports a broad range of community initiatives through donations and employee volunteer activities.

We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666

We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Salary:

Negotiation

Job ID:

J01078

Status:

Related Job:

AI & DATA Engineer/Databricks

Ho Chi Minh - Viet Nam

Outsource

Data Engineering
AI

Lead the design and implementation of cloud-native data pipelines for large-scale analytics and AI applications using Databricks Develop and maintain high-quality backend APIs and AI Agents supporting internal tools and customer-facing products Execute and manage data migration projects with a focus on performance, reliability, and maintainability Access Databricks environments directly or via CLI to develop, orchestrate, test, and deploy jobs and pipelines Promote and implement CI/CD best practices, Git workflows, and engineering standards across the data team Collaborate closely with AI engineers, consultants, and external stakeholders to translate requirements into scalable solutions

Negotiation

View details

Solution Designer - Technology Fraud & Scams

Ho Chi Minh - Viet Nam

Product

Java
ReactJS
AWS
Azure
Microservices

Evaluate business requirements and COM systems to form enterprise-level solutions that prioritize technical excellence, security, scalability, and business value. Develop comprehensive design documents, architectural diagrams, and technical documentation for implementation teams. Utilize systems thinking and design thinking methodologies to analyze implications across the COM ecosystem. Conduct proof-of-concept builds as needed to validate architectural decisions and minimize implementation risks. Communicate intricate technical concepts and design choices to various stakeholders such as Heads of Technology, Engineering Managers, Product Owners, Tech Leads, Testing Teams, and Technology Executives. Act as a reliable intermediary between business and technical domains. Promote platform-thinking principles by creating reusable, adaptable solutions that enhance consistency and effectiveness within the organization. Offer strategic advice to Technology Leadership on architectural strategy, technical debt, and platform development.

Negotiation

View details

Featured Job

Associate Manager – Software Engineer

Ho Chi Minh - Viet Nam

Product

Java
ReactJS

Lead the decisions around scalable full-stack and cloud-native systems architecture. Advocate for best practices in system design, reliability, and observability. Take charge of delivering essential platform capabilities, including crew training and assessment (OCL), compliance systems (Track & Trace), restaurant monitoring and reporting (MRD), virtual restaurant assessments, and intelligent operational action systems for RGMs. Collaborate with product and stakeholders, translating business requirements into scalable solutions. Build and design scalable applications using React/React Native, Spring Boot, and NestJS. Develop robust APIs and microservices that support restaurant operational systems. Ensure high code quality through testing, code reviews, and performance enhancement. Manage and create cloud infrastructure using AWS (EKS, Lambda). Set up CI/CD pipelines using GitLab CI. Guarantee strong monitoring and system reliability through the use of Datadog. Collaborate closely with engineering and product teams across global locations to deliver platform capabilities. Address complex technical challenges and provide scalable solutions to enhance platform reliability and operational efficiency.

Negotiation

View details