Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.

Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.

Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.

Monitoring performance and advising any necessary infrastructure changes.

Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.

At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.

Experience in large scale deployment and performance tuning.

Experience with schema design and dimensional data modeling

Experience with non-relational and relational databases (MySQL, MongoDB)

Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.

Experience with data pipeline and workflow management tool

Fluent written and spoken English.

Strong analytical and problem-solving skills.

Bonus Points if You

Have experience with Delta Lake technology.

Good Docker/Kubernetes knowledge is a plus.

Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.

We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.

We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.

We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.

We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.

We care about giving back to the communities in which we live and work. We supports a broad range of community initiatives through donations and employee volunteer activities.

We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666

We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Job ID:

J01078

Status:

Related Job:

Senior Full-Stack Engineer (AI Service Desk)

Ho Chi Minh - Viet Nam

Outsource

.NET
ReactJS
Azure

Design and develop backend services and APIs using C# and .NET technologies Build modern frontend applications and dashboard interfaces using React Develop scalable integrations between operational systems, analytics services, and reporting layers Full-stack development experience across frontend and backend systems Work closely with engineering and product teams to translate business requirements into technical solutions Improve application performance, maintainability, and scalability Participate in technical discussions, code reviews, and architecture decisions Contribute to engineering standards and development best practices

Negotiation

View details

Senior AI DevSecOps Engineer

Ho Chi Minh - Viet Nam

Product

Devops
AWS
Azure
Security

Management of CI/CD Pipeline: Ensure automation, security, and scalability across all stages of the development lifecycle. Infrastructure & Security: Design and implement secure multi-cloud infrastructure solutions leveraging cloud services, containerization, and orchestration tools. Policy as Code: Define and enforce security and compliance policies across Kubernetes clusters using OPA or Kyverno, ensuring guardrails are automated and auditable. AI & Platform Automation: Drive the adoption of AI-powered tools and workflows to automate infrastructure operations, optimize CI/CD pipelines, accelerate root cause analysis, improve security posture, and enhance engineering productivity. Observability & Alerting: Build and maintain a comprehensive observability stack with proactive alerting, dashboards, and runbooks for critical business flows and security events. Secret & Credential Management: Design and enforce secrets management practices across all environments ensuring zero hardcoded credentials in codebases and pipelines. Incident Response & On-Call: Own and continuously improve incident response processes, define runbooks, lead post-mortems, track MTTR, and participate in on-call rotation to maintain platform reliability and SLO adherence. Threat Modelling & Penetration Testing: Conduct regular threat modelling sessions with engineering teams and coordinate or perform penetration testing activities to proactively identify attack surfaces before they reach production. Code Security: Conduct regular code reviews and static/dynamic analysis to identify and remediate security vulnerabilities. Compliance and Best Practices: Ensure compliance with industry standards and best practices. Collaboration: Collaborate with development, operations, and security teams to foster a culture of automation and security-first thinking. Mentorship: Mentor junior engineers and other team members on security best practices. Documentation: Maintain thorough and up-to-date documentation of security policies, procedures, and incident reports. Trend Scouting: Stay updated with the latest trends in technology and AI to integrate innovative solutions into our processes.

Negotiation

View details

Senior Data Engineer (C++, Python, AI/LLM)

Ho Chi Minh - Viet Nam

Outsource

Data Engineering
C/C++
Python

Refine a wide array of structured and unstructured data to produce high-quality datasets for quantitative analysis and financial engineering. Improve data integrity and quality by creating validation tools and frameworks to assess the effectiveness of data enrichment pipelines. Gain expertise in machine learning, deep learning, and emerging AI/LLM applications, and analyze the underlying dynamics and behaviors in the data. Derive insights from large-scale datasets and collaborate with research teams to pinpoint opportunities for tradable signals. Create utility tools to automate software development, testing, deployment, and monitoring workflows. Offer technical support to global researchers, including diagnosing technical issues, troubleshooting Python and C++ code, and suggesting scalable fixes and improvements. Troubleshoot and resolve issues in C++ applications and data pipelines with a strong focus on performance, stability, correctness, and maintainability. Investigate and implement AI/LLM-based solutions to enhance data processing, workflow efficiency, troubleshooting, documentation, and research support processes.

Negotiation

View details