Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.
Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.
At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.
Experience in large scale deployment and performance tuning.
Experience with schema design and dimensional data modeling
Experience with non-relational and relational databases (MySQL, MongoDB)
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with data pipeline and workflow management tool
Fluent written and spoken English.
Strong analytical and problem-solving skills.
Bonus Points if You
Have experience with Delta Lake technology.
Good Docker/Kubernetes knowledge is a plus.
Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.
We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.
We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.
We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.
We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.
We care about giving back to the communities in which we live and work. We supports a  broad range of community initiatives through donations and employee volunteer activities.
We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Job ID:

J01078

Status:

Close

Related Job:

Senior Backend Engineer

Ho Chi Minh, Ha Noi - Viet Nam


Product

Design, build, and operate backend services that power a leading B2B SaaS platform for the construction industry. Design clean, maintainable, and extensible software architecture. Identify and resolve performance bottlenecks (query optimization, caching, async processing). Drive software quality through automated testing, code reviews, observability, and CI/CD practices. Review and validate AI-generated code to ensure maintainability, correctness, and security. Mentor engineers and raise the team's engineering bar.#Development environment: Backend: Ruby (on Rails), Golang, Amazon Aurora (MySQL), DynamoDB FrontEnd: Nuxt.js, Vue.js, Next.js, ReactJS Mobile App: Kotlin, Swift, Flutter Deploy/ Build: AWS Amplify, CodePipeline, CodeBuild, CircleCI, GitHub Actions Others: Swagger, Docker, Figma, Confluence, JIRA, esa, gRPC Infrastructure: Helm, Terraform Automation test: Autify, Magicpod

Negotiation

View details

Application Engineer

Ho Chi Minh - Viet Nam


Product

  • Frontend
  • ReactJS
  • NodeJS

Build and maintain the Jan desktop app across macOS, Windows, and Linux using Tauri. Work full stack across the app: React and Node.js on the application layer, Rust on the native side. Own packaging, builds, and distribution: installers, auto-update, release pipelines, and code signing. Give Linux first-class support: packaging and distribution across common distros. Integrate local model runtimes and app features end to end. Work agent-natively as your default, running agents in parallel with your own review and guardrail discipline.

Negotiation

View details

AI Engineer

Ho Chi Minh - Viet Nam


Product

  • AI
  • Python

#AI-Powered Insurance Solutions Develop and deploy machine learning models to support insurance recommendation, pricing, risk assessment, and claims automation Build and maintain AI-powered features integrated into our embedded insurance platform - from data pipelines to inference APIs Design and implement RAG (Retrieval-Augmented Generation) pipelines and LLMbased assistants for internal and customer-facing use cases Collaborate with product and engineering teams to translate business requirements into practical AI solutions Participate in the full ML/AI lifecycle: data collection, feature engineering, model training, evaluation, deployment, and monitoring Contribute to our internal AI agent framework - building, testing, and improving multiagent workflows using LangChain, LangGraph, or similar tools Ensure AI models and services meet performance, reliability, and compliance standards in a regulated (insurance) environment Participate in developing CI/CD workflows for AI/ML/Data pipelines. Contribute to Agent Development Toolkits (ADK) and the automated Software Development Life Cycle (SDLC) that accelerate AI-native feature delivery#R&D & Engineering Tasks Research and experiment with state-of-the-art AI/ML techniques and evaluate their applicability to insurance use cases Prototype new AI capabilities quickly, iterate based on feedback, and graduate successful experiments into production Document experiments, model architectures, and engineering decisions clearly for team knowledge sharing Stay current with the AI ecosystem (LLM advances, agent frameworks, tooling) and bring relevant insights back to the team Support Full Stack Engineers in using the AI Development Toolkit (ADK) to develop applications - guiding and enabling their use of the toolkit rather than building the applications yourself - and maintain a basic understanding of the SDLC to help ensure consistent engineering standards across the platform Contribute to and continuously enhance the system knowledge base, ensuring documentation, patterns, and learnings are accessible to the agents

Negotiation

View details