Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.
Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.
At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.
Experience in large scale deployment and performance tuning.
Experience with schema design and dimensional data modeling
Experience with non-relational and relational databases (MySQL, MongoDB)
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with data pipeline and workflow management tool
Fluent written and spoken English.
Strong analytical and problem-solving skills.
Bonus Points if You
Have experience with Delta Lake technology.
Good Docker/Kubernetes knowledge is a plus.
Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.
We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.
We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.
We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.
We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.
We care about giving back to the communities in which we live and work. We supports a  broad range of community initiatives through donations and employee volunteer activities.
We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Job ID:

J01078

Status:

Close

Related Job:

AI Engineer

Ho Chi Minh - Viet Nam


Product

  • AI
  • Python

#AI-Powered Insurance Solutions Develop and deploy machine learning models to support insurance recommendation, pricing, risk assessment, and claims automation Build and maintain AI-powered features integrated into our embedded insurance platform - from data pipelines to inference APIs Design and implement RAG (Retrieval-Augmented Generation) pipelines and LLMbased assistants for internal and customer-facing use cases Collaborate with product and engineering teams to translate business requirements into practical AI solutions Participate in the full ML/AI lifecycle: data collection, feature engineering, model training, evaluation, deployment, and monitoring Contribute to our internal AI agent framework - building, testing, and improving multiagent workflows using LangChain, LangGraph, or similar tools Ensure AI models and services meet performance, reliability, and compliance standards in a regulated (insurance) environment Participate in developing CI/CD workflows for AI/ML/Data pipelines. Contribute to Agent Development Toolkits (ADK) and the automated Software Development Life Cycle (SDLC) that accelerate AI-native feature delivery#R&D & Engineering Tasks Research and experiment with state-of-the-art AI/ML techniques and evaluate their applicability to insurance use cases Prototype new AI capabilities quickly, iterate based on feedback, and graduate successful experiments into production Document experiments, model architectures, and engineering decisions clearly for team knowledge sharing Stay current with the AI ecosystem (LLM advances, agent frameworks, tooling) and bring relevant insights back to the team Support Full Stack Engineers in using the AI Development Toolkit (ADK) to develop applications - guiding and enabling their use of the toolkit rather than building the applications yourself - and maintain a basic understanding of the SDLC to help ensure consistent engineering standards across the platform Contribute to and continuously enhance the system knowledge base, ensuring documentation, patterns, and learnings are accessible to the agents

Negotiation

View details

Backend Engineer

Ho Chi Minh - Viet Nam


Product

  • Typescript
  • NodeJS
  • Python
  • AI

Build the core gateway: a unified, OpenAI-compatible API in front of multiple providers (OpenAI, Anthropic, Google, plus self-hosted and OSS models). Own provider routing and reliability: load balancing, automatic failover, and cost and latency-aware routing. Build billing and metering that is correct, not approximate: per-request token accounting, usage ledgers, cost attribution per team, user, and key, budgets, and spend limits. Ship org controls: API key management, per-team and per-user quotas, rate limiting, and RBAC. Handle streaming and performance: low-overhead proxying, streaming responses, connection handling, and caching where it helps. Contribute to the Jan Agent and connect it to the router: route its model and tool calls through the gateway, and make agent traffic first-class in metering, controls, and observability. Make deliberate speed-versus-correctness calls: move fast where iteration is cheap, refuse to cut corners where a bug means a bad charge or a leaked key, and pay down debt on your own initiative.

Negotiation

View details

Head of Engineering - Marketing Technology

Ho Chi Minh - Viet Nam


Product

  • Management

Develop an integrated roadmap for strategic execution based on the organization's strategic aspirations and lead the implementation process from planning to delivery. Manage multiple engineering teams throughout the organization to achieve desired outcomes, hence having knowledge of the organization's specific areas of operation is an advantage. Collaborate closely with business teams and product owners to verify requirements before and after delivery through showcases and post-production monitoring. Take responsibility for both the development and operation of applications in production, providing active operational support and establishing a clear support model with a focus on site reliability engineering. Direct and oversee the implementation of cybersecurity updates, including keeping software versions current and patching infrastructure regularly. Oversee investment allocation across the organization to maintain alignment, ensure effective spending, and offer insights on the effectiveness and prioritization of investments. Integrate engineering excellence with domain expertise in marketing while pursuing strategic technology objectives.

Negotiation

View details