Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.
Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.
At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.
Experience in large scale deployment and performance tuning.
Experience with schema design and dimensional data modeling
Experience with non-relational and relational databases (MySQL, MongoDB)
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with data pipeline and workflow management tool
Fluent written and spoken English.
Strong analytical and problem-solving skills.
Bonus Points if You
Have experience with Delta Lake technology.
Good Docker/Kubernetes knowledge is a plus.
Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.
We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.
We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.
We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.
We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.
We care about giving back to the communities in which we live and work. We supports a  broad range of community initiatives through donations and employee volunteer activities.
We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Salary:

Negotiation

Job ID:

J01078

Status:

Close

Related Job:

Platform Lead

Others - Singapore

Product

  • Backend
  • Devops
  • Data Engineering

Develop and expand distributed systems to handle large volumes of sensory, telemetry, and control data across cloud and edge environments, facilitating real-time connections for fleets of robots. Create the API Platform with a focus on high reliability, exceptional developer experience, and robust multimodal AI capabilities accessible through user-friendly APIs and SDKs. Establish extensive training and inference platforms for foundation models used in robot autonomy, teleoperation, and developer integrations. Devise data ingestion and streaming pipelines for real-time connectivity of robot fleets to the cloud, covering various data inputs such as video, LiDAR, joint states, and audio. Oversee and advance a modern cloud native infrastructure stack employing Kubernetes, Docker, and infrastructure as code tools. Ensure platform reliability through telemetry, monitoring, alerting, autoscaling, failover, and disaster recovery measures. Make infrastructure decisions pertaining to distributed storage, consensus protocols, GPU orchestration, network reliability, and API security. Foster collaboration across ML, robotics, and product teams to facilitate hardware in the loop simulation, policy rollout, continuous learning, and CI/CD workflows. Implement secure APIs featuring fine-grained access control, usage metering, rate limiting, and billing integration to accommodate a growing user base.

Negotiation

View details

Embedded Software Engineer (Chinese Speaking)

Ho Chi Minh - Viet Nam

Outsource

  • Embedded

Create, maintain, and enhance complex embedded software components as per technical and business needs. Conduct software requirement engineering by validating and analyzing customer requirements. Integrate software components and merge them into a unified build. Develop and implement test cases to verify software functionality and ensure it meets quality standards. Adhere to established software development processes and coding standards to produce reliable code for embedded systems. Use debugging and analysis tools to troubleshoot software defects and performance issues. Provide guidance to junior engineers on technical tasks, coding practices, and problem-solving. Contribute to technical reviews and knowledge-sharing sessions within the team. Ensure compliance with industry standards, regulatory requirements, and quality frameworks relevant to assigned projects.

Negotiation

View details

Senior Backend Engineer (Python/AWS)

Ho Chi Minh - Viet Nam

Outsource

  • Python

Our company, with expert teams in Berlin and Ho Chi Minh City, provides innovative software solutions for startups and leading enterprise businesses in Germany. The team in Berlin and Ho Chi Minh City collaborates to develop high-quality solutions. We are seeking a Senior Backend Engineer (Python/AWS) to join our team in Ho Chi Minh City. This role is ideal for team players interested in building an international career as a product builder as well as a coder. Developing and maintaining scalable backend services using Python for a live product Designing and implementing robust RESTful APIs and backend systems following industry best practices Leading the design and development of cloud-native backend solutions on AWS (e.g., ECS, SQS, SNS) Driving the architecture and scalability of backend systems for reliability, performance, and maintainability Defining and enforcing coding standards, testing strategies, and best practices across the backend codebase Implementing and overseeing observability practices, including monitoring, logging, and alerting Collaborating closely with frontend engineers, QA, DevOps, and product stakeholders to deliver high-quality solutions Conducting code reviews, technical design reviews, and architectural discussions Leading troubleshooting and root-cause analysis of complex production issues Mentoring junior and mid-level engineers and supporting their technical growth Contributing to technical documentation, system design documentation, and knowledge sharing Staying up to date with emerging technologies and driving technical innovation within the team

Negotiation

View details