Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.
Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.
At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.
Experience in large scale deployment and performance tuning.
Experience with schema design and dimensional data modeling
Experience with non-relational and relational databases (MySQL, MongoDB)
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with data pipeline and workflow management tool
Fluent written and spoken English.
Strong analytical and problem-solving skills.
Bonus Points if You
Have experience with Delta Lake technology.
Good Docker/Kubernetes knowledge is a plus.
Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.
We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.
We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.
We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.
We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.
We care about giving back to the communities in which we live and work. We supports a  broad range of community initiatives through donations and employee volunteer activities.
We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Job ID:

J01078

Status:

Close

Related Job:

Head of Engineer - Tech Fraud & Scams VN

Ho Chi Minh

Product

  • Management
  • Backend
  • Data Engineering

Develop an integrated roadmap for the strategic execution of Customer Onboarding and Mastery, Financial Crime, and Fraud's strategic ambitions. Lead engineering teams across these domains to drive outcomes, necessitating domain knowledge in these areas. Collaborate with business teams and product owners to validate requirements and monitor post-delivery performance. Oversee the runtime of applications in production and provide active operational support. Lead efforts for cyber security updates and ensure software currency versions remain up to date. Manage investment delivery across CET to maintain alignment between domains and ensure effective spending while providing insights on prioritization of spend and its effectiveness.

Negotiation

View details

Head of Engineer - CET

Ho Chi Minh - Viet Nam

Product

  • Management

Develop an integrated strategic roadmap for the execution of the Customer Onboarding and Mastery, Financial Crime, and Fraud's strategic ambitions, and drive the process from development to implementation. Manage multiple engineering teams across the Customer Onboarding and Mastery, Financial Crime, and Fraud domains to achieve desired outcomes, requiring domain knowledge in these areas. Collaborate with business teams and product owners to validate requirements before and after delivery through showcases and Day 2 production monitoring. Take ownership of the development and runtime of applications in production, providing active operational support and establishing a clear support model with engineers proficient in site reliability engineering. Lead efforts related to cyber security updates, ensuring that software currency versions are kept up to date and infrastructure is patched regularly. Oversee investment delivery across the organization to maintain alignment between domains, effectively allocate investments, and provide insights on the prioritization and effectiveness of spending.

Negotiation

View details

Head of Engineer - Home Ownership

Ho Chi Minh - Viet Nam

Product

  • Management

Take charge of technical leadership for the Sub-Domain and ensure timely delivery of Software Development Life Cycle Epics and Features. Guide, train, and support technology resources to enhance their skills and knowledge for optimal performance and to foster a highly effective team. Drive technical delivery with a focus on enhancing speed, cost, and quality of outcomes, while ensuring alignment of the squads on objectives and outcomes. Facilitate lean portfolio management across the Domain by connecting business roadmaps with software delivery and overseeing cross-functional, agile teams to meet performance targets. Accountable for addressing technical or delivery obstacles that cannot be resolved at the squad level. Oversee financials to ensure adherence to the plan and drive continuous improvement in development and delivery processes. Develop a leading market capacity and strategically deploy departmental resources to achieve optimal resource allocation and successful product development.

Negotiation

View details