Big Data Engineer

JOB DESCRIPTION

Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities.
Implementing ETL process to transform data from OLTP databases to OLAP DB and Data Lake using event streaming platforms such as Kafka.
Develop, transform large datasets and maintain robust data pipelines that can support various use cases with high performance.
Monitoring performance and advising any necessary infrastructure changes.
Defining data retention, data governance policies and framework

JOB REQUIREMENT

At least 5 years experience in Java programming languages.
At least 5 years experience with Big Data, Java Spring, Kafka Streams, Spark Streams frameworks.
Experience in large scale deployment and performance tuning.
Experience with schema design and dimensional data modeling
Experience with non-relational and relational databases (MySQL, MongoDB)
Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
Experience with data pipeline and workflow management tool
Fluent written and spoken English.
Strong analytical and problem-solving skills.
Bonus Points if You
Have experience with Delta Lake technology.
Good Docker/Kubernetes knowledge is a plus.
Good Kibana, Elasticsearch ELK stack knowledge is a plus.

WHAT'S ON OFFER

We have a track record of success and a vision and a plan for a promising future. Our company has closed to 100% market share for player location regulatory compliance in the US gaming space. And we have fuelled that momentum with the expansion into new markets - media & entertainment and fintech.
We are proud of our values and we live them in all of our actions, conversations, and work: There’s always a way; Together we can do more; Aim higher. Then higher; Act with integrity; For the greater good.
We are proud to be part of a global team that develops award-winning solutions for some of the world’s largest and most innovative companies.
We will support you on your learning journey. We invest in employee career growth and development. Our learning & development commitment includes leadership and technical development, a substantial budget for education and training, as well as dedicated work hours for self-study.
We care about our team. Our team is talented, has a bias for action, and is known for their positive attitude and energy. Team members are generously rewarded with competitive salaries, incentives, and a comprehensive benefits package.
We care about giving back to the communities in which we live and work. We supports a  broad range of community initiatives through donations and employee volunteer activities.
We know that work can be fun. We take the time to create employee events and experiences where everyone can connect and celebrate.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Product

Technical Skills:

Data Engineering, Java

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Salary:

Negotiation

Job ID:

J01078

Status:

Close

Related Job:

Senior/ Lead Data Engineer (Data Platform / MLOps)

Ho Chi Minh, Ha Noi - Viet Nam


Information Technology & Services

You will be responsible for managing, designing, and enhancing data systems and workflows that drive key business decisions. The role is focused 75% on data engineering, involving the construction and optimization of data pipelines and architectures, and 25% on supporting data science initiatives through collaboration with data science teams for machine learning workflows and advanced analytics. You will leverage technologies like Python, Airflow, Kubernetes, and AWS to deliver high-quality data solutions. Architect, develop, and maintain scalable data infrastructure, including data lakes, pipelines, and metadata repositories, ensuring the timely and accurate delivery of data to stakeholders. Work closely with data scientists to build and support data models, integrate data sources, and support machine learning workflows and experimentation environments. Develop and optimize large-scale, batch, and real-time data processing systems to enhance operational efficiency and meet business objectives. Leverage Python, Apache Airflow, and AWS services to automate data workflows and processes, ensuring efficient scheduling and monitoring. Utilize AWS services such as S3, Glue, EC2, and Lambda to manage data storage and compute resources, ensuring high performance, scalability, and cost-efficiency. Implement robust testing and validation procedures to ensure the reliability, accuracy, and security of data processing workflows. Stay informed of industry best practices and emerging technologies in both data engineering and data science to propose optimizations and innovative solutions.

Negotiation

View details

Engineering Manager (Golang/RoR/JavaScript Backend Focus)

Ho Chi Minh, Ha Noi - Viet Nam


No.1 Construction Tech company in Japan

  • Backend
  • Golang
  • Ruby
  • Javascript

#Position Summary We are seeking an experienced and highly technical individual to join us as an Engineering Manager. This role is initially structured as a hands-on technical contributor to ensure a deep understanding of our projects, codebase, and team dynamics. Following this integration period, the successful candidate will transition fully into a dedicated Engineering Manager role, taking on full leadership responsibilities. This is a unique opportunity for a seasoned professional to lead a team while staying directly engaged with the technology.#Responsibilities#Engineering role: Hands-on Technical Contribution such as work directly on 1-2 critical projects, writing and reviewing code, designing system architecture, and ensuring technical excellence. Utilize strong expertise in Golang, Ruby on Rails (RoR), and JavaScript to develop and maintain robust, scalable backend systems. Contribute to the full software development lifecycle (SDLC), including requirements gathering, design, development, testing, and deployment. Align technical work with the overall Engineering standards and best practices (same as those for Andpad's senior Dev positions).#Management role: Leadership & People Management: Lead, mentor, and coach a team of 4-5 engineers. Team Leadership: Oversee team performance, project delivery, and technical quality. Conduct regular 1: 1 meetings, performance reviews, and career development planning for team members. Facilitate technical discussions, resolve roadblocks, and make critical architectural/design decisions. Drive continuous improvement in the team's engineering practices, tools, and processes. Act as the liaison between the engineering team and product management/stakeholders.

Negotiation

View details

Senior Software Engineer (Backend + Network)

Ho Chi Minh - Viet Nam


Product

  • Backend
  • Network

Continuously monitor and analyze new VPN providers, proxy services, and anonymization tools. Conduct investigations on IP allocation patterns, hosting provider behaviors, and network infrastructure changes. Develop and maintain comprehensive databases of known VPN/proxy IP ranges and behavioral signatures. Research emerging threats such as residential proxies, mobile proxies, and distributed proxy networks. Monitor darkweb marketplaces and security forums for emerging proxy/VPN trends. Perform deep packet analysis and network traffic pattern recognition. Develop and maintain the system using PHP, Python, and/or Go. Optimize VPN/Proxy detection algorithms. Design scalable infrastructure to handle millions of IP lookups per day. Implement monitoring and alerting systems for detection accuracy and system performance. Analyze production incidents related to false positives/negatives in threat detection. Collaborate with DevOps team on deployment of detection rule updates and model improvements. Investigate customer-reported bypass attempts and develop rapid response solutions. Provide technical expertise during customer security consultations. Support sales engineering team with technical demonstrations and proof-of-concepts. Document threat analysis findings and detection methodologies for internal and customer use. Maintain relationships with cybersecurity vendors, threat intelligence providers, and ISPs. Monitor industry threat reports, security advisories, and academic research. Participate in cybersecurity conferences and forums to stay current with the threat landscape. Contribute to open-source security tools and research when appropriate.

Negotiation

View details