Cloud Engineer (AWS Kafka)

ABOUT CLIENT

Our client is using new technology to develop products for the banking industry

JOB DESCRIPTION

Designing, implementing, and maintaining streaming solutions using AWS Managed Streaming for Apache Kafka (MSK).
Monitoring and managing Kafka clusters to ensure optimal performance, scalability, and uptime.
Configuring and fine-tuning MSK clusters, including partitioning strategies, replication, and retention policies.
Collaborating with engineering teams to design and implement event-driven systems and microservices architectures.
Developing and maintaining robust data pipelines for real-time data processing and streaming using Kafka.
Ensuring seamless integration between MSK/SQS/SNS and other AWS services such as Lambda, EventBridge Pipes, S3.
Analyzing and optimizing the performance of Kafka clusters and streaming pipelines to meet high-throughput and low-latency requirements.
Implementing best practices for Kafka topic design, consumer group management, and message serialization (e.g., Avro).
Implementing security best practices for MSK, including encryption, authentication, and access controls.
Ensuring compliance with industry standards and regulations related to data streaming and event processing.
Setting up comprehensive monitoring and alerting for Kafka clusters and streaming applications using AWS CloudWatch and Datadog.
Troubleshooting and resolving issues related to data loss, message lag, and streaming failures.
Designing and implementing data integration solutions to stream data between various sources and targets using MSK.
Leading data transformation and enrichment processes to ensure data quality and consistency in streaming applications.

JOB REQUIREMENT

Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
Minimum 5 years of experience in event-driven architectures and streaming solutions.
Proficiency in Apache Kafka, with at least 2 years specifically in AWS MSK.
Design and implementation experience of high-throughput, low-latency streaming applications in AWS environments.
Strong understanding of Kafka internals and proficiency in programming languages such as Java, Python, or Scala.
Experience with AWS services like Lambda, Kinesis, S3, and IAM in conjunction with MSK.
Familiarity with CI/CD tools and IaC tools like CloudFormation, Terraform, or CDK.
Strong analytical and problem-solving skills with effective communication and collaboration abilities.
AWS Certified Solutions Architect, AWS Certified Developer, or similar AWS certification.
Strong analytical and problem-solving skills and effective communication and collaboration abilities.
Ability to manage multiple priorities and projects in a fast-paced environment.

WHAT'S ON OFFER

Company offers meal and parking benefits.
Full benefits and probationary salary provided.
Insurance coverage as per Vietnamese labor law and premium health care for employees and their families.
Work environment is values-driven, international, and agile in nature.
Opportunities for overseas travel related to training and work.
Participation in internal Hackathons and company events such as team building, coffee runs, and blue card activities.
Additional benefits include a 13th-month salary and performance bonuses.
Employees receive 15 days of annual leave and 3 days of sick leave per year.
Work-life balance with a 40-hour workweek from Monday to Friday.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Offshore

Technical Skills:

Kafka, AWS

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Hybrid

Salary:

Negotiation

Job ID:

J01556

Status:

Close

Related Job:

Senior/Middle QA Engineer

Ho Chi Minh - Viet Nam

Product

  • Automation Test
  • Playwright
  • Typescript
  • Selenium
  • Java

Develop and maintain automation test scripts using tools like Playwright with Typescript, Selenium with Java, and API service testing with Rest API using Playwright. Execute API performance testing scenarios using JMeter. Work with various technologies such as SQL, MongoDB, Atlast MongoBD, CI/CD Jenkins, Docker, AzureDevOps, and AWS for test automation. Store and maintain source code in GitHub for automation scripts. Participate in various meetings and product backlog reviews to understand test objectives and provide input on testability of requirements. Contribute to reducing manual testing efforts by increasing automation testing coverage and designing test cases and automation scripts. Collaborate with the project team to understand project objectives, gather automation requirements, design automated tests, and troubleshoot issues. Maintain and fix automation test scripts and report issues in the defect management system. Engage in manual testing where necessary. Participate in meetings and product backlog reviews to understand test objectives, provide input on testability of requirements, and estimate testing activities. Develop automation test scripts to reduce manual testing and increase automation testing coverage. Collaborate with the project team to understand project objectives, gather automation requirements, design automated tests, and troubleshoot issues. Maintain and fix automation test scripts, and report issues in the defect management system. Report defects/bugs in the defect tracking management tool. Coordinate with the Agile team to provide testing results for User Stories and approve them for the next environment.

Negotiation

View details

Senior Fullstack Engineer

Ho Chi Minh - Viet Nam

Product

  • Java
  • Angular
  • Microservices
  • AWS
  • Azure

Gain a deep understanding of the enterprise data landscape and establish data flow between operational systems for our micro-service approach. Implement high-performance, scalable, and testable components for our architecture. Incorporate modern architectural patterns and techniques (microservices, DDD, TDD) while using frameworks such as Spring Boot and Spring Cloud. Create modern frontend microservices and leverage the latest version of Angular for enriching DM Storybook. Develop RESTful APIs and microservices-based solutions utilizing container technologies such as AKS, Kubernetes, and Docker. Utilize AI coding tools to expedite development and explore AI-powered insurance solutions like claim processing and recommendation engines. Uphold high engineering standards with a focus on performance and scalability. Collaborate with architects, engineers, and project teams to ensure engineering principles are met and lead change. Write clean, maintainable, and well-documented code. Effectively communicate in English, both verbally and in writing. Employ rapid prototyping techniques to accelerate time-to-market for our customers. Keep abreast of new technologies through trend scouting.

Negotiation

View details

Senior Signal Processing Engineer

Others - Viet Nam

Outsource

  • Python

Enhance and optimize rPPG/TOI pipelines using RGB/IR video while compensating for motion and illumination. Incorporate multi-stage preprocessing, denoising, and quality scoring techniques such as adaptive filtering, ICA/PCA variations, color-space transformations, stabilization of skin regions of interest, and confidence metrics for signals. Develop strategies for normalizing data across different devices and creating estimators with controlled errors. Establish criteria for accepting biomarkers and identifying potential failures in consumer-grade data capture. Collaborate with iOS and machine learning teams to integrate algorithms into on-device or hybrid pipelines. Create technical documentation suitable for regulatory compliance and support Apple review processes. Produce benchmark reports that compare performance across different device models, skin tones, lighting conditions, and motion scenarios. Develop a specification sheet for biomarker features with recommended thresholds and confidence intervals. Present A/B test results demonstrating improvements in stability, data completeness, and downstream inference accuracy.

Negotiation

View details