Senior DevOps (Data Platform)

JOB DESCRIPTION

An accomplished is desired to become a member of our dynamic team. The optimal candidate should have substantial knowledge and experience managing workloads on EC2 clusters using DataBricks (EMR or an equivalent level of experience will suffice), ensuring connectivity and data availability via Data Mesh, implementing least privileged access across AWS accounts and Databricks data platform, and operating distributed engines such as Spark. Furthermore, storage technologies, data orchestration, and CI/CD pipeline, and operational experience with Spark and other data warehousing tools are prerequisites for success in this position.
Manage, capacity plan, and operate workloads utilizing EC2 clusters via DataBricks/EMR to ensure efficient and reliable data processing
Collaborate with stakeholders to design and implement a Data Mesh architecture across multiple closely related but separate enterprise entities
Utilize Infrastructure as Code (IaC) tools such as CloudFormation or Terraform to define and manage data platform user access to data and compute resources.
Implement role-based access control (RBAC) mechanisms using IaC templates to enforce least privilege principles and ensure secure access to data and compute resources
Collaborate with cross-functional teams to design, implement, and optimize data pipelines and workflows
Utilize distributed engines such as Spark to process and analyze large volumes of data efficiently when required
Develop and maintain operational best practices for Spark and other data warehousing tools to ensure system stability and performance
Implement and manage storage technologies to efficiently store and retrieve data as per business requirements
Troubleshoot and resolve platform-related issues in a timely manner to minimize downtime and disruptions
Stay updated on emerging technologies and industry trends to continuously enhance the data platform infrastructure
Document processes, configurations, and changes to ensure comprehensive system documentation.

JOB REQUIREMENT

Knowledge of one or more of the following: AWS CloudFormation and Terraform for infrastructure provisioning
Knowledge of the source control and its related concepts (Gitlab/Git flow, Trunk-based, branches, etc.).
Familiarity with at least one programming language (Python, Bash, etc.).
Familiarity with a distributed compute engine such as Spark
Familiarity with a data platform or data orchestration tool such as Databricks/Airflow
Equipped with in-depth working knowledge and experience in using AWS IAM, VPC, EC2, RDS, DynamoDB, DMS, and S3
Experience with CI/CD tools (such as Jenkins, TeamCity, AWS CodePipeline, CodeDeploy) or configuration management tools (such as Ansible, Chef, Puppet..)
DevOps mindset with automation and operational excellence in mind
Good skills in English and the ability to communicate effectively with business and technical teams
Demonstrate good logical thinking and problem-solving skills
Be curious and have a self-learning attitude
Big Plus:
AWS Data Engineer Associate or DevOps Professional Certifications
You are:
Passionate about technology
Independent but also a team player
Comfortable with a high degree of ambiguity
Focused on usability and speed
Keen on presenting your ideas to your peers and management.

WHAT'S ON OFFER

Meal and parking allowances are covered by the company.
Full benefits and salary rank during probation.
Insurances such as Vietnamese labor law and premium health care for you and your family.
SMART goals and clear career opportunities (technical seminar, conference, and career talk) - we focus on your development.
Values-driven, international working environment, and agile culture.
Overseas travel opportunities for training and work-related.
Internal Hackathons and company events (team building, coffee run, etc.).
Pro-Rate and performance bonus.
15-day annual + 3-day sick leave per year from the company.
Work-life balance 40-hr per week from Mon to Fri.

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Digital Bank, Product

Technical Skills:

Devops, Spark

Location:

Ho Chi Minh - Viet Nam

Salary:

Negotiation

Job ID:

J01916

Status:

Active

Related Job:

Senior Machine Learning Engineer

Ho Chi Minh, Ha Noi - Viet Nam

Information Technology & Services

  • Machine Learning

Negotiation

View details

Senior Bridge Software Engineer (Japanese N2)

Ho Chi Minh, Ha Noi - Viet Nam

No.1 Construction Tech company in Japan

  • BSE/BrSE

#The OpportunityWe are seeking a Bridge System Engineer (BrSE) to serve as a vital link between our development teams in Vietnam and Japan. You will play a key role in driving the digital transformation of the construction industry, including the potential to work on AI-related projects and products. By ensuring seamless communication and project delivery, you will contribute to our business growth. Working within a dynamic squad model and small agile teams, you will be involved in every stage of the project lifecycle, from design to deployment and beyond. This is an excellent opportunity to apply your skills with modern technologies and frameworks in a fast-paced, international environment.#Job Scope #Project Management & Client Coordination Serve as the key liaison between Japanese clients and our Vietnam development teams. Conduct detailed briefings with the Japan team to clarify project requirements and objectives. Manage client relationships and expectations, ensuring project alignment and satisfaction. Track project performance and ensure all projects are delivered on time and within scope. #Development Team Support Lead the definition of project scope, objectives, and technical feasibility. Delegate project tasks to team members based on their skills and expertise. Conduct risk management to proactively identify and mitigate potential project risks. Manage changes to project scope, schedules, and costs. Create and maintain comprehensive project documentation #Development Environment Backend: Ruby on Rails, Go, AWS, Elasticsearch, MySQL, DynamoDB, Redis, Terraform (IaC), OIDC (Authentication). Frontend: Next.js/React.js, Typescript, Vue.js/Nuxt.js. Mobile App: Kotlin, Swift, Flutter. CI/CD & DevOps: Docker, Kubernetes, CodePipeline, CodeBuild, CircleCI, GitHub Actions. Monitoring & Tools: Datadog, Sentry, Bugsnag, Swagger, ZenHub, Figma

Negotiation

View details

Senior Java Software Engineer (Spring, Azure)

Ho Chi Minh - Viet Nam

Product, Start up studio

  • Java
  • Devops
  • Spring
  • Azure
  • Microservices

Perform hands-on coding and code review as other peer developers as needed Understand the requirements of the customer or business and utilize this knowledge to develop applications that are consistent with this; Design, develop, review, implement, maintain and manage continuous integration, build management and deployment scripts, systems, and any code as required; Participate in Agile/Scrum activities: daily standup, demo session, retrospective, estimate, and planning, etc Provide mentoring/training for junior members if any Perform other tasks assigned by the Line Manager

Negotiation

View details