Senior Data Engineer

JOB DESCRIPTION

In this role, you will work with Data Analyst to create data models. You will develop ETL pipelines, perform validations and testing. You will partner closely with our clients on a wide variety of collaborative and innovative engagements.
One should be a phenomenal teammate with a forward-thinking mindset, ability and confidence to challenge the status quo to define future visions
Work with Data analyst to create data models
Implement ETL pipelines using AWS Glue from data extraction, data uploading, data formatting and data loading
Implement complex data transformations using Python or Scala and implement unit testing
Verify data transformation using AWS Athena
Implement data loading into Oracle database and verify
Ensure best possible performance and quality of transformed/loaded data

JOB REQUIREMENT

Primary Skills:
Proficiency in programming languages such as Python or Scala
Solid experience with ETL tools, database management systems and data integration techniques
Proficient in database query languages such as SQL and NoSQL
Secondary Skills:
Scripting languages
AWS Platforms: Glue (Console, Studio, Crawler, Job, Data Catalog, DataBrew), Athena
Insurance or banking domain
 
BS/MS degree in Computer Science, Engineering or a related subject
Good English communication is a must
Minimum 2+ years of relevant experience primarily in ETL development, data analysis and modelling
Experience working in an agile team, practicing Scrum, Kanban
Good communication skills, interpersonal and teamworking skills
Pro-active and flexible working approach
Knowledge of the business domains is a plus: Insurance (Life/Non-life), Banking
Team-player with experience working with international and multi-functional teams
Self-development skills to keep up to date with fast-changing trends

WHAT'S ON OFFER

Competitive salary, health insurance covered for employee and dependents
Working on international projects. Professional and dynamic working environment
Achieving valuable experience with variety projects, new technologies and hundreds of talents
Receiving training opportunities including many technical seminars and soft skill training courses
Good opportunity for promotion through regular performance review system

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data, Data Analyst, ETL/ELT, Data Engineering

Location:

Ho Chi Minh - Viet Nam

Working Policy:

Job ID:

J01506

Status:

Close

Related Job:

Data Platforms Team Leader

Ho Chi Minh - Viet Nam


Product

  • Data Engineering
  • Devops
  • AI

#Team Leadership and Management: Lead and mentor agile team of data platform and support engineers towards self-organization and empowerment Conduct performance reviews and provide professional development opportunities Present team achievements in internal and external events#Data Platform Administration & Support​: Install, configure, maintain and monitor data platforms, including databases, filesystems, and other related technologies​ Regularly update and patch systems to maintain security and stability​ Identify, diagnose, and resolve data platform problems in a timely manner​ Implement and maintain backup and recovery strategies for data platforms, ensuring data integrity and availability​ Inform, support and educate users of historical and new platform features and related processes#Continuous Improvement, Technical Excellence and Accountability: Ensure proper data platform design and platform features enabling AI/ML model training/serving, data management, data quality tracking Oversee the technical design aligned with company strategy and policies Follow, select and apply the latest technologies and best practices in platform code, management, and AI/ML area#Delivery Tracking: Ensure projects are delivered on time, within scope, in alignment with product owner and users' expectations, including non-functional requirements (performance, security, stability, observability, continuity) Manage expectations, risks and resolve issues that arise during platform lifecycle#Collaboration with Product Owner (s) and Development Team (s): Work closely with the Product Owners and Development Teams depending on platform features and performance to align platform roadmaps with their goals Provide platform-level feasibility assessments for new features and enhancements Ensure clear communication and coordination between the team, Product Owner (s) and Development Team (s)#Automation, code quality and documentation: Implement and maintain quality standards for platform code Ensure regular testing and validation are implemented as vital part of automated CI/CD#Data Governance and Compliance: Ensure data platform features comply with relevant data privacy and security regulations and policies Manage data access and usage to protect personal data and other sensitive information

Negotiation

View details

Senior AI Data Platform Engineer

Ho Chi Minh - Viet Nam


Product

  • Data Engineering
  • Devops
  • AI

#ML Data Platform Engineering & Administration Install, configure, and maintain ML data platforms on top of Kubernetes, Object Storage, Cassandra, Postgres and related technologies Monitor platform performance and optimize as needed for reliability and efficiency#Platform Configuration and Maintenance Implement and manage platform configurations, ensuring adherence to best practices and security standards Regularly update and patch systems to maintain security and stability#Collaborate with Cross-Functional Teams Work closely with ML and data engineers and other roles to align IT needs and strategies Provide expert guidance on ML data platform best practices and optimization#Troubleshoot and Resolve Technical Issues Identify, diagnose, and resolve data platform problems in a timely manner Escalate complex issues to upper-level support when necessary#Backup and Recovery Management Implement and maintain backup and recovery strategies for data platforms, ensuring data integrity and availability#Maintain and Update Documentation Create and maintain documentation related to data platform administration, configuration, and maintenance Share knowledge with team members and contribute to a culture of continuous learning#Enhance Data Security and Compliance Ensure data platforms adhere to security best practices and comply with relevant regulations Stay up-to-date on industry trends and evolving security standards#Drive Continuous Improvement Evaluate and implement new technologies and techniques to enhance data platform performance and administration Proactively identify areas for improvement, prepare plan for implementation and get support from management and development teams Always prefer automation and code-first approach over hard to reproduce manual tasks

Negotiation

View details

Senior IT Infrastructure Engineer

Ho Chi Minh - Viet Nam


Product

  • System
  • IT inhouse

Plan, design, and build enterprise hardware systems such as PDC, DRC, evaluating and selecting the best options to meet the organization's needs. Operate, maintain, and upgrade VMWare, OpenStack environments, backup software and libraries. Maintain, plan, deploy and protect the infrastructure environment server hardware and firmware, consolidating and improving system components such as virtualization, backup servers, SAN, Hardware security module, rack, and storage systems mainly in PDC, DRC to meet the organization's current and future requirements. Participate in IT projects, providing technical expertise and guidance for infrastructurerelated components. Ensure information security by understanding key security objectives such as confidentiality, integrity, and availability, and implementing appropriate measures in the infrastructure environment, fulfill the requirements of internal and external audits. Design converged SAN architecture and maintain SAN devices such as switches and storage, upgrading firmware when needed. Perform capacity planning for free space, performance, and usage, and proactively monitor systems to identify and address performance issues. Manage and monitor data center systems such as fire alarm and air conditioning, and plan server room layout and cabling. Test all changes to SAN networks, hardware, and software to ensure smooth implementation and operation. Document issues and resolutions and prepare status reports and reviews for management. Foster a strong collaborative relationship with Vendor ( Hardware & Storage Team, Virtualization team, Backup Team), seamlessly merging the efforts into a harmonious and unified team. Hold primary accountability for maintaining the smooth operation and availability of the datacenter, in strict adherence to SLA requirements. Prioritize swift resolution of any emerging issues to minimize downtime.

Negotiation

View details