Senior/Lead Data Engineer

ABOUT CLIENT

Our client is a global technology company that specializes in providing innovative IT solutions for the financial services industry

JOB DESCRIPTION

Implement technical infrastructure for compliance initiatives such as SOC 2 and GDPR, including building systems for a future data catalog and managing data access.
Design and develop scalable data pipelines for batch and event-driven data ingestion to facilitate real-time analytics and machine learning feature capabilities.
Establish foundational patterns for data quality monitoring, including automated freshness and integrity checks for critical data assets to enhance trust and reliability in the data.
Proactively lead the migration of analytical workloads from a shared production cluster to a scalable cloud data warehouse, such as Snowflake.

JOB REQUIREMENT

At least 7 years of experience in data engineering, emphasizing the construction and management of core data platforms.
Specialization in Modern Data Warehousing: Proven expertise in designing, constructing, and maintaining robust and scalable data warehouses such as Snowflake, BigQuery, or Redshift.
Proficiency in Event-Driven Architectures: Hands-on experience with real-time data processing technologies and patterns (e.g., Kafka, Kinesis, Flink, Spark Streaming).
Extensive Knowledge of Database Operations: Strong comprehension of database performance tuning, monitoring, disaster recovery, and the operational considerations of large-scale data systems.
Experience with Data Governance & Compliance: Hands-on involvement in creating technical solutions to meet compliance requirements like SOC 2 or GDPR, including data access controls and cataloging.
Pragmatic Problem-Solving Skills: Demonstrated ability to select appropriate solutions without over-engineering, while ensuring robustness in a startup environment. Proficiency in SQL and Python.
AWS Experience: Familiarity with core AWS services used in a platform context (RDS, S3, IAM, Kinesis, etc.). Experience using dbt (Data Build Tool) for data transformations in a production environment is highly desirable.
Infrastructure as Code Experience: Familiarity with tools such as Terraform for managing data infrastructure.
Experience in a Startup Environment: Comfortable working in an ambiguous and fast-paced setting.

WHAT'S ON OFFER

Generous salary package
Additional month's salary
Performance-based bonuses
Access to professional English training
Comprehensive health insurance
Ample annual leave opportunities

CONTACT

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666
We are PEGASI – IT Recruitment Consultancy in Vietnam. If you are looking for new opportunity for your career path, kindly visit our website www.pegasi.com.vn for your reference. Thank you!

Job Summary

Company Type:

Outsource

Technical Skills:

Data Engineering, Python, AWS

Location:

Ho Chi Minh, Ha Noi - Viet Nam

Working Policy:

Job ID:

J00685

Status:

Close

Related Job:

Data Platforms Team Leader

Ho Chi Minh - Viet Nam

Product

  • Data Engineering
  • Devops
  • AI

#Team Leadership and Management: Lead and mentor agile team of data platform and support engineers towards self-organization and empowerment Conduct performance reviews and provide professional development opportunities Present team achievements in internal and external events#Data Platform Administration & Support​: Install, configure, maintain and monitor data platforms, including databases, filesystems, and other related technologies​ Regularly update and patch systems to maintain security and stability​ Identify, diagnose, and resolve data platform problems in a timely manner​ Implement and maintain backup and recovery strategies for data platforms, ensuring data integrity and availability​ Inform, support and educate users of historical and new platform features and related processes#Continuous Improvement, Technical Excellence and Accountability: Ensure proper data platform design and platform features enabling AI/ML model training/serving, data management, data quality tracking Oversee the technical design aligned with company strategy and policies Follow, select and apply the latest technologies and best practices in platform code, management, and AI/ML area#Delivery Tracking: Ensure projects are delivered on time, within scope, in alignment with product owner and users' expectations, including non-functional requirements (performance, security, stability, observability, continuity) Manage expectations, risks and resolve issues that arise during platform lifecycle#Collaboration with Product Owner (s) and Development Team (s): Work closely with the Product Owners and Development Teams depending on platform features and performance to align platform roadmaps with their goals Provide platform-level feasibility assessments for new features and enhancements Ensure clear communication and coordination between the team, Product Owner (s) and Development Team (s)#Automation, code quality and documentation: Implement and maintain quality standards for platform code Ensure regular testing and validation are implemented as vital part of automated CI/CD#Data Governance and Compliance: Ensure data platform features comply with relevant data privacy and security regulations and policies Manage data access and usage to protect personal data and other sensitive information

Negotiation

View details

Senior AI Data Platform Engineer

Ho Chi Minh - Viet Nam

Product

  • Data Engineering
  • Devops
  • AI

#ML Data Platform Engineering & Administration Install, configure, and maintain ML data platforms on top of Kubernetes, Object Storage, Cassandra, Postgres and related technologies Monitor platform performance and optimize as needed for reliability and efficiency#Platform Configuration and Maintenance Implement and manage platform configurations, ensuring adherence to best practices and security standards Regularly update and patch systems to maintain security and stability#Collaborate with Cross-Functional Teams Work closely with ML and data engineers and other roles to align IT needs and strategies Provide expert guidance on ML data platform best practices and optimization#Troubleshoot and Resolve Technical Issues Identify, diagnose, and resolve data platform problems in a timely manner Escalate complex issues to upper-level support when necessary#Backup and Recovery Management Implement and maintain backup and recovery strategies for data platforms, ensuring data integrity and availability#Maintain and Update Documentation Create and maintain documentation related to data platform administration, configuration, and maintenance Share knowledge with team members and contribute to a culture of continuous learning#Enhance Data Security and Compliance Ensure data platforms adhere to security best practices and comply with relevant regulations Stay up-to-date on industry trends and evolving security standards#Drive Continuous Improvement Evaluate and implement new technologies and techniques to enhance data platform performance and administration Proactively identify areas for improvement, prepare plan for implementation and get support from management and development teams Always prefer automation and code-first approach over hard to reproduce manual tasks

Negotiation

View details

Senior IT Infrastructure Engineer

Ho Chi Minh - Viet Nam

Product

  • System
  • IT inhouse

Plan, design, and build enterprise hardware systems such as PDC, DRC, evaluating and selecting the best options to meet the organization's needs. Operate, maintain, and upgrade VMWare, OpenStack environments, backup software and libraries. Maintain, plan, deploy and protect the infrastructure environment server hardware and firmware, consolidating and improving system components such as virtualization, backup servers, SAN, Hardware security module, rack, and storage systems mainly in PDC, DRC to meet the organization's current and future requirements. Participate in IT projects, providing technical expertise and guidance for infrastructurerelated components. Ensure information security by understanding key security objectives such as confidentiality, integrity, and availability, and implementing appropriate measures in the infrastructure environment, fulfill the requirements of internal and external audits. Design converged SAN architecture and maintain SAN devices such as switches and storage, upgrading firmware when needed. Perform capacity planning for free space, performance, and usage, and proactively monitor systems to identify and address performance issues. Manage and monitor data center systems such as fire alarm and air conditioning, and plan server room layout and cabling. Test all changes to SAN networks, hardware, and software to ensure smooth implementation and operation. Document issues and resolutions and prepare status reports and reviews for management. Foster a strong collaborative relationship with Vendor ( Hardware & Storage Team, Virtualization team, Backup Team), seamlessly merging the efforts into a harmonious and unified team. Hold primary accountability for maintaining the smooth operation and availability of the datacenter, in strict adherence to SLA requirements. Prioritize swift resolution of any emerging issues to minimize downtime.

Negotiation

View details