Solution Architect (Data)

Design, maintain, and enhance analytical and operational services, including data lakes, databases, pipelines, and metadata repositories, ensuring timely and accurate delivery of insights.

Work closely with data science teams to define and implement data schemas and models, integrate new data sources with product teams, and collaborate with data engineers to adopt emerging technologies in the data domain.

Develop and improve large-scale batch and real-time data processing systems to support business expansion and performance enhancement initiatives.

Leverage tools like Apache Airflow and AWS Batch for efficient workflow scheduling, monitoring, and data management.

Implement robust testing strategies to guarantee the accuracy, reliability, and usability of data processing systems.Stay up to date with emerging technologies and industry best practices, identifying and implementing strategic optimizations to improve development efficiency.

Strong understanding of the principles and architectural design of distributed computing.

Extensive experience in ETL/ELT pipeline development, ensuring efficient data transformation and processing.

Proficiency in Hadoop/Spark performance tuning to enhance system efficiency.

Strong Python proficiency, with expertise in PySpark, Pandas, NumPy/SciPy, and Polars for data processing.

Experience working with version control systems, such as Git.

Hands-on experience with big data and columnar databases, including Athena, Redshift, Vertica, and Hive/Hadoop.

Familiarity with AWS and other cloud technologies, including Glue, EMR, EC2, S3, Lambda, and more.

Expertise in Docker, ECS, Kubernetes, and container management strategies.

Knowledge of CI/CD tools, including Jenkins, CircleCI, and AWS CodePipeline.

Familiarity with Java or Scala (JVM-based languages).

Experience with RDBMS (MySQL, PostgreSQL) and NoSQL databases (DynamoDB, Redis).

Exposure to enterprise-level BI platforms, such as Tableau, Looker, and PowerBI.

Understanding of cloud-based data science platforms, including AWS SageMaker and Databricks.

Experience with log ingestion and monitoring tools like ELK Stack, Datadog, and similar frameworks.

Strong grasp of data security principles, compliance, and privacy best practices.

Familiarity with event-driven architectures and message queuing technologies.

Generous salary package

Additional month's salary

Performance-based bonuses

Access to professional English training

Comprehensive health insurance

Ample annual leave opportunities

PEGASI – IT Recruitment Consultancy | Email: recruit@pegasi.com.vn | Tel: +84 28 3622 8666