PySpark Data Engineer

Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Role Overview

Seeking a PySpark Data Engineer with at least 2 years of hands‑on experience in developing scalable data pipelines, ETL processes, and big data solutions using PySpark and Python. The ideal candidate will have experience working with large datasets, distributed data processing frameworks, and modern cloud‑based data platforms.

Key Responsibilities

• Develop and maintain ETL/ELT pipelines using PySpark.
• Build and optimize data processing workflows for large‑scale datasets.
• Implement data transformation, validation, and cleansing logic.
• Write efficient Spark SQL and Python code for data engineering solutions.
• Troubleshoot and optimize Spark jobs for perfor...