Data Bricks & Spark Engineering Expert Vancouver

Drive innovation in data engineering with VLink as a Senior Engineering Expert in Montreal. You will oversee the migration of regulatory report pipelines to Databricks using Scala and Spark.

This onsite position calls for a hands‑on approach to redesign and implement ETL processes in a up‑to‑date cloud‑based system. Candidates must be adept in managing complex data frameworks within Azure, utilizing tools such as Snowflake and Airflow for orchestration, and ensuring data integrity across migrations.

Key Responsibilities

• Implement and test regulatory reporting pipelines on Databricks
• Develop robust Spark applications using Scala
• Analyze and extract requirements from complex SQL queries
• Design data quality frameworks for consistency and accuracy
• Execute CI/CD pipelines for effective deployment

Requirements

• Extensive experience with Databricks and Spark
• Proficient in SQL and data ana...