Data Engineer

Job Description: Role Purpose: The Data Engineer is responsible for the plumbing of the Ray of Light project. You will build and maintain the pipelines that move raw material data from source systems into Snowflake, ensuring the data is clean, structured, and ready for either automated agents or rule-based logic. Key Responsibilities: Pipeline Development: Design and implement scalable ETL/ELT pipelines using Azure Data Factory (ADF) to ingest supply chain data. Snowflake Modeling: Architecture of schemas within Snowflake that support high-frequency querying for real-time alerts (Late POs, Inventory levels). Data Transformation: Utilize SQL and dbt (or similar) to transform raw data into gold layer tables that the Business Analyst and AI Engineers can rely on. Performance Tuning: Optimize Snowflake compute usage and query performance to ensure Inventory Alerts trigger without latency. Collaboration: Work with the Data SME to understand source system nuances and ensure data integrity fo...