Job Description
We are looking for a Senior AI Engineer with Databricks expertise to design, deploy and maintain scalable machine learning pipelines using the Databricks platform. In this role, you will deliver production-ready ML pipelines, automated training and retraining workflows, deployed models, monitoring dashboards and CI/CD pipelines for ML systems.
Responsibilities
Design, implement and maintain end-to-end ML pipelines on DatabricksBuild workflows for data ingestion, preprocessing, feature engineering, training and inferenceLeverage PySpark, Spark ML and Databricks notebooks/jobsManage model versioning, experiment tracking and reproducibility using MLflowPackage and deploy models for batch and real-time inferenceMonitor model performance, drift and retraining cyclesDevelop scalable ETL/ELT pipelines using Databricks Delta LakeOptimize data storage and access patterns through partitioning, Z-ordering and caching
Ready to Apply?
Submit your application for Senior AI Engineer with Databricks at Epam
Apply Now