Databricks Engineer with AI / ML

iLink Digital • Canada, KY

13h

About The Position

We are seeking a highly skilled Databricks Engineer with AI/ML experience to design, build, and optimize scalable data and machine learning platforms on Databricks. The role involves end -to -end ownership of data pipelines, ML workflows, and production AI systems.

Requirements

• 5+ years of Databricks & Apache Spark
• Strong Python & PySpark
• Experience with Delta Lake & Lakehouse
• MLflow & MLOps experience
• Cloud platform (AWS/Azure/GCP)
• Git & CI/CD

Nice To Haves

• Experience with LLMs & Generative AI
• RAG pipelines & Vector Databases
• Deep Learning frameworks
• Databricks certifications
• Power BI integration

Responsibilities

• Design and implement scalable ETL pipelines using Databricks & Spark
• Build Lakehouse architecture using Delta Lake
• Develop and deploy ML models using MLflow
• Implement MLOps pipelines for training, testing, and serving models
• Optimize cluster performance and reduce compute cost
• Build RAG and LLM -based solutions using Mosaic AI
• Integrate analytics with BI tools (Power BI, Tableau)
• Implement data governance using Unity Catalog
• Collaborate with Data Scientists and Business teams
• Ensure data quality, security, and compliance

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed