About this opportunity
Lead Data Engineer (Databricks) | Hybrid | Grand Rapids, MI
Location: Grand Rapids, MI (Hybrid)
Employment Type: Contract / Full-Time
Certification: Databricks Certification preferred
Role Overview
We are seeking a Lead Data Engineer to architect, build, and operate scalable, secure, high-performance data lakehouse solutions on Databricks across Azure or AWS. This is a hands-on technical leadership role responsible for end-to-end platform design and delivery.
Key Responsibilities
- Design and implement enterprise-scale Databricks architectures using Medallion Architecture (Bronze, Silver, Gold)
- Develop ETL/ELT pipelines using SQL, PySpark, and Python
- Build incremental and streaming ingestion pipelines with Databricks Auto Loader
- Implement Delta Lake solutions for reliable, ACID-compliant storage and processing
- Integrate Databricks with Azure or AWS cloud services
- Optimize Apache Spark workloads, SQL queries, cluster configurations, and pipeline performance
- Establish data governance, security, and access control standards
- Provide technical leadership and architectural guidance to data engineering teams
- Support production deployments, troubleshooting, and performance tuning
Required Qualifications
- Strong experience with Databricks architecture and Lakehouse solutions
- Hands-on expertise in Medallion Architecture and Databricks Auto Loader
- Proficiency in SQL, PySpark, and Python
- Experience with Azure Databricks or AWS Databricks
- Solid understanding of Apache Spark, Delta Lake, and ETL/ELT design
- Proven experience in pipeline optimization and production-grade data engineering
- Knowledge of data governance, security, and scalable architecture design
- Strong communication, analytical, and problem-solving skills
Preferred Qualifications
- Databricks certification
- Experience with Unity Catalog and Delta Live Tables (Lakeflow Declarative Pipelines)
- Experience with CI/CD, Git, and infrastructure-as-code tools
- Background in cloud migration and enterprise data platform modernization
- Experience leading technical teams or defining data architecture standards
Contact
#Hiring #LeadDataEngineer #Databricks #DataEngineering #PySpark #DeltaLake #Lakehouse #AzureDatabricks #AWSDatabricks #GrandRapidsJobs #MichiganJobs #WestMichigan #HybridJobs #TechJobs
Interested in this role?
Review the details, then choose the resume you want to share.
Apply for this job Free for job seekers. Always.Share this job
Scan to open this jobEmployers make hiring decisions. Never pay someone to secure a job.
