EG

Staff AI & Data Engineer - Databricks

  • Eliassen Group
  • Remote · Denver, United States
  • Remote
  • Full-Time
  • $166,400 - 187,200 per year
  • Posted 13 days ago
Data & AI

Salary: $166,400 - 187,200 per year

Requirements:

  • Applicants must be willing and able to work on a W-2 basis.
  • Advanced hands-on expertise with Databricks, Apache Spark, Delta Lake, and SQL.
  • Hands-on experience with AWS data analytics and AI services, including EMR and Bedrock.
  • Strong Python and SQL development skills.
  • Experience building scalable batch and/or streaming data pipelines.
  • Deep knowledge of Bronze, Silver, and Gold medallion architectures.
  • Experience with Databricks Lakeflow or comparable orchestration tools.
  • Experience implementing enterprise data quality, lineage, observability, and monitoring.
  • Experience using Unity Catalog and working in governed enterprise data environments.
  • Strong understanding of dimensional modeling, data products, semantic models, and cross-domain integration.
  • Experience with Git-based development, CI/CD, automated testing, and production deployments.
  • Ability to troubleshoot complex distributed data and pipeline issues.
  • Experience building AI and GenAI solutions using enterprise data.
  • Understanding of semantic layers and natural-language-to-data architectures.
  • Experience with Databricks Genie or comparable natural-language analytics technology.
  • Experience building tools, functions, APIs, or services for AI agents.
  • Understanding of MCP, agent tool calling, tracing, evaluation, and AI governance.
  • Experience developing production AI solutions with security, observability, and governance controls.
  • Preferred: Databricks Data Engineer Professional certification or equivalent experience.
  • Preferred: Experience with Databricks AI/BI, Genie, MLflow, and MCP-based integrations.
  • Preferred: Experience in Real Estate, Finance, People/Workplace, Operations, or similar domains.
  • Preferred: Experience developing metadata-driven or configuration-driven ingestion frameworks.

Responsibilities:

  • Design and build production-grade data pipelines on Databricks.
  • Ingest data from enterprise applications, databases, APIs, SaaS platforms, files, and other sources.
  • Build and maintain Bronze, Silver, and Gold medallion architectures.
  • Apply incremental processing and change data capture patterns where appropriate.
  • Standardize types, codes, units, keys, and business definitions across source systems.
  • Implement deduplication, historical tracking, schema evolution, and data lineage.
  • Optimize pipelines for reliability, performance, scalability, and cost.
  • Develop a configuration-driven source onboarding framework and Lakeflow pipeline templates.
  • Automate source registration, deployment, monitoring, lineage, and operational controls.
  • Establish data quality expectations, anomaly detection, monitoring, and quarantine processes.
  • Set up job and pipeline monitoring, alerts, audit logging, and operational dashboards.
  • Support automated deployment and promotion through Databricks Asset Bundles and CI/CD.
  • Develop conformed dimensions and shared-key strategies across domains.
  • Create integrated Gold-layer products and reusable data contracts.
  • Build AI-ready Gold data products with ownership, lineage, definitions, and quality information.
  • Develop semantic context, business glossaries, ontologies, and certified KPIs in Unity Catalog.
  • Create governed Unity Catalog functions and agent-ready tools and endpoints.
  • Implement tracing, evaluation, testing, monitoring, and governance for AI and agent workflows.
  • Support development of AI agents that use trusted enterprise data.

Technologies:

  • AI
  • AI Agents
  • AWS
  • CI/CD
  • Databricks
  • Git
  • Support
  • MCP
  • MLflow
  • Python
  • SQL
  • Security
  • Spark
  • Unity
  • Cloud
  • GameDev

More:

We are recruiting a remote, hands-on Staff AI & Data Engineer to strengthen our clients Databricks platform and build enterprise data and AI capabilities, including trusted data products, cross-domain analytics, semantic layers, and agent-ready solutions. The W-2 hourly pay range is $80–$90; compensation considers skills, experience, and other relevant factors, and other employment options may have different pay arrangements. Eligible W-2 employees regularly scheduled for at least 30 hours per week may receive medical, dental, vision, pre-tax accounts, voluntary benefits including life and disability insurance, a 401(k) with company match, and sick time where required by law. We use AI tools in initial application screening and hiring, with AI-assisted evaluations and responses reviewed by human recruiters. Eliassen Group is a strategic consulting firm delivering technology, business advisory, and life sciences solutions. We value an inclusive team and make employment decisions based on merit, performance, and business needs. A $1,000 referral check may be available for eligible referrals we hire.

last updated 46 week of 2026

Apply on DevITjobs

You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Data & AI · United States

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

Staff AI & Data Engineer - Databricks at Eliassen Group — Remote · Denver, United States | Peter Nowak