Salary: $140,000 - 210,000 per year
Requirements:
- Bachelors degree in Computer Science, Information Systems, Software Engineering, or a related technical field.
- Seven or more years of progressive experience in data architecture, software engineering, or technical delivery, including at least two years architecting or scaling AI- or LLM-assisted engineering workflows.
- Expert proficiency in Python, PySpark, and SQL.
- Hands-on experience designing repository instructions, system prompts, guardrails, and context windows for Claude Code, GitHub Copilot, or similar agentic coding tools.
- Demonstrated experience designing scalable Databricks architectures in AWS or Azure environments.
- Strong background building CI/CD pipelines with automated testing, linting, and data reconciliation, using tools such as GitHub Actions, GitLab CI, or Azure DevOps.
- Strong communication skills and the ability to explain AI governance, architecture patterns, and productivity metrics to executive stakeholders and technical teams.
- Databricks certification in Data Engineering Professional, Solutions Architect, or Machine Learning Professional is strongly preferred.
- Experience building migration pipelines from legacy data platforms such as Netezza, Teradata, Oracle, Informatica, or SSIS to Databricks Lakehouse is preferred.
- Working knowledge of FinOps and token or compute cost attribution for large-scale AI workloads is preferred.
Responsibilities:
- Design, build, operate, and continuously improve our enterprise AI Factory to support legacy-code modernization and automated data engineering.
- Create system prompts, project instructions, rule sets, and operational safeguards for Claude Code and other AI coding agents.
- Develop and maintain modular conversion templates for technical patterns, such as legacy ETL or SQL to PySpark and on-premises warehouse models to lakehouse architectures.
- Build automated validation and reconciliation frameworks to verify data integrity, schema consistency, and business-logic parity between legacy implementations and AI-generated code.
- Integrate static analysis, linting, and architecture-pattern checks into CI/CD pipelines to detect regressions, drift, and anti-patterns before deployment.
- Write production-quality Python, PySpark, and advanced SQL for data pipelines, lakehouse architectures, and distributed computing.
- Design and optimize Databricks lakehouse solutions for performance, security, and cost efficiency.
- Establish governance policies, risk controls, and quality gates for code generation, data security, intellectual property protection, and prompt management.
- Define, track, and report measures of engineering acceleration, developer velocity, cycle-time reduction, defect rates, and return on investment.
- Coach technical leads, data engineers, and consulting delivery teams as they adopt AI-assisted development tools.
Technologies:
- Agentic AI
- AI
- AWS
- Architect
- Azure
- CI/CD
- Claude Code
- Cloud
- Copilot
- Databricks
- DevOps
- ETL
- GitHub
- GitLab
- Informatica
- Support
- LLM
- Machine Learning
- Oracle
- Python
- PySpark
- SQL
- Security
- SSIS
- Windows
More:
We are Infinitive, a data and AI consultancy helping clients modernize, monetize, and operationalize data. We combine industry and technology expertise with teams matched to client cultures. We have been recognized by Consulting Magazine, The Washington Post, the Washington Business Journal, and Virginia Business as a top workplace. We are seeking a hands-on AI Architect to guide our AI Factory and connect modern cloud data architectures with generative and agentic AI tools, accelerating software delivery, data platform modernization, and code migration. The estimated U.S. compensation range is $140,000–$210,000, with individual compensation determined by factors including skills, experience, training, and credentials. We are an equal opportunity employer and consider qualified applicants without regard to legally protected characteristics.
last updated 46 week of 2026
You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
