Salary: $65,000 - 102,000 per year
Requirements:
- Strong hands-on Python experience in platform, automation, or infrastructure-heavy environments
- Experience building CLI tools with Python, Golang, or Rust
- Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines
- Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement
- Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows
- Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems
- Strong skills in metrics, tracing, dashboards, alerting, and log analysis
- Experience with ingestion, ETL, or content-processing pipelines at scale
- Ability to consider reliability, cost, latency, throughput, and disaster recovery
- Nice to have: experience with Qdrant, Neo4j, or other vector or graph infrastructure
- Nice to have: prior experience supporting RAG, search, evaluation, or agent platforms
- Nice to have: background in enterprise or highly regulated environments
- Nice to have: familiarity with enterprise tools such as Vault, Splunk, Artifactory, or ECR
- Nice to have: comfort using AI-assisted engineering workflows in day-to-day work
Responsibilities:
- Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg
- Make design trade-offs among retrieval quality, latency, cost, safety, and operational simplicity
- Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls
- Improve answer grounding, failure analysis, and citation enforcement to support enterprise-grade dependability
- Create observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions
- Develop ingestion infrastructure for current and future content sources
- Establish observability across application, pipeline, database, and model-serving behavior
- Manage cost, latency, throughput, and failure modes for AI-heavy workloads
- Build release workflows that validate changes to AI behavior, not just code compilation
- Partner with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform
Technologies:
- AI
- Architect
- Backend
- Confluence
- Docker
- ETL
- FastAPI
- GitHub
- Golang
- Grafana
- Helm
- Support
- Kubernetes
- LLM
- Neo4J
- OpenTelemetry
- Prometheus
- Python
- RAG
- Rust
- Splunk
More:
We are hiring a Python AI Engineer to operate and evolve the infrastructure behind our enterprise knowledge base platform. The platform currently supports Confluence and GitHub ingestion, chunking, pgvector, RAG retrieval, and FastAPI serving. As we grow, we are expanding toward hybrid retrieval combining vector, sparse, and graph methods; ingestion from multiple sources; robust evaluation pipelines; agent infrastructure; and shared chat platform components. We are focused on scalable, reliable, production-grade AI infrastructure rather than demo-only behavior.
last updated 46 week of 2026
You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
