Salary: $120,000 - 160,000 per year
Requirements:
- 10+ years of significant experience designing, building, and operating distributed systems or cloud-native backend infrastructure in production.
- Strong working knowledge of Kubernetes and distributed-systems patterns, including control loops, API servers, and high-scale control planes, as well as containerization, networking, and resource isolation.
- Proficiency in at least one of Go, Java, or Python, and willingness to work across all three.
- Demonstrated ability to lead cross-team technical work and turn ambiguous requirements into designs others can support.
- Excellent written and verbal communication skills, including the ability to write design documents that align stakeholders outside your reporting line.
- Preferred: Exposure to model serving, LLM or agent infrastructure, or streaming data systems. A background in ML research or model training is not required.
- Must be able to work without current or future visa sponsorship; we will not provide visa sponsorship for this position.
Responsibilities:
- Design and build backend services, primarily in Go, Java, and Python, for running AI and model inference on real-time data.
- Own product features from design through delivery, align stakeholders inside and outside the team, and drive decisions to resolution.
- Make technical decisions across systems and teams involving model lifecycle, inference routing, and agent execution.
- Ensure the quality of delivered work, including code, test coverage, documentation, operability, and safe rollouts.
- Improve the team through code reviews, design feedback, and leadership on ambiguous, cross-cutting work.
- Participate in on-call for the services our team owns and help maintain healthy team processes and rituals.
Technologies:
- AI
- API
- Backend
- Cloud
- IBM
- Support
- Java
- Kubernetes
- LESS
- LLM
- Model Serving
- Model Training
- Python
- AI Agents
More:
At IBM Software, we build AI-powered, cloud-native products that help address client challenges and support digital transformation. Youll join a curious, collaborative team working across technologies, partners, and industries, with opportunities to learn and grow while contributing to IBMs product and technology landscape. In this role, youll help build Confluent Clouds AI capabilities, enabling customers to use AI and agents directly with real-time streaming data on the platform they already use. The work spans APIs, model and agent lifecycle services, control-plane scheduling, and inference serving. We offer eligible employees healthcare coverage, financial programs, paid time off and leave, learning resources, employee resource groups, volunteer opportunities, and discounts. Compensation varies according to job-related skills, experience, and location; benefits may be adjusted for part-time schedules or employees starting during the calendar year. We consider qualified applicants with criminal histories in accordance with applicable law. The posting is expected to remain open for up to 21 days from its publication date, or less if the role is filled.
last updated 47 week of 2026
You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.
