CB

AI Developer

  • Cobalt Benefits Group LLC
  • Boston, United States
  • On-site
  • Full-Time
  • $68,000 - 108,000 per year
  • Posted yesterday
Data & AI

Salary: $68,000 - 108,000 per year

Requirements:

  • Bachelors degree in Computer Science, Information Systems, or a related field, or equivalent practical experience, plus at least three years of professional software development experience.
  • Hands-on experience developing and evaluating generative AI solutions, including RAG, context engineering, tool or function calling, and at least one production or production-pilot solution.
  • Strong Python and/or C#/.NET skills, with experience building production APIs, integrating REST services, using OAuth or similar authorization, and securely managing secrets and configuration.
  • Ability to review, test, debug, and maintain AI-generated code; working knowledge of SQL, data modeling, and data pipelines.
  • Experience working with HIPAA-regulated information, PHI masking, and access controls.
  • Experience with AI regression testing, monitoring, model version management, release controls, cost optimization, and guarded multi-step agents.
  • Ability to document technical decisions, follow governance and change control, lead business requirements sessions, and recommend pausing or stopping solutions that do not meet evaluation thresholds.
  • Preferred: Experience with Microsoft Copilot Studio, Power Automate, Power Platform, Azure OpenAI, and Azure AI Search.
  • Preferred: Demonstrated improvement of retrieval or extraction systems supported by before-and-after evaluation results.
  • Preferred: Experience with AI coding agents and Model Context Protocol (MCP).
  • Preferred: Familiarity with healthcare, third-party administration, employee benefits, claims, eligibility, plan documents, or EDI.
  • Collaborative communicator who can translate business processes into technical requirements and work across business, engineering, security, and compliance teams.
  • Analytical, detail-oriented problem solver who values measurable quality, documentation, and continuous improvement.
  • Sound judgment and accountability in privacy, fairness, human oversight, and responsible AI delivery.
  • Adaptable, hands-on builder comfortable choosing between low-code and custom engineering approaches.

Responsibilities:

  • Design, prototype, build, test, and deploy AI applications and agents for production, selecting suitable Copilot Studio, workflow, agent, custom-service, vendor, or non-AI approaches in accordance with Build-vs-Buy guidance.
  • Develop RAG solutions, including document ingestion, chunking, indexing, metadata management, retrieval tuning, and grounded responses with source citations.
  • Integrate internal and third-party systems through authenticated REST and GraphQL APIs, and collaborate on data pipelines for documents and structured data.
  • Work with IT Security to apply least-privilege permissions, single sign-on, secrets management, PHI/PII safeguards, output validation, and appropriate logging and retention controls.
  • Build evaluation harnesses using golden test sets, subject-matter expert rubrics, and production sampling; monitor accuracy, citation support, completeness, latency, and transaction costs, including results by plan type.
  • Implement telemetry for prompts, retrieval, tool calls, and outputs; maintain runbooks, hand-off documentation, cost controls, and operational monitoring.
  • Advance solutions through CBG AI Solution Delivery Playbook decision gates and prepare required artifacts, including risk assessments, requirements, evaluation plans, and transition documentation.
  • Partner as appropriate with the AI Risk Manager, Compliance, Data Protection Officer, Security, and AI Ethics Committee; share reusable components, templates, and approved prompt patterns.
  • During the first 90 days, complete AI governance onboarding, deliver an enhancement through Production Readiness Review, and establish a golden-test-set evaluation harness.
  • Within six months, release a new approved AI solution, publish reusable components adopted by another project, and enable monitoring dashboards.
  • Within 12 months, meet approved business KPIs, demonstrate reusable delivery patterns, and keep inventory, risk classification, evaluation, and monitoring records current.

Technologies:

  • AI
  • API
  • Azure
  • C#
  • CI/CD
  • Copilot
  • Cosmos DB
  • DevOps
  • GitHub
  • GraphQL
  • Support
  • MCP
  • Microsoft 365
  • OWASP
  • OAuth
  • Python
  • RAG
  • REST
  • SQL
  • Security
  • Office 365
  • ASP.NET
  • Cloud

More:

We are Cobalt Benefits Group (CBG), a healthcare third-party administrator specializing in self-funded benefit plans. Recognized as one of the Best Companies to Work for in NH 2026 by NH Business Magazine, we have more than 30 years of experience and a team of over 300 employees. Through our four lines of business, we create customized health plans, manage claims and disputes, and administer programs including FSAs, HSAs, COBRA, and retiree billing. In this hands-on AI Developer role, you will work with business owners, DevOps, IT Security, Compliance, and AI governance stakeholders to deliver secure, governed AI solutions that support operational efficiency and member experience. Our technology environment includes Microsoft 365 Copilot, Copilot Studio, Power Automate, Power Apps, Teams, Azure OpenAI/Azure AI Foundry, Azure AI Search, Azure API Management, Entra ID, Key Vault, Azure SQL, Cosmos DB, Azure Data Lake Storage, Blob Storage, Dataverse, GitHub, and CI/CD pipelines; technologies vary by project and risk tier. Our solutions follow CBG governance and security requirements, with privacy, security, and human oversight proportionate to risk, and align with HIPAA, HITRUST CSF, the NIST AI Risk Management Framework, and applicable OWASP guidance. Automated claim denials without human review and use of PHI in public generative AI models are prohibited. Eligible full-time employees can access a benefits package after the applicable waiting period, including medical, dental, and vision insurance; employer HSA contributions; company-provided life and AD&D insurance; paid short- and long-term disability; flexible spending accounts; a 401(k) with up to a 6% employer match; paid holidays; paid half-day Summer Fridays; vacation and sick time; a volunteer day; tuition and wellness reimbursements; and company events. We are an Equal Employment Opportunity employer and participate in E-Verify.

last updated 47 week of 2026

Apply on DevITjobs

You apply on DevITjobs, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Data & AI · United States

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

AI Developer at Cobalt Benefits Group LLC — Boston, United States | Rivet Commerce job board