RP

Senior Backend Engineer | AI Inference Platform & Distributed Systems

  • Randstad Pte. Limited
  • Singapore
  • On-site
  • Permanent, Full Time
  • SGD 8k–15k / month
  • Posted 2 days ago
Data & AIAiKubernetesAutomated Software TestingHigh Availability

•

Architect and scale high-throughput, low-latency API gateways powering enterprise AI model inference

•

Own end-to-end backend development across Go/Python microservices, GPU orchestration, and open-source inference engines

About the company

As an innovative leader in artificial intelligence infrastructure, this organization builds developer-first platforms that simplify access to foundation models. The company is committed to advancing scalable cloud-native technologies, empowering global enterprises to deploy reliable AI applications seamlessly.

About the job

Your role involves:

•

Architecting and evolving a fault-tolerant, secure backend platform that serves enterprise AI inference workloads at scale

•

Building core platform services including unified API protocol layers, identity and access management, dynamic request routing, and usage metering/billing engines

•

Designing seamless technical integrations to connect the inference platform with diverse enterprise client environments

•

Implementing deep system observability while continuously optimizing service latency, compute efficiency, and overall platform reliability

•

Evaluating and integrating emerging open-source AI inference technologies into production workflows to elevate system throughput

•

Driving full-lifecycle software delivery—from architectural design and automated testing to production rollout and root cause incident analysis

Skills and experience required

As a successful applicant, you will have:

•

Master's or PhD in Computer Science/Engineering (or equivalent experience) with 5+ years of backend engineering experience in large-scale or AI infrastructure

•

Strong programming expertise in Go, Python, or comparable systems-level backend languages

•

Deep hands-on mastery of distributed systems, microservices architecture, middleware, and network protocols in high-availability production environments

•

Practical working knowledge of GPU computing concepts, AI inference architectures, Linux, containers, and Kubernetes orchestration

•

Proven engineering judgment to balance system reliability, performance optimization, architectural complexity, and delivery velocity

•

Production experience integrating inference frameworks (such as vLLM, TensorRT-LLM, or SGLang) or optimizing distributed GPU model serving (Advantage)

Whats on offer

Shape the foundational architecture of an AI-native platform used by developers and enterprises to run next-generation models in production. You will thrive in a high-ownership engineering culture that encourages continuous experimentation with cutting-edge open-source inference stacks.

To apply online please use the 'apply' function, alternatively you can reach me at https://www.linkedin.com/in/hoonteck-nologyrecruitment. (EA: 94C3609/ R1219669)

Apply on MyCareersFuture

You apply on MyCareersFuture, where this job was posted. Peter Nowak isn’t the employer and doesn’t check listings.

Get new jobs like this by email

Data & AI · Singapore

Free. Confirm by email first; unsubscribe anytime in one click.

Similar jobs

Senior Backend Engineer | AI Inference Platform & Distributed Systems at Randstad Pte. Limited — Singapore | Peter Nowak