Location
Bengaluru
Job Type
Full-time
Posted
June 29, 2026
Job Description
JOB DESCRIPTION Design and maintain canonical LLM APIs (OpenAI‑compatible chat/generate, search, ingest, embeddings, responses, interactions) with multi‑model backends, consistent across on‑prem and cloud. Operate Gateway for LLM traffic (SSE/streaming), set TPS and payload SLOs, and coordinate capacity allocations with enterprise gateway owners. Implement authN/Z patterns: OAuth2 client credent...
Req ID: 373825
We are currently seeking a Senior GenAI Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN).
(Posting Title:- Senior GenAI Engineer)
Role Summary
Hands‑on GenAI Engineer working on canonical LLM APIs—designing OpenAI‑compatible endpoints (/generate, /search, /ingest, embeddings), operating AI Gateway Hybrid with OAuth/mTLS hardening, and evolving SDKs for LangGraph/ADK with trace/eval hooks. Owns versioning, deprecation, rate limiting, and developer onboarding.
Responsibilities