Hello

Selected projects by Ankit Kaushik

Cost-Aware Model Routing Gateway for LLM Applications

Orange

A LLMRouter & OpenAI-compatible inference gateway that intelligently routes requests to the cheapest capable AI model using local embedding-based complexity scoring, semantic caching, and budget-aware failover—optimizing cost without compromising response quality.

  • Python
  • FastAPI
  • LangChain
  • FAISS
  • Ollama
  • OpenAI API
  • Embeddings
  • Docker
orange.ankitkaushik.in
Orange screenshot
My Journey

Work
Experience

A timeline of my professional experience shipping production LLM features — AI agents, retrieval pipelines, and workflow automation — alongside the platform work that keeps them fast and reliable.

  1. Software Engineer

    WallmantraNew Delhi

    • Built and shipped "Grace AI", an AI-assisted shopping layer that lets customers find products in natural language and get personalised recommendations across the catalog.
    • Added LLM-powered customer support workflows that handle common queries automatically and keep responses consistent, reducing manual support load.
    • Improved storefront performance, cutting page load times by ~25% through caching and query optimisation.
    • Set up a modular, reusable service architecture with onboarding docs that helped new developers get productive faster.
    • Worked with product, design, and growth teams to ship AI features that made products easier to discover and improved checkout.
  2. Software Engineer Intern

    Amantya TechnologiesOnsite, Gurugram

    • Designed multi-step agent workflows that automated client request handling and reduced manual work for the operations team by ~40%.
    • Built a structured logging and monitoring setup with automatic file rotation that significantly cut log storage and made issues easier to trace.
    • Standardised log formats and error-tracing across services, making debugging and deployments faster and more reliable.

Get in
Touch

Profile Background

Ankit Kaushik

Full-Stack & Gen AI Engineer

Ankit Kaushik

Orange (LLMRouter)

Cost-Aware Model Routing Gateway

Grace AI

AI-Assisted Shopping Layer

AKMovies

Movie & TV Streaming Platform

Portfolio

Developer Portfolio Website

Portfolio

Developer Portfolio Website

AKMovies

Movie & TV Streaming Platform

Grace AI

AI-Assisted Shopping Layer

Orange (LLMRouter)

Cost-Aware Model Routing Gateway

Let's connect and build something amazing together.

© 2026 Ankit Kaushik