I'm Kshitij Gupta
Forward Deployed Engineer
LLMs, AI Infrastructure, and Production Engineering
I am a Forward Deployed Engineer at TrueFoundry, where I work with customers to design, build, and deploy AI applications in production. My work spans large language models, machine learning infrastructure, and distributed systems, with a focus on turning complex AI capabilities into reliable products.
Previously, I worked as a Machine Learning Engineer at Chubb, building and scaling LLM-powered systems for enterprise use cases. This included model fine-tuning, retrieval-augmented generation (RAG), agentic workflows, and high-performance inference infrastructure serving production workloads at scale.
My experience covers the full lifecycle of AI systems—from research and experimentation to deployment, observability, and operationalization. I have worked on model serving, cloud-native infrastructure, and production AI platforms, with an emphasis on building systems that are both scalable and maintainable.
I also have a research background in natural language processing from Nanyang Technological University (NTU), Singapore, where I worked on code-switching language models and multilingual NLP. My research has resulted in publications at venues including ACL ARR, AACL-IJCNLP, ACIIDS, and IALP. Across both industry and research, I enjoy working on problems at the intersection of machine learning, software engineering, and infrastructure, with a particular focus on deploying AI systems that create measurable real-world impact.
• Developing and deploying production-grade AI/ML applications, leveraging cloud-native infrastructure, LLMs, and modern
software engineering practices.
• Working directly with customers to solve complex technical challenges, drive adoption of platform capabilities, and deliver
measurable business impact.
• Collaborating with cross-functional teams across engineering, product, and customer stakeholders to rapidly prototype, iterate,
and deliver high-impact solutions in production environments.
• Fine-tuning at scale (LLaMA-3.1 70B): Built an end-to-end pipeline with PEFT (LoRA/QLoRA) + RAG over internal domain data, improving task accuracy on internal benchmarks by 25% and reducing production drift by 15% over the evaluation window; governed by offline holdout tests and progressive traffic gating.
• Agentic AI (orchestration & planning): Integrated a multi-agent workflow directly into the same application. A planner/router decomposes user intents into sub-goals, selects tools (internal search, scraping, structured DB lookups) based on a question taxonomy, and emits step-by-step CoT plans to guide execution.
• Agentic AI (evidence retrieval & verification): Implemented retrieval/scrape agents for structured and unstructured sources with source-level citation tracking, plus a verification agent that runs CoT-based cross-checks. This improved factual grounding vs. a single-agent baseline by 18% while keeping response times within the application SLA through caching and bounded tool-use.
• High-performance inference & deployment: Productionized with vLLM on AKS across A100/H100 nodes; GPU memory/KV cache optimizations cut p95 latency by 40% and lifted throughput by 50%, reliably serving 10K+ daily requests under peak load.
• Integrated robust CI/CD processes, monitoring, and automated scaling strategies to ensure continuous model improvement and reliable production deployments across cloud-based environments.
• Architected scalable data pipelines: Implemented robust data processing solutions using SQL Server, Azure Databricks, and PySpark, cutting processing times by 30% and significantly enhancing overall system performance.
• Integrated CI/CD, monitoring, and automated scaling: Established end-to-end processes that ensured continuous model improvement and reliable production deployments across cloud-based environments.
• Developed a machine learning language model tailored for English-Malay code-switched data, achieving a 20% improvement in accuracy over baseline models by implementing advanced statistical and neural augmentation techniques.
• Integrated linguistically informed algorithms—including part-of-speech tagging and grammatical coherence—to enhance multilingual NLP robustness and advance the state-of-the-art in code-switching language processing.
• Enhanced the model's ability to handle diverse linguistic patterns, advancing the state-of-the-art in code-switching language processing.
• Contributed to the development of bilingual communication technologies by applying cutting-edge machine learning techniques for code-switching scenarios.
Assemble AI is my open-source initiative dedicated to leveraging AI for real-world problems. Through this platform, I create innovative LLM-powered tools that demonstrate the practical applications of modern AI technologies, from personalized content generation to intelligent data processing.
HawkHire is an end-to-end AI-powered hiring copilot that assists recruiters and interview panels with resume normalization, explainable job description matching, and evidence-backed interview analysis. It combines multi-agent orchestration with structured reasoning to deliver auditable, high-confidence hiring decisions.
Key Capabilities:
Impact:
Technologies: GPT, OpenAI API, Python, Multi-Agent Systems, RAG, NLP, Data Processing
Interested in collaborating on LLM tools or learning more about these projects?
Python, Java, C, C++, C#, JavaScript
PyTorch, TensorFlow, Transformers, Hugging Face, vLLM, Keras
AWS, Azure, Docker, Kubernetes, Git, GitHub
Flask, Spring Boot, Databricks, Maven, LaTeX
SQL, RDS
Large Language Models, NLP, Computer Vision, MLOps