Kushal Dabbe

LLM inference · ML systems · Computer vision

🗼 Tokyo, Japan

I build ML systems end-to-end. LLM agents, retrieval pipelines, and computer vision. My focus now is the LLM inference and training stack: serving optimization, distributed training, fine-tuning, and benchmarking. This site tracks the projects and notes from that work.

Experience

• Jan 2024 - Present · Tokyo, Japan
  Software Engineer · Rakuten Mobile
• Aug 2023 - Dec 2023 · Remote (Delhi, India)
  NLP Engineer · Counsello AI
• 2019 - 2023
  IIT (BHU) Varanasi
  B.Tech, Mechanical Engineering

Skills

LanguagesPython · C++ · C · SQL · JavaScript · Go

AI / LLMPyTorch · HuggingFace · RAG pipelines · LangChain · LangGraph · Pinecone/ChromaDB)

VisionYOLOv8 fine-tuning · Grounding DINO · SAM 2 · Depth Anything V2 · BoT-SORT tracking · pose estimation · OpenCV

ML optimizationONNX export · graph optimization · CoreML / CUDA deployment · mAP / IoU evaluation

InfraFastAPI · Next.js · Spark · Airflow · AWS · Docker

Currently focused on

TrainingDDP · FSDP · DeepSpeed · mixed precision

Fine-tuningLoRA · QLoRA · SFT · DPO · dataset curation

InferencevLLM · SGLang · TensorRT-LLM · quantization

ServingTriton · Kubernetes

Evalslm-eval-harness · benchmark design

Email LinkedIn GitHub