Skip to content
Chitral Patil

Proof of work

Projects

Not a GitHub dump — a few things that show how I think. The flagship is the meter; the rest trace the same instinct backward.

Flagship · open source

vllm-cost-meter

Objective live telemetry + effective cost-per-million-token meter for vLLM servers.

A read-only observer for running vLLM servers that ingests Prometheus metrics and surfaces live effective LLM serving cost against the operator's actual traffic.

  • Reads vLLM Prometheus metrics
  • Tracks throughput, request rate, TTFT, TPOT, E2E latency, prompt / generation lengths, batch state, and KV cache
  • Computes live effective cost-per-million-token visibility
  • Ships benchmark reference curves from the paper
  • Independent, reproducible research artifact
More on GitHub

Older projects are framed as curiosity and shipping, not headline claims.