Show HN: Log every LLM call with tokens, cost, latency, and time to first token
3 points by garritfra
Llmtee is a lightweight proxy designed for logging LLM calls, providing an easy solution without the need for complex setups like Postgres or Redis. It operates as a single binary that logs usage details such as tokens, cost, latency, and time to first token into an SQLite database or Postgres, with a container size of approximately 25 MB and a memory footprint around 40 MB.