from Hacker News

Ask HN: What is your LLM monitoring stack?

by aiunboxed on 10/26/23, 1:17 AM with 1 comments

What do you use for tracing llm calls etc ?
  • by chitraa on 10/30/23, 3:57 PM

    Consider using resources like TensorFlow Profiler, PyTorch Profiler, and Spark MLlib's profiler. you can also take advantage from the capabilities of tracing libraries like TensorBoard or Prometheus.