// INFERENCE CLUSTER
LIVE

iHoree LLM Monitor

real-time metrics across 6 endpoints · 1h rolling history · server polls every 5s

ONLINE
0/6
CLUSTER GEN
0 tok/s
TOTAL TOKENS
0
DECODE CALLS
0

Host Resources

CPU · RAM · GPU per endpoint

Time Series Detail

CLICK AN ENDPOINT CARD OR BUTTON TO FOCUS

Generation Throughput
predicted_tokens_seconds · tok/s
--
Prompt Throughput
prompt_tokens_seconds · tok/s
--
Cumulative Tokens
prompt_tokens_total + tokens_predicted_total
--
Requests & Slots
processing · deferred · busy_slots_per_decode
--
Copyright © 2026 iHoree
Made with by MOVZX