HeadlinesBriefing favicon HeadlinesBriefing.com

Grafana Agent Hermes Observability Plugin

Hacker News •
×

Grafana Agent Observability plugin for Hermes Agent records LLM calls and tool executions as generations and emits OTel traces and metrics. Installation is straightforward: paste the provided URL into the Hermes agent (or any Claude, Codex, Cursor, or similar agent) to let it install and configure the plugin, handling pip install, config.yaml edits, and credential setup. The plugin captures conversation data by default and lets you tune settings before enabling anything.

Manual installation requires running `pip install grafana-agento11y-hermes` in the same Python environment as Hermes, then editing `~/.hermes/config.yaml` to enable the plugin under `plugins:enabled:` because the CLI currently only scans `~/.hermes/plugins/`. Upgrading from the old `hermes-plugin-sigil` package involves uninstalling the old package, installing the new one, renaming the config key from `sigil` to `agento11y`, and converting `SIGIL_*` environment variables to `AGENTO11Y_*`.

All configuration is done via a single Grafana Cloud setup page where you create a token, copy environment variables, and set `AGENTO11Y_DEBUG=true` to verify installation; logs will show successful tracer and meter provider initialization.

License is Apache-2.0, and once configured you can query Grafana Cloud → Observability → AI → Conversations to view the recorded data.