from Hacker News

Ask HN: Instant Observability for Graph Data

by HighlandSpring on 10/7/22, 12:36 PM with 0 comments

I'm a single person working on a real-time data hobby project in Scala. The rough of the app is:

- subscribes to a bunch of feeds over websockets

- aggregates the messages somewhat

- passes them through some ML models and decision makers which are organised hierarchically

- executes the decisions

- listens on feeds that relay decision updates

A lot of it is CRUD and a lot of it is actors passing messages around. I'm getting to the point where I don't want to be scanning through log lines anymore and need to set up some visibility but time is scarce so want to ask around:

What is there apart from Kibana?

Kibana is a pretty good fit, there's a Scala library that extracts structured logs from string interpolations (https://izumi.7mind.io/logstage) so before long I could have a very searchable log and all kinds of dashboards.

The one nice-to-have that I'd miss is capturing my hierarchies. It'd be more helpful if I could also have a network view of all my entities, their nestings and the throughput between them. That'd be really nice but again, it's a nice to have and I'd like it to be very low setup

Am I missing something obvious? Grafana?