from Hacker News

Ask HN: How to monitor periodic short-lived processes?

by sharmi on 7/26/22, 2:27 AM with 12 comments

Hi HN,

    We are two founders starting up a business. We need to run multiple programs everyday (around 25) that will be run periodically. They are not always alive though and will often be done in 10 minutes to  an hour.
Unfortunately as a two person company, keeping track of all the programs' statuses is hard.

Is there a way to keep track (and if possible, also spawn them on schedule) of the processes and give regular updates? Like a dashboard of sorts, that can show which programs have been running successfully and which have failed to finish or didn't start?

  • by DamonHD on 7/26/22, 2:42 AM

    For a *nix box, the simple/historic way has been to run the tasks from cron and append log output from them to text files or the system logs. If you really mean statuses, as in exit statuses, wrap the programs in shell scripts which print out the programs' exit codes.

    It's unfashionable these days I think, but still works for me.

  • by 2143 on 7/26/22, 4:36 AM

    You might have to come up with something custom.

    Here's one idea:

    1. Wrap your processes in systemd services or something similar, where it's possible to determine the status by pinging it.

    2. Write a script to periodically (via cron maybe) ping all relevant services, and store the statuses somewhere (file, DB..)

    3. Another script (or the previous one) to read the data from 2 and spit it to a locally served webpage.

    > if possible, also spawn them on schedule

    Cronjobs.

  • by verdverm on 7/26/22, 2:48 AM

    Cron is the term you are looking for and there are many options. As another commenter said, there are Linux system level solutions. There are also Cron concepts in kubernetes, aws lambda, zapier. If they don't have a dashboard, I'm sure there is another SaaS that does and plenty of open source solutions for that as well