from Hacker News

Show HN: A SQLite-backed job queue handling 15k jobs/s

by joseferben on 9/4/24, 7:15 PM with 0 comments

15k jobs/s is on my macbook pro m1 without batching.

i did a bit of benchmarking and optimizing, but there are probably quite a few things that can be done to improve throughput.

plainjobs is a bit more feature complete than just a bare-bones queue with atomic pop semantic. it supports scheduled cron jobs and auto re-queueing if a worker dies.

the queue has an api that can be used to build a dashboard, which is one of the next things i'm going to do.

i extracted plainjobs while working on a SQLite stack for web development in TypeScript, hoping it could be useful for others!