https://terminal.space/tag/async/ Recent content in Async on sugar, spice, &terminal? nice Hugo en Sat, 20 Aug 2022 07:04:44 +0000 https://terminal.space/tech/introducing-async-service/ Sat, 20 Aug 2022 07:04:44 +0000 https://terminal.space/tech/introducing-async-service/ <h1 id="distributed-tasks-with-postgres--rabbitmq">Distributed tasks with Postgres &amp; Rabbitmq</h1> <p>TL;DR: <a href="https://www.db-fiddle.com/f/yeKfmXg2nLbhZBLzWi11W/2">Check out the code here</a></p> <p>At my workplace, we needed a mechanism to:</p> <ol> <li>Have service A tell service B to start executing long-running tasks, with notifications upon completion</li> <li>Add reliability to cross-service infrastructure to be resilient to temporary outages</li> <li>Support nested jobs where Job 1 needs to complete sub-steps 1a, 1b, 1c, etc. which are all jobs themselves</li> <li>Support scaling to accommodate large surges of jobs</li> </ol> <p>I considered different off-the-shelf products, but ended up feeling like we would need to fork the functionality to get the behavior we wanted. I also wanted to avoid introducing yet-another-stack, query syntax, and more into our system. Since our backend already is based around postgres and rabbitmq, I singlehandedly designed and implemented async service to handle our needs.</p>