feat(backend): add BullMQ JobManager framework by brendan-kellam · Pull Request #1427 · sourcebot-dev/sourcebot

brendan-kellam · 2026-07-08T03:16:08Z

No description provided.

Introduces a JobManager over BullMQ: work-queue Workloads with a ProcessContext, CronWorkloads multiplexed onto a shared cron worker with a reconcile() sweep helper, a JobProducer that owns the queues and the deduplicated enqueue path, and a Redis-backed read model (status/jobDetail). Wired into the backend entrypoint with a demo workload. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

coderabbitai · 2026-07-08T03:16:15Z

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Organization UI

Review profile: CHILL

Plan: Pro Plus

Run ID: 1f6f22d0-7a7c-4601-b6b3-4307d9fdd327

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

Create PR with unit tests
Commit unit tests in branch brendan/job-manager

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

_{Comment @coderabbitai help to get the list of available commands.}

mintlify · 2026-07-14T16:56:30Z

Preview deployment for your docs. Learn more about Mintlify Previews.

Project	Status	Preview	Updated (UTC)
sourcebot	🟢 Ready	View Preview	Jul 14, 2026, 4:56 PM

💡 Tip: Enable Workflows to automatically generate PRs for you.

github-actions · 2026-07-31T23:09:51Z

License Audit

⚠️ Status: PASS

Metric	Count
Total packages	2206
Resolved (non-standard)	17
Unresolved	0
Strong copyleft	0
Weak copyleft	28

Weak Copyleft Packages (informational)

Package	Version	License
@img/sharp-libvips-darwin-arm64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-darwin-x64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linux-arm	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linux-arm64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linux-ppc64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linux-riscv64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linux-s390x	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linux-x64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linuxmusl-arm64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-libvips-linuxmusl-x64	1.3.2	`LGPL-3.0-or-later`
@img/sharp-wasm32	0.35.3	`Apache-2.0 AND LGPL-3.0-or-later AND MIT`
@img/sharp-win32-arm64	0.35.3	`Apache-2.0 AND LGPL-3.0-or-later`
@img/sharp-win32-ia32	0.35.3	`Apache-2.0 AND LGPL-3.0-or-later`
@img/sharp-win32-x64	0.35.3	`Apache-2.0 AND LGPL-3.0-or-later`
axe-core	4.10.3	`MPL-2.0`
dompurify	3.4.11	`(MPL-2.0 OR Apache-2.0)`
lightningcss	1.32.0	`MPL-2.0`
lightningcss-android-arm64	1.32.0	`MPL-2.0`
lightningcss-darwin-arm64	1.32.0	`MPL-2.0`
lightningcss-darwin-x64	1.32.0	`MPL-2.0`
lightningcss-freebsd-x64	1.32.0	`MPL-2.0`
lightningcss-linux-arm-gnueabihf	1.32.0	`MPL-2.0`
lightningcss-linux-arm64-gnu	1.32.0	`MPL-2.0`
lightningcss-linux-arm64-musl	1.32.0	`MPL-2.0`
lightningcss-linux-x64-gnu	1.32.0	`MPL-2.0`
lightningcss-linux-x64-musl	1.32.0	`MPL-2.0`
lightningcss-win32-arm64-msvc	1.32.0	`MPL-2.0`
lightningcss-win32-x64-msvc	1.32.0	`MPL-2.0`

Resolved Packages (17)

Package	Version	Original	Resolved	Source
@sentry/cli	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-darwin	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-linux-arm	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-linux-arm64	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-linux-i686	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-linux-x64	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-win32-arm64	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-win32-i686	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
@sentry/cli-win32-x64	2.58.5	`FSL-1.1-MIT`	`FSL-1.1-MIT (Functional Source License 1.1, MIT Future License)`	npm registry license "FSL-1.1-MIT" -> installed package LICENSE file (full FSL v1.1 text, converts to MIT two years after release). Real, identifiable license; simply not an SPDX-registered identifier.
codemirror-lang-elixir	4.0.0	`UNKNOWN`	`Apache-2.0`	npm registry package-level license "Apache-2.0" -> installed package LICENSE file (Apache License 2.0 text)
khroma	2.1.0	`UNKNOWN`	`MIT`	npm registry (no license field) -> installed package LICENSE file "The MIT License (MIT)" / GitHub repo fabiospampinato/khroma
lezer-elixir	1.1.2	`UNKNOWN`	`Apache-2.0`	npm registry package-level license "Apache-2.0" -> installed package LICENSE file (Apache License 2.0 text)
map-stream	0.1.0	`UNKNOWN`	`MIT`	npm registry package-level license "MIT" -> installed package LICENCE file (verbatim MIT text)
memorystream	0.3.1	`UNKNOWN`	`MIT`	extracted from object: npm registry legacy "licenses":[{"type":"MIT","url":"..."}]; corroborated by MIT LICENSE file
pause-stream	0.0.11	`["MIT", "Apache2"]`	`(MIT OR Apache-2.0)`	extracted from array ["MIT","Apache2"]; LICENSE file states "Dual Licensed MIT and Apache 2"
posthog-js	1.369.0	`SEE LICENSE IN LICENSE`	`(Apache-2.0 AND MIT)`	LICENSE file referenced by "SEE LICENSE IN LICENSE": Apache-2.0 grant plus MIT notices for vendored code; matches PostHog's own later-version SPDX declaration "(Apache-2.0 AND MIT)"
valid-url	1.0.9	`UNKNOWN`	`MIT`	npm registry (no license field) -> installed package LICENSE file (verbatim MIT text) / GitHub repo ogt/valid-url

brendan-kellam added 3 commits July 7, 2026 20:55

Merge branch 'main' into brendan/job-manager

55d7ff0

Merge branch 'main' into brendan/job-manager

c72d798

wip

bb84b8e

mintlify Bot deployed to staging - docs July 14, 2026 16:56 View deployment

brendan-kellam added 5 commits July 27, 2026 19:10

further wip

ea54e4c

further wip

809bad4

migrated repo indexing to workload

c7108d6

further wip

7336c5e

Merge branch 'main' into brendan/job-manager

1232e4b

brendan-kellam added 3 commits July 31, 2026 16:14

simplicity: remove much of the web changes

81c4190

wip

f6ad4b3

add necessary lifecyle hooks

d367d9f

mintlify Bot deployed to staging - docs August 1, 2026 00:40 View deployment

mintlify Bot deployed to staging - docs August 1, 2026 01:06 View deployment

mintlify Bot deployed to staging - docs August 1, 2026 01:37 View deployment

further wip

c7d9744

mintlify Bot deployed to staging - docs August 3, 2026 22:57 View deployment

Navigation Menu

Uh oh!

feat(backend): add BullMQ JobManager framework - #1427

feat(backend): add BullMQ JobManager framework#1427
brendan-kellam wants to merge 13 commits into
mainfrom
brendan/job-manager

brendan-kellam commented Jul 8, 2026

Uh oh!

coderabbitai Bot commented Jul 8, 2026 •

edited

Loading

Review skipped

Uh oh!

mintlify Bot commented Jul 14, 2026

Uh oh!

github-actions Bot commented Jul 31, 2026 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Uh oh!

Conversation

brendan-kellam commented Jul 8, 2026

Uh oh!

coderabbitai Bot commented Jul 8, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Review skipped

Uh oh!

mintlify Bot commented Jul 14, 2026

Uh oh!

github-actions Bot commented Jul 31, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

License Audit

Weak Copyleft Packages (informational)

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

coderabbitai Bot commented Jul 8, 2026 •

edited

Loading

github-actions Bot commented Jul 31, 2026 •

edited

Loading