Skip to content

[TRI-1152] chore: upgrade webapp to use graphile-worker 0.14.0-rc.0 #396

Description

@ericallam

We're currently on 0.13.0 but 0.14.0 comes with automatic queue management, so it will be easier to do #392 along with other things:

  • New "batch jobs" feature for merging payloads with a job_key (see README)
  • Significantly improved 'large jobs table' performance (e.g. when a large queue is locked, or there's a lot of jobs queued for task identifiers your worker instance doesn't support, or a lot of failed jobs). Around 20x improvement in this 'worst case' performance for real user workloads.
  • Added new (experimental) much faster add_jobs batch API.
  • Fix error handling of cron issues in 'run' method.
  • CronItem.match can now accept either a pattern string or a matcher function
  • Jobs that were locked more than 4 hours will be reattempted as before, however they are slightly de-prioritised by virtue of having their run_at updated, giving interim jobs a chance to be executed (and lessening the impact of queue stalling through hanging tasks).

The full release notes are here:

https://github.com/graphile/worker/blob/main/RELEASE_NOTES.md#v0140

As mentioned in the release notes, this is a breaking change, meaning workers running 0.13 cannot run against the 0.14 schema. So we'll need to make this clear in any release notes for this feature.

From SyncLinear.com | TRI-1152

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions