Skip to content

Simplify the multiprocessing number of processes settings #302

Description

@tdruez

There's currently 2 way to define the number of available processes:

  • SCANCODE_PROCESSES=4 for the scancode pipes (docker and rootfs pipelines)
  • SCANCODE_DEFAULT_OPTIONS=--processes 4 for the scancode cli subprocess calls (scan_codebase and scan_package pipelines)

This is confusing for the user as you may think you set the proper settings but for some pipelines you are actually only running on 1 cpu.

Also, the default when SCANCODE_PROCESSES is not provided is to base the number of workers on the CPU count of the machine. But for the SCANCODE_DEFAULT_OPTIONS the default is always 1. We should have a similar default for both approaches.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions