back2source: Run pipeline for 100 Windows C++ projects

[pombredanne]

The list of projects could be a CSV with purl, source/from download URL and binary/to download URL.

[chinyeungli]

We might be able to locate some sources and binaries on
https://vcpkg.io/en/
https://community.chocolatey.org/

[chinyeungli]

@pombredanne Are we looking for the installer as the deploy binary? For instance,

name	from	to
godot	https://github.com/godotengine/godot/archive/refs/heads/4.3.zip	https://github.com/godotengine/godot/releases/download/4.3-stable/Godot_v4.3-stable_win64.exe.zip
pcsx2	https://github.com/PCSX2/pcsx2/archive/refs/tags/v2.2.0.zip	https://github.com/PCSX2/pcsx2/releases/download/v2.2.0/pcsx2-v2.2.0-windows-x64-installer.exe

[chinyeungli]

cpp_projects_list.xlsx
@pombredanne please see if this list is good enough.

[pombredanne]

@chinyeungli this looks great!

[tdruez]

@chinyeungli The following download URLs from the list are not reachable, could you update the XLSX before we start the analysis process?

• https://github.com/xournalpp/xournalpp/releases/download/nightly/xournalpp-1.2.5%2Bdev-nightly-20241215-windows-setup-x86_64.exe
• https://github.com/rime/weasel/releases/download/latest/weasel-0.16.3.4.37c8fa1-installer.exe
• https://github.com/LizardByte/Sunshine/archive/refs/tags/v2024.1214.152703.zip
• https://github.com/LizardByte/Sunshine/releases/download/v2024.1214.152703/sunshine-windows-installer.exe
• https://github.com/LibreCAD/LibreCAD/releases/download/2.2.1_rc-latest/LibreCAD-2.2.1_rc4-6-ge0bf7ac3-win64.exe
• https://github.com/f3d-app/f3d/archive/refs/tags/nightly.zip
• https://github.com/f3d-app/f3d/releases/download/nightly/F3D-2.5.0-197-g93c2a3ec-Windows-x86_64.exe.md5

Also, the following entry is too large (over 1G) and should not be part of this batch:

• https://github.com/Floorp-Projects/Floorp/archive/refs/tags/v11.21.0.zip

[chinyeungli]

Updated the XLSX
cpp_projects_list-2025-01-13.xlsx

[tdruez]

Run on the 100 projects list provided at https://github.com/user-attachments/files/18403167/cpp_projects_list-2025-01-13.xlsx

1. Convert the cpp_projects_list-2025-01-13.xlsx into back2source_cpp_projects_list-2025-01-13.csv

2. Batch create the projects

docker compose -f /opt/scancodeio/docker-compose.yml run --rm \
    --volume $PWD:/input-data:ro \
    web scanpipe batch-create \
    --input-list /input-data/back2source_cpp_projects_list-2025-01-13.csv \
    --pipeline map_deploy_to_develop \
    --label back2source-Cpp \
    --execute --async

3. Use the "Report" action on the filtered list of projects by "back2source-Cpp" label.

Results: https://github.com/aboutcode-org/back2source-data/blob/main/reports/2025-01-17/back2source-report-Cpp.xlsx

[tdruez]

Re-run following the merge of #1674

LABEL="back2source-Cpp-v2"
INPUT="back2source_cpp_projects_list-2025-01-13.csv"
PIPELINE_OPTIONS="Windows"

docker compose -f /opt/scancodeio/docker-compose.yml run --rm \
    --volume $PWD:/input-data:ro \
    web scanpipe batch-create \
    --input-list /input-data/$INPUT \
    --pipeline map_deploy_to_develop:$PIPELINE_OPTIONS \
    --label $LABEL \
    --execute --async

Results: back2source-report-Cpp-v2-2025-06-20.xlsx

[pombredanne]

Results still need review