back2source: Run pipeline for Java and native code and Android apk and dex classes

[pombredanne]

This depends on:

• Add documentation on how to install android-inspector in ScanCode.io #1676
• back2source: Refine ScanCode.io d2d pipeline for Java #1404

[chinyeungli]

Created a list of projects for testing
java_projects.xlsx

[tdruez]

@chinyeungli Could you update the list considering the following:

Could not fetch URL(s):
- https://github.com/M66B/FairEmail/releases/download/1.2253/FairEmail-v1.2253a-github-release.apk#to
- https://github.com/jindrapetrik/jpexs-decompiler/archive/refs/tags/nightly3017.zip#from
- https://github.com/jindrapetrik/jpexs-decompiler/releases/download/nightly3017/ffdec_22.0.1_nightly3017.deb#to

Also, the following entries are quite large (over 1G) and should not be part of this batch:

• https://github.com/DTStack/chunjun/releases/download/v1.12.8/chunjun-dist-1.12-SNAPSHOT.tar.gz
• https://github.com/apache/linkis/releases/download/0.11.0/wedatasphere-linkis-0.11.0-dist.tar.gz
• https://github.com/facebook/buck/archive/refs/tags/v2022.05.05.01.zip
• https://github.com/apache/incubator-streampark/releases/download/v1.2.3/streamx-console-service_2.11-1.2.3.tar.gz
• https://github.com/camunda/camunda/releases/download/8.7.0-alpha2/camunda-zeebe-8.7.0-alpha2.tar.gz

[chinyeungli]

Updated the XLSX
java_projects-2025-01-13.xlsx

[tdruez]

Run on the 100 projects list provided at https://github.com/user-attachments/files/18403306/java_projects-2025-01-13.xlsx

1. Convert the java_projects-2025-01-13.xlsx into back2source_java_projects-2025-01-13.csv

2. Batch create the projects

   docker compose -f /opt/scancodeio/docker-compose.yml run --rm \
       --volume $PWD:/input-data:ro \
       web scanpipe batch-create \
       --input-list /input-data/back2source_java_projects-2025-01-13.csv \
       --pipeline map_deploy_to_develop:Java \
       --label back2source-Java \
       --execute --async
   

3. Use the "Report" action on the filtered list of projects by "back2source-Java" label.

Results: https://github.com/aboutcode-org/back2source-data/blob/main/reports/2025-01-17/back2source-report-Java.xlsx

[AyanSinhaMahapatra]

Should we not also use https://github.com/aboutcode-org/android-inspector?tab=readme-ov-file#local-installation-and-usage-test here, which is a separate pipeline: android_d2d. Maybe We should run both d2d and anoroid d2d pipelines, as there is some overlap atleast? This is not there in this repo because we need to install jadx manually here.