Support SQLite as an output format

[jdaguil]

It would be great if ScanCode supported SQLite file format as an output.

[mjherzog]

Specifically we should have a post-scan plugin to create an AboutCode SQLite file ready for AboutCode Manager. Converting a JSON file to SQLite as the first step in using AboutCode Manager is not a great first impression and this conversion is effectively a background process in any case.

[vivonk]

@mjherzog @jdaguil is this work still incomplete? I would like to work on this 😄

[steven-esser]

@vivonk This is still incomplete and you are free to work on it.

If you are interested, I can go into more detail on the general schema required for SQLite output file.

[mjherzog]

We need this output to streamline codebase analysis especially with "rightsizing" multiple Scans for a codebase so that the Scan files are easier to use in Workbench.

[adityaviki]

@MaJuRG Can you provide the schema for the SQLite output file.

[steven-esser]

@adityaviki For now, you can refer to schema found in: https://github.com/nexB/scancode-workbench/

Two ways to view the schema:

1. Trace the various Sequelize ORM code in scancode-workbench to get a list of all the tables + fields
2. load up an example scan using scancode-workbench, and then you can view the resulting .sqlite file for a more granular schema listing