Introduce output data format versioning #2653

[AyanSinhaMahapatra]

Add output data format version numbers to the headers and version help
text. Introduce new command line option to switch to the new experimental
data format.

Signed-off-by: Ayan Sinha Mahapatra ayansmahapatra@gmail.com

[AyanSinhaMahapatra]

@pombredanne could you look into this why the tests with latest_from_pip are failing like here. These are failing as bin/pip install --force-reinstall --upgrade -e .[dev] replaces commoncode 21.8.31 with 21.8.27, which doesn't have the header changes, and hence the failures.

If I change this to 21.8.31, this happens in the test:

ERROR: Could not find a version that satisfies the requirement commoncode>=21.8.31 (from scancode-toolkit[dev]) (from versions: 20.9, 20.9.30, 20.10, 20.10.8, 20.10.20, 21.1.14, 21.1.21, 21.4.28, 21.5.12, 21.5.25, 21.6.10, 21.6.11, 21.7.23, 21.8.27)
ERROR: No matching distribution found for commoncode>=21.8.31

What am I doing wrong here

[pombredanne]

Use future and not experimental, here and elsewhere

[pombredanne]

let's use 1.0

[pombredanne]

21.8.31

You need to push 21.8.31 to PyPI too IMHO

[pombredanne]

IMHO you could have fewer changes in the diffs if def check_json_scan(..., ignore_headers=True) was updated to be def check_json_scan(..., include_headers=False) this way few changes are needed in the tests overall... and only a few tests that test headers will need fixing.

[AyanSinhaMahapatra]

You need to push 21.8.31 to PyPI too IMHO

You have to add me at https://pypi.org/project/commoncode/ btw

[pombredanne]

LGTM. Merging!