Skip to content

Fetch report from Clouseau in batches - #243

Merged
suhaibmujahid merged 4 commits into
mozilla:masterfrom
suhaibmujahid:batch-clouseau
Jul 17, 2024
Merged

suhaibmujahid merged 4 commits into
mozilla:masterfrom
suhaibmujahid:batch-clouseau

Conversation

@suhaibmujahid

Copy link
Copy Markdown
Member

@suhaibmujahid
suhaibmujahid requested a review from marco-c July 17, 2024 13:35
@marco-c

marco-c commented Jul 17, 2024

Copy link
Copy Markdown
Collaborator

ImportError: cannot import name 'batched' from 'itertools' (unknown location)

@suhaibmujahid

Copy link
Copy Markdown
Member Author

ImportError: cannot import name 'batched' from 'itertools' (unknown location)

This requires Python >= 3.12: https://docs.python.org/3/library/itertools.html#itertools.batched

I coped with the implementation in 27a9a8d to avoid compatibility issues. We could drop that once we drop the support for Python < 3.12.

Comment thread libmozdata/utils.py Outdated
Comment on lines +387 to +388
# This is a roughly equivalent to the itertools.islice which was added in
# Python 3.10.

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What if we just require 3.10?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I prefer that. We need first to update Taskcluster to run on Python 3.10 instead of Python 3.9.

I filed an issue for that since it is out of the scope of this PR: #245

Comment thread libmozdata/utils.py Resolved
Comment thread libmozdata/utils.py Resolved
Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
Co-authored-by: Marco Castelluccio <mcastelluccio@mozilla.com>
@suhaibmujahid
suhaibmujahid merged commit c83436d into mozilla:master Jul 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[file_crash_bug] Bad Request for url: https://clouseau.moz.tools/api/reports?signatures

2 participants