Skip to content

Fix/citation list inputs - #132

Merged
lfoppiano merged 2 commits into
masterfrom
fix/citation-list-inputs
Nov 8, 2026
Merged

lfoppiano merged 2 commits into
masterfrom
fix/citation-list-inputs

Conversation

@lfoppiano

Copy link
Copy Markdown
Member

No description provided.

Base automatically changed from fix/converter-duplicate-links to master November 8, 2026 08:50
Any .txt was an eligible input for processCitationList, including the
<stem>_<status>.txt markers written next to the inputs when no output
directory is given. A rerun posted the previous run's markers as citation
lists, producing marker-of-marker files and inflated counts. PDFs are no
longer eligible for this service either, since process_txt reads them as
text and fails.
@lfoppiano
lfoppiano force-pushed the fix/citation-list-inputs branch from bb95ff0 to 077d5f2 Compare November 8, 2026 08:52
Remote objects were named by basename only, so pdfs/a/x.pdf and
pdfs/b/x.pdf listed under pdfs/ both mapped to x.grobid.tei.xml: within a
chunk the second overwrote the first, across chunks it was skipped as
already done. Objects are now named by their key relative to the common
prefix of the listing, mirroring what local directories and archives do,
and the citation-list download route keeps that relative path on disk.
@lfoppiano
lfoppiano merged commit 2cf525a into master Nov 8, 2026
17 of 33 checks passed
@lfoppiano
lfoppiano deleted the fix/citation-list-inputs branch November 8, 2026 21:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant