Use PyPI API filename field for duplicate-distribution check - #49
Open
elhoim wants to merge 1 commit into
Open
Conversation
The duplicate-distribution filter reconstructed the comparison filename by unquoting the basename of file_info['url'], instead of using file_info['filename'] which PyPI's JSON API already provides directly. Under PEP 625 sdist name normalization, the URL path and the actual filename can diverge, defeating the duplicate check and causing re-uploads or upload failures. Use file_info['filename'] directly.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Finding 43 (Low) —
.github/workflows/pypi-publish.yml:78-82Problem
The comparison filename is reconstructed via unquote(Path(urlparse(file_info['url']).path).name) when PyPI's JSON API already returns file_info['filename'] directly; sdist name normalization drift (PEP 625) would defeat the duplicate check.
Fix
The duplicate-distribution check in .github/workflows/pypi-publish.yml reconstructed the comparison filename by unquoting the basename of file_info['url'] instead of using file_info['filename'], which PyPI's JSON API already provides directly. Under PEP 625 sdist name normalization, the URL path's basename can diverge from the canonical distribution filename (e.g. case/separator normalization differences), defeating the duplicate check so an already-published file could fail to be skipped, causing a spurious re-upload attempt. Fixed by using file_info['filename'] directly and dropping the now-unused unquote/urlparse import.
Verification
Reproduced against the unmodified code at
9b8c605, then re-checked after the change.Before
After
python bin/cli.py --helpexits 0 and the module still imports cleanly. Verification was performed offline against the pure functions — no runningmisp-modulesinstance is required.Branched from
9b8c605. This PR addresses only this finding; the other findings from the same review are in separate PRs, so they will need rebasing against each other as they merge.🤖 Generated with Claude Code
https://claude.ai/code/session_01DYX4TKA5inzByJ4qGWKjqh