Skip to content

DOC clarify pandas DataFrame hash cache misses#1817

Draft
sapunyangkut wants to merge 1 commit into
joblib:mainfrom
sapunyangkut:codex/issue-1611-document-pandas-hash-cache-miss
Draft

DOC clarify pandas DataFrame hash cache misses#1817
sapunyangkut wants to merge 1 commit into
joblib:mainfrom
sapunyangkut:codex/issue-1611-document-pandas-hash-cache-miss

Conversation

@sapunyangkut

Copy link
Copy Markdown

Summary

  • document that pandas DataFrames with equal data, columns, and index can still have different internal representations
  • explain that different joblib.hash values intentionally cause a conservative cache miss
  • avoid attributing the behavior to a pandas implementation detail that is not stable across versions

Validation

  • reproduced against the current checkout: DataFrame.equals is true while the two joblib.hash values differ
  • python -m pytest -q doc/user_guide/memory.rst — 1 passed
  • git diff --check

The full Sphinx build was not run locally because the optional documentation dependency set is not installed; the repository's focused doctest for the edited page passed.

Closes #1611

AI assistance disclosure

This documentation change was prepared with AI assistance. The issue discussion, current hashing implementation, all 67 open pull requests, repository policies, diff, reproduction, and validation results were reviewed before submission.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

joblib.hash Produces Different Hashes for Equivalent Pandas DataFrames

1 participant