jUdZddlZddlZddlZddlZddlmZddlmZddl m Z eje Z dZiZeedfed<ej&Zed Gd d Zd eeefdefdZdededefdZdedefdZdededeeefdzfdZdedeeefdzfdZdeded eeefddfdZy)a5On-disk cache for repository tree listings. A tree listing is the set of files (with their download metadata) contained in a repo at a given commit. Because a commit hash is immutable, its tree listing never changes and can be cached forever without any invalidation logic. The listing is stored as a human-readable JSON file under `/trees/.json`. The folder depends on the download target: the per-repo `storage_folder` for `cache_dir` downloads, or `local_dir/.cache/huggingface/` for `local_dir` downloads (see `tree_cache_folder_for_local_dir`). ```json { "format_version": 1, "files": { "config.json": {"size": 519, "blob_id": ""}, "model.safetensors": {"size": 1234, "blob_id": "...", "lfs_sha256": "", "lfs_size": 1234, "xet_hash": "..."} } } ``` N) dataclass)logging)is_valid_xet_hashzdict[str, TreeCacheEntry]_IN_MEMORY_TREE_CACHET)frozenceZdZUdZeed<eed<dZedzed<dZedzed<dZ edzed<de fd Z e d e ddfd Z y) TreeCacheEntryz^Raw metadata of a single file in a cached tree listing, mirroring the `/tree` endpoint fields.sizeblob_idN lfs_sha256lfs_sizexet_hashreturnc|j|jd}|j|j|d<|j|d<|j|j|d<|S)N)r r r rrr r r rr)selfinfos /home/vela/workspace/domain/tn-silver/web/tn-site/.runtime/depth-eval/venv/lib/python3.12/site-packages/huggingface_hub/_tree_cache.pyto_jsonzTreeCacheEntry.to_json?sW"iiDLLA ?? &!%D #}}D  == $#}}D  rc ||d|d|jd|jd|jdS)Nr r r rrr)get)clsrs r from_jsonzTreeCacheEntry.from_jsonHsAfOxx -XXj)XXj)   r)__name__ __module__ __qualname____doc__int__annotations__strr rrdictr classmethodrrrr r 5shh I L!Jd !HcDjHcDj T &6  rr entriesrcBtd|jDS)zz(is_valid_tree_entries..Us.iXhuu~~%J):5>>)JJXhs/1)allvalues)r&s ris_valid_tree_entriesr.Ss iX_XfXfXhi iirtree_cache_folder commit_hashcJtjj|d|dS)Ntreesz.jsonospathjoin)r/r0s r_tree_cache_pathr7Xs! 77<<)7{m54I JJr local_dircDtjj|ddS)zGFolder under which the `trees/` cache lives for a `local_dir` download.z.cache huggingfacer3)r8s rtree_cache_folder_for_local_dirr;\s 77<< 8] ;;rc$t||}t5|tvr!t|}t|r|ndcdddS dddt |}| t|syt5|t|<ddd|S#1swY%J>PT $ # ( $).G3G< #&-d# $ N $ # $ Ns A9% B9BBr5c t|d5}tj|}dddjdtk7ry|dj Dcic]\}}|t j|c}}S#1swY\xYwcc}}w#t$rYyttttf$r%}tjd|d|Yd}~yd}~wwxYw)Nutf-8encodingformat_versionfilesz#Ignoring corrupted tree cache file : )openjsonloadrTREE_CACHE_FORMAT_VERSIONitemsr rFileNotFoundErrorOSError ValueErrorKeyError TypeErrorloggerwarning)r5fdata file_pathres rr>r>ps  $ )Q99Q33D99Qfgg * ) h  Z9 5rhr%rrrpsL( !)   H %ACtC!<<=B+Y^^- $   :j4^(;#<jj KK#K#KFYAZ]aAa  S T#~2E-F-M 44#4SR`M`Ha4fj4r