hf-internal-testing/transformers_code_embeddings

Transformers Code Embeddings Compact index of function/class definitions from src/transformers/models/**/modeling_*.py for cross-model similarity. Built to help surface reusable code when modularizing models. Contents embeddings.safetensors — float32, L2-normalized embeddings shaped [N, D]. code_index_map.json — {int_id: "relative/path/to/modeling_*.py:SymbolName"}. code_index_tokens.json — {identifier: [sorted_unique_tokens]} for Jaccard. How these… See the full description on the dataset page: https://huggingface.co/datasets/hf-internal-testing/transformers_code_embeddings.