webis/set-encoder-base

1---2license: apache-2.03pipeline_tag: text-ranking4library_name: lightning-ir5base_model:6- google/electra-base-discriminator7tags:8- cross-encoder9---10 11# Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders12 13This model is presented in the paper [Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders](https://huggingface.co/papers/2404.06912). It's a cross-encoder architecture designed for efficient and permutation-invariant passage re-ranking.14 15Code: https://github.com/webis-de/set-encoder16 17We provide the following pre-trained models for general-purpose re-ranking.18 19To reproduce the results, run the following command using the [Lightning IR](https://github.com/webis-de/lightning-ir) library and the configuration files from the repository repository linked above:20 21```bash22lightning-ir re_rank --config ./configs/re-rank.yaml --model.model_name_or_path <MODEL_NAME>23```24 25(nDCG@10 on TREC DL 19 and TREC DL 20)26 27| Model Name                                                                               | TREC DL 19 (BM25) | TREC DL 20 (BM25) | TREC DL 19 (ColBERTv2) | TREC DL 20 (ColBERTv2) |28| ---------------------------------------------------------------------------------------- | ----------------- | ----------------- | ---------------------- | ---------------------- |29| [webis/set-encoder-base](https://huggingface.co/webis/set-encoder-base)                  | 0.746             | 0.704             | 0.781                  | 0.768                  |30| [webis/set-encoder-large](https://huggingface.co/webis/set-encoder-large)                | 0.750             | 0.722             | 0.789                  | 0.791                  |31 32 33## Citation34 35If you use this code or the models in your research, please cite our paper:36 37```bibtex38@InProceedings{schlatt:2025,39  address =                  {Berlin Heidelberg New York},40  author =                   {Ferdinand Schlatt and Maik Fr{\"o}be and Harrisen Scells and Shengyao Zhuang and Bevan Koopman and Guido Zuccon and Benno Stein and Martin Potthast and Matthias Hagen},41  booktitle =                {Advances in Information Retrieval. 47th European Conference on IR Research (ECIR 2025)},42  doi =                      {10.1007/978-3-031-88711-6_1},43  month =                    apr,44  publisher =                {Springer},45  series =                   {Lecture Notes in Computer Science},46  site =                     {Lucca, Italy},47  title =                    {{Set-Encoder: Permutation-Invariant Inter-Passage Attention for Listwise Passage Re-Ranking with Cross-Encoders}},48  year =                     202549}