1 results

bayesian-coherence

inall models datasets apps agents people projects

Datasets

All datasets matching “bayesian-coherence”

suchirsalhan /bayesian-coherence-lm Bayesian Coherence of LMs — Prompt Sets Prompt sets for measuring the Bayesian-coherence of language models via the incoherence certificate |log R| (local) and the cross-lingual/transitive cycle ratio |log cycle| (global). A model's prompts induce an implicit joint distribution over entities and relations; a model is coherent on a quartet iff its loop of conditional inferences multiplies back to 1 (log R = 0). Code: https://github.com/suchirsalhan/bayesian-coherence-lm… See the full description on the dataset page: https://huggingface.co/datasets/suchirsalhan/bayesian-coherence-lm.text100K<n<1M0 likes34 downloads2d agoHugging Face