Skip to content

About

Multilingual benchmark of Typed Decision Models (Jev, Clef, pplx-decider and more) and English-fitted confidence thresholds: 9 suites, 122 languages. Paper: arXiv:2611.01370. Code to follow.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

1 Commit

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

XDecideBench

XDecideBench is a benchmark of typed decisions across languages. A typed decision is a probability distribution over a declared, finite output space: one of k options, yes/no, or an ordinal level. The benchmark scores the submitted distributions, not generated text, on nine suites in 122 languages, and checks whether confidence policies fitted in English hold in other languages.

Citation

Marek Šuppa and Jaroslav Kopčan. XDecideBench: Evaluating Typed Decision Models and Confidence Policies Across Languages. 2026. arXiv preprint.

About

Multilingual benchmark of Typed Decision Models (Jev, Clef, pplx-decider and more) and English-fitted confidence thresholds: 9 suites, 122 languages. Paper: arXiv:2611.01370. Code to follow.

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors