vennabers: Venn-Abers Classification and Regression Calibration

Calibrates the predictions of classification and regression models with Venn-Abers predictors. A Venn-Abers predictor turns the score of any model into a pair of probabilities that contains a calibrated value when the observations are independent and identically distributed (Vovk and Petej, 2014, <doi:10.48550/arXiv.1211.0025>); Inductive and Cross Venn-Abers predictors make this practical for large data sets (Vovk, Petej and Fedorova, 2015, <doi:10.48550/arXiv.1511.00213>). The package serves analysts and researchers who need calibrated probabilities or prediction bounds for binary classification, multiclass classification by one-vs-one coupling (Manokhin, 2017, <https://proceedings.mlr.press/v60/manokhin17a.html>) or one-vs-rest, and regression (Petej and Vovk, 2026, <doi:10.48550/arXiv.2605.06646>). Predictions of an existing model can be calibrated directly, or optional 'tidymodels' workflows fit the model, create the calibration splits and tune the complete procedure. Diagnostics include the Brier score, log loss, plots of fitted calibration maps and reliability diagrams with the CORP (consistent, optimally binned, reproducible and pool-adjacent-violators based) method of Dimitriadis, Gneiting and Jordan (2021) <doi:10.1073/pnas.2016191118>.

Version: 1.0.0
Depends: R (≥ 4.5.0)
Suggests: knitr, rmarkdown, mgcv, nnet, parsnip (≥ 1.6.0), workflows (≥ 1.3.0), hardhat (≥ 1.4.3), rsample (≥ 1.3.2), recipes (≥ 1.4.0), rlang (≥ 1.2.0), tibble (≥ 3.3.1), withr (≥ 3.0.3), generics (≥ 0.1.4), tidyselect (≥ 1.2.1), tailor (≥ 0.1.0), probably (≥ 1.1.0), tune (≥ 2.1.0), dials (≥ 1.4.3), yardstick (≥ 1.4.0), future (≥ 1.67.0), rpart, spelling, testthat (≥ 3.0.0)
Published: 2026-11-07
DOI: 10.32614/CRAN.package.vennabers (may not be active yet)
Author: René-M. Kruse ORCID iD [aut, cre, cph]
Maintainer: René-M. Kruse <rene.marcel.kruse at protonmail.com>
BugReports: https://github.com/RMKruse/vennabers/issues
License: MIT + file LICENSE
URL: https://rmkruse.github.io/vennabers/, https://github.com/RMKruse/vennabers
NeedsCompilation: no
Language: en-US
Citation: vennabers citation info
Materials: README, NEWS
CRAN checks: vennabers results

Documentation:

Reference manual: vennabers.html , vennabers.pdf
Vignettes: Venn-Abers, Platt and isotonic calibration compared (source, R code)
Diagnose and assess calibration (source, R code)
Example scripts: manual calibration (source)
Example scripts: learned postprocessing (source)
Example scripts: Grid and Bayes selection (source)
Example scripts: training and frozen workflows (source)
Calibrating supplied predictions (source, R code)
Venn-Abers methods and their guarantees (source, R code)
Tuning and assessing the complete procedure (source, R code)
Training and freezing calibrated workflows (source, R code)

Downloads:

Package source: vennabers_1.0.0.tar.gz
Windows binaries: r-devel: vennabers_1.0.0.zip, r-release: not available, r-oldrel: not available
macOS binaries: r-release (arm64): vennabers_1.0.0.tgz, r-oldrel (arm64): vennabers_1.0.0.tgz, r-release (x86_64): vennabers_1.0.0.tgz, r-oldrel (x86_64): vennabers_1.0.0.tgz

Linking:

Please use the canonical form https://CRAN.R-project.org/package=vennabers to link to this page.