Adding `pred_measure` feature - #363

Draft

florence-bockting wants to merge 67 commits into

Commits on Jul 2, 2026

feat: add predictive performance measures as pred_measure* family
Florence Bockting
committed
1c5d871
feat: update print method for new pred_measure* family
Florence Bockting
committed
bad8062
feat: deprecate loo functions in favor of new pred_measure family
Florence Bockting
committed
6d404e1
tests: update tests for deprecated functions
Florence Bockting
committed
f5854c2
docs: add migration guide to loo package
Florence Bockting
committed
c42c803
docs: update documentation for new pred_measure functions and deprecated functions
Florence Bockting
committed
7750200
chore: update DESCRIPTION, NAMESPACE, NEWS and _pkgdown
Florence Bockting
committed
1926429

Commits on Jul 3, 2026

tests: add test data
Florence Bockting
committed
02ecbbb
tests: add unit tests for pred_measure function family
Florence Bockting
committed
a24fee1
fix: update elpd and fix typo in .compute_base_measure
Florence Bockting
committed
3a670cf
fix:update measure names in .validate_control
Florence Bockting
committed
439867e
docs: add vignettes for new predictive preformance measure
Florence Bockting
committed
883dda0
docs: add/update cross-references to vignettes
Florence Bockting
committed
755984d
chore: add data fitting to CI and avoid committing large data files
Florence Bockting
committed
b260a32
chore: add cli to Imports and lme4 to Suggests
Florence Bockting
committed
082d7be
fix: minor fixes
Florence Bockting
committed
e394c30
chore: add developer-notes
Florence Bockting
committed
e9f1a3a
add print method of test_pred_measure
Florence Bockting
committed
cf0c79b
chore: update developer-notes and add old-vs.-new API comparison
Florence Bockting
committed
5cb9f10
fix: small fixes to pass test checks
Florence Bockting
committed
562b141
Merge branch 'loo-v3.0.0' into pred_measure
florence-bockting
authored
023add0

Commits on Jul 4, 2026

tests: update snapshots
Florence Bockting
committed
8346344

Commits on Jul 6, 2026

tests: add snapshots for pred_measure_builtin
Florence Bockting
committed
e99aeac
refactor: add class loo to loo_pred_measure
Florence Bockting
committed
884df6e

Commits on Jul 7, 2026

docs: update pkg-info
Florence Bockting
committed
b924ac5

Commits on Jul 8, 2026

refactor: rename revert_sign arg to higher_is_better
Florence Bockting
committed
f64cf6c
docs: update renaming arg to higher_is_better
Florence Bockting
committed
441f0ea
tests: update renaming to higher_is_better
Florence Bockting
committed
b0015c7
chore: update renaming higher_is_better argument
Florence Bockting
committed
076e2c7

Commits on Jul 16, 2026

Merge branch 'loo-v3.0.0' into pred_measure
florence-bockting
authored
674746e

Commits on Aug 28, 2026

Commits on Aug 30, 2026

fix: computation of weights for (s)rps
Florence Bockting
committed
b0f94cb
fix: refactor computation of ic and mlpd
Florence Bockting
committed
7184cae
fix: computation of weights for (s)rps
Florence Bockting
committed
91f251a
tests: add tests for mlpd, ic, and updated weigts for (s)rps
Florence Bockting
committed
757021e
fix: check equality of log_weights from loo and psis_object
Florence Bockting
committed
f08afcc
fix: pass name of measures correctly
Florence Bockting
committed
806600b
review: add guards for potential silent failures
Florence Bockting
committed
0c85ba8
fix: kfold diagnostics, dims on update, reuse stored log_weights
Florence Bockting
committed
d0b52fa
fix: bacc pointwise path, dims after 3-D conversion, duplicate filter
Florence Bockting
committed
1b1d050
fix: error on group_ids until grouped summaries exist
Florence Bockting
committed
8c46b00
refactor: extract .lppd_from_inputs() from elpd, mlpd and ic
Florence Bockting
committed
e74df04
refactor: extract .acc_pointwise() from acc and bacc
Florence Bockting
committed
b3a7db7
refactor: extract .point_error_from_inputs() from mae and mse
Florence Bockting
committed
12133b8
refactor: read the source from the attribute, reuse .measure_estimate_se()
Florence Bockting
committed
bd67f6a
refactor: print the Pareto k table with pareto_k_table()
Florence Bockting
committed
ef914d8
refactor: remove dead code and correct the .compute_measure() roxygen
Florence Bockting
committed
f79c4f8

Commits on Aug 31, 2026

fix: label rps as a loss and srps as a utility in .measure_spec
Florence Bockting
committed
4882727
docs: correct the ic, mse/rmse/r2 and CRPS reference entries
Florence Bockting
committed
ffa1786
docs: correct the acc and bacc definitions in overview-measures
Florence Bockting
committed
fa95ff7
docs: document the PWM estimator that the crps and scrps code uses
Florence Bockting
committed
29072e6
docs: state that rps and srps take draws, not class probabilities
Florence Bockting
committed
294f87a
docs: correct the measure keywords and the weighted path in overview-measures
Florence Bockting
committed
8a9a8e2
docs: fit the workflow vignette's models in the article
Florence Bockting
committed
6db2531
docs: correct the pred-measure-workflow object and measure tables
Florence Bockting
committed
f0715be
docs: state the Pareto-k threshold as sample-size dependent
Florence Bockting
committed
7ffedf6
docs: drop the devtools and dplyr dependencies from the articles
Florence Bockting
committed
4dd743c
tests: shrink the pred_measure fixtures to fit the CRAN limit
Florence Bockting
committed
0a3ecbb
tests: fix the normalized-log-weights test reading a missing field
Florence Bockting
committed
919b29b
tests: drop two fixture fields that nothing reads
Florence Bockting
committed
b5952b7

Commits on Sep 17, 2026

refactor: remove elpd as 'base measure'
Florence Bockting
committed
791ed25
fix: update old function description and ensure correct Roxygen version
Florence Bockting
committed
dc49cd1
docs: update vignette about measure overview
Florence Bockting
committed
cb93257

Commits on Sep 18, 2026

docs: initial version of pred_measure workflow vignette
Florence Bockting
committed
22d1422
Merge branch 'loo-v3.0.0' into pred_measure
florence-bockting
authored
c1d75f8
Merge branch 'pred_measure' of https://github.com/stan-dev/loo into pred_measure
Florence Bockting
committed
0e7d193