ArXiv

Ribbon: Scalable Approximation and Robust Uncertainty Quantification

Authors
Graham Gibson, John Tipton, Kellin Rumsey...
Categories
stat.ML, cs.LG
arXiv
https://arxiv.org/abs/2606.27269v1
PDF
https://arxiv.org/pdf/2606.27269v1

Brief

Ribbon (Gibson et al., arXiv 2026-06-25) targets scalable predictive uncertainty for complex or misspecified models by approximating the Dirichlet-reweighted bootstrap (Bayesian/weighted-likelihood bootstrap) via an influence-function linearization around a single fitted model, avoiding costly posterior sampling or repeated refits. It supports a tunable concentration parameter, matches Laplace asymptotics under correct likelihoods, recovers sandwich covariances under misspecification, and (per the abstract) improves calibration on benchmarks; full text was not provided here.

Why it matters

Ribbon (Gibson, Tipton, Rumsey, Klein; arXiv 2026-06-25) approximates Dirichlet-reweighted (Bayesian/weighted-likelihood) bootstrap by using an influence-function linearization around a single fitted model, replacing repeated refitting with post-hoc linear algebra.

Key details

  • Ribbon provides a calibrated Dirichlet-reweighting family with a general concentration parameter that can be tuned on validation data; it is asymptotically equivalent to a flat-prior Laplace approximation under correct likelihood specification and recovers the robust sandwich covariance under misspecification.
  • On synthetic regression, MNIST classification, and California Housing benchmarks Ribbon delivered competitive predictive performance and improved calibration in several settings while avoiding repeated model retraining.
Source evidence

Abstract

Reliably quantifying predictive uncertainty is difficult for complex, high-dimensional, or misspecified models. Both fully Bayesian and bootstrap resampling methods provide principled uncertainty estimates but are often too expensive for modern machine-learning models because they require posterior sampling or repeated model refitting. We introduce Ribbon, a scalable approximation to Dirichlet-reweighted bootstrap uncertainty. Ribbon replaces repeated refitting with an influence-function linearization around a single fitted model, preserving the first-order data-reweighting structure of the Bayesian bootstrap while requiring only post-hoc linear algebra. Ribbon approximates the Bayesian-bootstrap or weighted-likelihood-bootstrap refitting target. With a general concentration parameter, Ribbon gives a calibrated Dirichlet-reweighting family whose uncertainty scale can be tuned on validation data. We show that Ribbon is asymptotically equivalent to a flat-prior Laplace approximation under correct likelihood specification and recovers the robust sandwich covariance under misspecification. Across synthetic regression, MNIST classification, and California Housing benchmarks, Ribbon provides competitive predictive performance and improved calibration in several settings while avoiding repeated model retraining.