2026
Error Bounds for a Denoiser-Based Drift Estimator
Transactions on Machine Learning Research · 2026
Read abstract
Parameter estimation in stochastic differential equations is a classical statistical problem of much importance in many scientific fields. Recent work of Tapia Costa et al. (2026) introduced a novel technique for estimating the drift when the diffusion parameter is known, using discrete samples from multiple trajectories. Their method treats drift estimation as a denoising problem, and leverages tools from (conditional) score-matching diffusion models. Although their experiments showed promising results across different drift classes, the question of theoretical guarantees for their estimator was left unanswered. In this note, we address this gap by exploiting techniques from diffusion model theory. More concretely, we derive an explicit risk bound for the time-averaged mean-squared error of said drift estimator. Our bound decomposes the risk into the (i) Euler-Maruyama discretization, (ii) score/denoiser approximation, (iii) noise initialization, and (iv) sampling variance, revealing the trade-offs between the different hyperparameters and sources of error in the estimator.
2026
SPDE Methods for Nonparametric Bayesian Posterior Contraction and Laplace Approximation
Preprint · arXiv:2603.22468
Read abstract
We derive posterior contraction rates (PCRs) and finite-sample Bernstein von Mises (BvM) results for non-parametric Bayesian models by extending the diffusion-based framework of Mou et al. (2024) to the infinite-dimensional setting. The posterior is represented as the invariant measure of a Langevin stochastic partial differential equation (SPDE) on a separable Hilbert space, which allows us to control posterior moments and obtain non-asymptotic concentration rates in Hilbert norms under various likelihood curvature and regularity conditions. We also establish a quantitative Laplace approximation for the posterior. The theory is illustrated in a nonparametric linear Gaussian inverse problem.
2024
PAC-Bayes-Chernoff bounds for unbounded losses
Advances in Neural Information Processing Systems 37, 24350–24374 (NeurIPS 2024)
Read abstract
We introduce a new PAC-Bayes oracle bound for unbounded losses that extends Cramér-Chernoff bounds to the PAC-Bayesian setting. The proof technique relies on controlling the tails of certain random variables involving the Cramér transform of the loss. Our approach naturally leverages properties of Cramér-Chernoff bounds, such as exact optimization of the free parameter in many PAC-Bayes bounds. We highlight several applications of the main theorem. Firstly, we show that our bound recovers and generalizes previous results. Additionally, our approach allows working with richer assumptions that result in more informative and potentially tighter bounds. In this direction, we provide a general bound under a new model-dependent assumption from which we obtain bounds based on parameter norms and log-Sobolev inequalities. Notably, many of these bounds can be minimized to obtain distributions beyond the Gibbs posterior and provide novel theoretical coverage to existing regularization techniques.
2022
Dirichlet process mixture models for non-stationary data streams
2022 IEEE International Conference on Data Mining (ICDM), 873–878
Read abstract
In recent years, we have seen a handful of work on inference algorithms over non-stationary data streams. Given their flexibility, Bayesian non-parametric models are a good candidate for these scenarios. However, reliable streaming inference under the concept drift phenomenon is still an open problem for these models. In this work, we propose a variational inference algorithm for Dirichlet process mixture models. Our proposal deals with the concept drift by including an exponential forgetting over the prior global parameters. Our algorithm allows to adapt the learned model to the concept drifts automatically. We perform experiments in both synthetic and real data, showing that the proposed model is competitive with the state-of-the-art algorithms in the density estimation problem, and it outperforms them in the clustering problem.
2019
Compactness and Löwenheim-Skolem theorems in extensions of first-order logic
BSc thesis · Universitat de Barcelona
Read abstract
Lindström’s theorem characterizes first-order logic as the most expressive among those that satisfy the countable Compactness and downward Löwenheim-Skolem theorems. Given the importance of this results in model theory, Lindström’s theorem justifies, to some extent, the privileged position of first-order logic in contemporary mathematics. Even though Lindström’s theorem gives a negative answer to the problem of finding a proper extension of first-order logic satisfying the same model-theoretical properties, the study of these extensions has been of great importance during the second half of the XX. century: logicians were trying to find systems that kept a balance between expressive power and rich model-theoretical properties. The goal of this essay is to prove Lindström’s theorem, along with its prerequisites, and to give weaker versions of the Compactness and Löwenheim-Skolem theorems for the logic L(Q₁) (first-order logic with the quantifier "there exist uncountably many"), which we present as an example of extended logic with good model-theoretical properties.