JMJan-Willem van de Meent

Jan-Willem van de Meent

*This is an algorithmically generated author record based on publicly available information.

Current Organizations / Institutes

The organizations/institutes from the scholar's latest article

Previous Organizations / Institutes

The organizations / institutes from the scholar's other articles in the past ten years


Jan-Willem van de Meent has a total of 89 co-authors. Here are the top co-authors by number of shared publications:


Latest Publications

  • Open Access

    Learned free-energy functionals from pair-correlation matching for dynamical density functional theory

    by Karnik Ram, Jacobus Dijkman, René van Roij, Jan-Willem van de Meent, Bernd Ensing, Max Welling, Daniel Cremers

    Classical density functional theory (cDFT) and dynamical density functional theory (DDFT) are modern statistical mechanical theories for modeling many-body colloidal systems at the one-body density level. The theories hinge on knowing the excess free-energy accurately, which is, however, not feasible for most practical applications. Dijkman [] recently showed how a neural excess free-energy functional for cDFT can be learned from bulk simulations via pair-correlation matching. In this article, we demonstrate how this same functional can be applied to DDFT, without any retraining, to simulate nonequilibrium overdamped dynamics of inhomogeneous densities. We evaluate this on a three-dimensional Lennard-Jones system with planar geometry under various complex external potentials, and we observe good agreement of the dynamical densities with those from expensive Brownian dynamic simulations, up to the limit of the adiabatic approximation. We further develop and apply an extension of DDFT based on gradient flows to a grand-canonical system modeled after breakthrough gas adsorption studies, finding similarly good agreement. Our results demonstrate a practical route for leveraging learned free-energy functionals in DDFT, paving the way for accurate and efficient modeling of many-body nonequilibrium systems.


  • Learning Neural Free-Energy Functionals with Pair-Correlation Matching

    by Jacobus Dijkman, Marjolein Dijkstra, René van Roij, Max Welling, Jan-Willem van de Meent, Bernd Ensing

    The intrinsic Helmholtz free-energy functional, the centerpiece of classical density functional theory, is at best only known approximately for 3D systems. Here we introduce a method for learning a neural-network approximation of this functional by exclusively training on a dataset of radial distribution functions, circumventing the need to sample costly heterogeneous density profiles in a wide variety of external potentials. For a supercritical Lennard-Jones system with planar symmetry, we demonstrate that the learned neural free-energy functional accurately predicts inhomogeneous density profiles under various complex external potentials obtained from simulations.


  • Open Access

    Entropy Coding of Unordered Data Structures

    by Julius Kunze, Daniel Severo, Giulio Zani, Jan-Willem van de Meent, James Townsend

    We present shuffle coding, a general method for optimal compression of sequences of unordered objects using bits-back coding. Data structures that can be compressed using shuffle coding include multisets, graphs, hypergraphs, and others. We release an implementation that can easily be adapted to different data types and statistical models, and demonstrate that our implementation achieves state-of-the-art compression rates on a range of graph datasets including molecular data.

  • Open Access

    Towards Reducing Diagnostic Errors with Interpretable Risk Prediction

    by Denis Jered McInerney, William Dickinson, Lucy C. Flynn, Andrea C. Young, Geoffrey S. Young, Jan-Willem van de Meent, Byron C. Wallace

    Many diagnostic errors occur because clinicians cannot easily access relevant information in patient Electronic Health Records (EHRs). In this work we propose a method to use LLMs to identify pieces of evidence in patient EHR data that indicate increased or decreased risk of specific diagnoses; our ultimate aim is to increase access to evidence and reduce diagnostic errors. In particular, we propose a Neural Additive Model to make predictions backed by evidence with individualized risk estimates at time-points where clinicians are still uncertain, aiming to specifically mitigate delays in diagnosis and errors stemming from an incomplete differential. To train such a model, it is necessary to infer temporally fine-grained retrospective labels of eventual "true" diagnoses. We do so with LLMs, to ensure that the input text is from before a confident diagnosis can be made. We use an LLM to retrieve an initial pool of evidence, but then refine this set of evidence according to correlations learned by the model. We conduct an in-depth evaluation of the usefulness of our approach by simulating how it might be used by a clinician to decide between a pre-defined list of differential diagnoses.


  • Open Access

    Towards Reducing Diagnostic Errors with Interpretable Risk Prediction

    by Denis McInerney, William Dickinson, Lucy Flynn, Andrea Young, Geoffrey Young, Jan-Willem van de Meent, Byron C. Wallace

    Denis McInerney, William Dickinson, Lucy Flynn, Andrea Young, Geoffrey Young, Jan-Willem van de Meent, Byron Wallace. Proceedings of the 2024 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (Volume 1: Long Papers). 2024.


  • Open Access

    String Diagrams with Factorized Densities

    by Eli Sennesh, Jan-Willem van de Meent

    A growing body of research on probabilistic programs and causal models has highlighted the need to reason compositionally about model classes that extend directed graphical models. Both probabilistic programs and causal models define a joint probability density over a set of random variables, and exhibit sparse structure that can be used to reason about causation and conditional independence. This work builds on recent work on Markov categories of probabilistic mappings to define a category whose morphisms combine a joint density, factorized over each sample space, with a deterministic mapping from samples to return values. This is a step towards closing the gap between recent category-theoretic descriptions of probability measures, and the operational definitions of factorized densities that are commonly employed in probabilistic programming and causal inference.

  • Open Access

    Topological Obstructions and How to Avoid Them

    by Babak Esmaeili, Robin Walters, Heiko Zimmermann, Jan-Willem van de Meent

    Incorporating geometric inductive biases into models can aid interpretability and generalization, but encoding to a specific geometric structure can be challenging due to the imposed topological constraints. In this paper, we theoretically and empirically characterize obstructions to training encoders with geometric latent spaces. We show that local optima can arise due to singularities (e.g. self-intersection) or due to an incorrect degree or winding number. We then discuss how normalizing flows can potentially circumvent these obstructions by defining multimodal variational distributions. Inspired by this observation, we propose a new flow-based model that maps data points to multimodal distributions over geometric spaces and empirically evaluate our model on 2 domains. We observe improved stability during training and a higher chance of converging to a homeomorphic encoder.

  • Open Access

    CHiLL: Zero-shot Custom Interpretable Feature Extraction from Clinical Notes with Large Language Models

    by Denis Jered McInerney, Geoffrey Young, Jan-Willem van de Meent, Byron C. Wallace

    We propose CHiLL (Crafting High-Level Latents), an approach for natural-language specification of features for linear models. CHiLL prompts LLMs with expert-crafted queries to generate interpretable features from health records. The resulting noisy labels are then used to train a simple linear classifier. Generating features based on queries to an LLM can empower physicians to use their domain expertise to craft features that are clinically meaningful for a downstream task of interest, without having to manually extract these from raw EHR. We are motivated by a real-world risk prediction task, but as a reproducible proxy, we use MIMIC-III and MIMIC-CXR data and standard predictive tasks (e.g., 30-day readmission) to evaluate this approach. We find that linear models using automatically extracted features are comparably performant to models using reference features, and provide greater interpretability than linear models using "Bag-of-Words" features. We verify that learned feature weights align well with clinical expectations.

  • Deriving Time-Averaged Active Inference from Control Principles

    by Eli Sennesh, Jordan Theriault, Jan-Willem van de Meent, Lisa Feldman Barrett, Karen Quigley


  • Top Cited Papers
    Open Access

    CHiLL: Zero-shot Custom Interpretable Feature Extraction from Clinical Notes with Large Language Models

    by Denis McInerney, Geoffrey Young, Jan-Willem van de Meent, Byron C. Wallace

    Denis McInerney, Geoffrey Young, Jan-Willem van de Meent, Byron Wallace. Findings of the Association for Computational Linguistics: EMNLP 2023. 2023.