How does a simulation learn its parameters from data?

By streaming the data in as a state partition, turning it into probabilities, and scoring simulation trajectories against them. If we want to learn the parameters which correspond to simulation trajectories fitting real-world data trends more closely, it is natural to use an objective based on the probabilities of state partition histories.

We start by streaming time-series data into our simulation by specifying it as a state partition.

We can then use a method to estimate the probabilities of state values within the data, e.g., probabilistic sample weighting.

So we have a way to calculate these ‘data probabilities’ for any possible state values the data can take in time.

By then evaluating these data probabilities at the points which coincide with simulation trajectories, we have an objective which quantifies how close the simulation is to the data.

When talking about different values for this objective, we often use the terminology ‘quality of fit’ or ‘fit to the data’ to describe how close the simulation is to replicating the data, and hence how good the value of the objective is.

References and further reading

Cranmer, Kyle, Johann Brehmer, and Gilles Louppe. 2020. “The Frontier of Simulation-Based Inference.” Proceedings of the National Academy of Sciences 117 (48): 30055–62. https://doi.org/10.1073/pnas.1912789117.
Gordon, Neil J., David J. Salmond, and Adrian F. M. Smith. 1993. “Novel Approach to Nonlinear/Non-Gaussian Bayesian State Estimation.” IEE Proceedings F (Radar and Signal Processing) 140 (2): 107–13. https://doi.org/10.1049/ip-f-2.1993.0015.
Hardwick, Robert J. 2025. “What objective does a simulation learn against?” umbralcalculations, December. https://umbralcalc.github.io/posts/what_objective_does_a_simulation_learn_against.html.
Hardwick, Robert J. 2026a. “What is a state partition?” umbralcalculations, November. https://umbralcalc.github.io/posts/what_is_a_state_partition.html.
Hardwick, Robert J. 2026b. “Why should I simulate the real world?” umbralcalculations, May. https://umbralcalc.github.io/posts/why_should_i_simulate_the_real_world.html.