In this lecture, we review summary statistics, MLE, and goodness-of-fit tests (particularly Chi-square and Kolmogorov–Smirnov, with some mention of Anderson–Darling and Shapiro–Wilk), with a particular focus on the type-I error, type-II error, and statistical power. We then introduce verification, validation, and calibration of simulation models and close with an example for the simulation of a bank. We use rigorous statistical methods to drive the calibration process that leads to updating the model of the bank and ensuring its outputs are a good statistical match for outputs in a real bank. This involves making use of a power analysis for a one-sample, two-sided t-test. We will cover the paired t-test version of this problem in the next lecture.
Archived lectures from undergraduate course on stochastic simulation given at Arizona State University by Ted Pavlic
Tuesday, October 26, 2021
Lecture H (2021-10-26): Verification, Validation, and Calibration of Simulation Models
Subscribe to:
Post Comments (Atom)
Popular Posts
-
In this lecture, we go over course policies for the Fall 2022 session of IEE 475.
-
In this lecture, we wrap up the course content in IEE 475. We first do a quick overview of the four variance reduction techniques (VRT's...
-
In this lecture, we introduce the three different simulation methodologies (agent-based modeling, system dynamics modeling, and discrete eve...
-
This lecture section is a cumulative review of material from the semester and is meant to serve as a study guide for students preparing for ...
-
Today's lecture covers the basics of probability (including introduction to measure spaces) and random variables. We also go over some r...
-
In this lecture, we (nearly) finish our coverage of Input Modeling, where the focus of this lecture is on parameter estimation and assessing...
-
In this lecture, we continue to discuss hypothesis testing -- introducing parametric, non-parametric, exact, and non-exact tests and reviewi...
-
This lecture continues to discuss issues related to estimating absolute performance from transient and steady-state simulations (of terminat...
-
In this lecture, we review fundamentals of Discrete Event System (DES) simulation (e.g., entities, resources, activities, processes, delays,...
-
In this lecture, we introduce Industrial and Systems Engineering as a blend of science and engineering that necessitates model building. We ...
No comments:
Post a Comment