In this lecture, we first cover some discrete distributions (and the Poisson process) that we ran out of time for during the previous lecture. We then launch into a discussion of how to generate pseudo-random numbers distributed uniformly between 0 and 1 (which are necessary for us to easily generate random variates of any distribution). We talk about the two most important properties of a pseudo-random number generator (PRNG), uniformity and independence. We then talk about desirable properties. Some examples are given of some early PRNG's, and then we introduce the linear congruential generator (LCG) and its variants (like the Combined Linear Congruential Generator, CLCG), which represent a much more modern PRNG that has a number of good properties. We close with a discussion of tests of uniformity. We will continue this discussion and add on tests for independence during next lecture (which will primarily cover random-VARIATE generation).
Students may wish to follow up by checking out the Pseudo-Random Number Generators and AI Watermarking concept explorer, which covers LCG's, CLCG's, and the more modern MRG approach to PRNG. It also covers methods for AI watermarking of stochastic outputs, like the ones that are now used in large language models like Gemini and Claude.
No comments:
Post a Comment