Importance Sampling, Trivialized

Algebraic manipulation is always a fun way to make something profound seem like mere trickery.

We’ll derive importance sampling by showing how it reduces to multiplying and dividing by the same thing (and is therefore equivalent because we just multiplied by 1).

We have some random variable with PDF that we want to take the expectation of. My notation will be sloppy except where it counts.

We now introduce another PDF . By multiplying and dividing by it, we can get an expectation with respect to instead of .

Remembering the trick makes it easy to re-derive thankfully. I never remember it and had to do this derivation twice in the 10 minutes it took to write.

Related Posts

e-ink reminisces

Edwin Edwards

Middle School by Bo Burnham

How to Disable Disqus Ads on your Blog

Derivation of Reservoir Sampling

Fun with Python Iterators: Linked Lists Made Easy

Notes for November 11, 2018

Underrated Vim Option: undofile and undodir

Hot Take on Solo Travel: Starve

Alan Perlis