I think by "rest of us", he meant nerdy, curious programmers. And not academic PHD mathematicians.

I don't know your background, maybe you are deep in the academic world, but if not, it's likely you are the "rest of us" he is addressing.