Yeah, a "patent office guy" who knew nothing about physics at all until he suddenly overturned the entire world through sheer force of will. Certainly not a guy who already wanted to be a physics teacher with all the requisite training and credentials, including published papers in prestigious journals in his first year of working in the patent office, but had to find a job to make money in the meantime while he searched for one.
Einstein was someone who went up the academic course for physics, but had a brief detour during a jobless interval. I imagine many of us here can relate to that. He's not some sort of quintessential outsider.
(He's not a quintessential insider either; while the rumors about his poor grades are overstated, he did have a rough relationship with any academic subject he didn't really care about. He certainly wasn't the valedictorian type or a groomed, perfect academic from tip to toe. But neither was he an outsider. He's just an average everyday genius who combined tons of hard work with immense native talent.)
Here we're talking about people who aren't even in the same system!