I played TopFlight Syncho-Dyne irons from HS to mid college (8 years), switched to MacGregor MTs for 20 years, and then played Ping Eye2 clones(Pro Tour Blacks) for 14 years. Played Callaway X20s for two years, now play Callaway X20 Tours for last 5 years (but reshafted to something lighter than PX originals).
I switched when I had maturity or swing-change factors* which meant those irons no longer worked for me. Like, things that lessons and practice couldn't solve.
----------------------- *MTs are an exception. They were blades, and early 90s technology delivered irons much easier to hit.
I think that distance is important… to the point at which you're losing "too much" accuracy.
But that point is farther down the road than most people in your situation seem to think. I'd encourage you to film your swing and check out what flaw starts to exhibit itself from 9:00 to 11:00.
Also… check your 9:00 swing - it may be closer to 11:00 than you think, and your 11:00 swing may just be really long. Or you bend your left arm or something.