Generally yes. Taller guys just have an advantage because they swing on a bigger arc.
Velocity = Radius x Angular Velocity
So as radius increases the velocity at the end of the circle increases. Taller players have longer arms so they can swing the club faster with less angular velocity. This is why Rory has to have some of the fastest hips on tour, he's only 5'8" tall compared to Dustin Johnson's 6'3" tall.
Re: Dustin, another thing that allows him to hit far, is his extension at the top, it's like he's pushing the club as high as he can. look at pic's of him at the top vs some other players, his club is way up there, and he does other things well too. I agree, a bigger arc is going to have more velocity, but it's not always a given for players to hit it far.