Well if you feel that you do, have a look at this..
Ladies flex will just increase the launch angle and backspin. It would not decrease the ball speed that much. Well it would a tad because smash factor decreases as loft increases.
In the grand scheme of things, flex only really helps fine tune in spin and launch angle. The reason most pros use low lofted drivers is because they produce too much backspin. So they need a stiff flex heavy golf shaft, low loft, then they hit down on the ball. If you hit up on the ball you can use a slightly higher lofted, few degrees at most.
A right golf shaft can take the dynamic loft down 2-3 degrees and take off 1000-1500 rpm. Though Gorilla James does hit up on the ball, so that helps out a ton. That pretty much will help cap his backspin. If he hit down with the ladies flex, I think he would have lost a ton of distance.
Point being, its the swing more than the equipment. Every golfer is going to have their max and min values depending on the club and loft, but it isn't that huge of a thing. Most golf fitters will just try to mask the golfer's problems by giving them a supped up club to take the numbers down to optimal conditions. Even then, their contact position changes so much, it doesn't matter.