I'll defend you on this one! He is an easy target (as was pointed out in the OP) and people point to the clothes. IMO, It's not the clothes. It's the giant beer gut, and it's the fit of the loud clothes, and it's the plethora of giant Tin Cup logos all over the ill-fitting, loud clothes. You can wear loud clothes and look good. (I'm thinking of Billy Horschel last year with the blue pants that had monkeys or something all over them. I wouldn't be caught dead in those myself, but they looked cool on him.)
He (Daly) is a caricature of himself at this point.
I also don't get the hate for Poulter ... and by extension, Ricky Fowler. I get that they wear clothes that are really flashy, and that your average "regular golfer" is the opposite of flashy, but they have the BEST fashion sense of anybody on tour, not the worst.
To me, worst dressed does not mean "flashiest" or "most colorful," but rather it means "unkempt." If you wear a polo that comes untucked (hey, @jamo you know anybody who does that? ) and don't fix it, such that you're walking around all disheveled, or you wear pants too long or too short, or too tight or too baggy, those are signs of poor dressers.
Guys that try to be stylish are stylish. I don't care for the flat caps, but they certainly work for Ricky and Hunter. I really don't like the painters caps, but they work for Freddy and Ricky B.
In general, I think that most guys on tour are very well dressed. When you are at a tournament and walking around between holes or between the range and the course, any pro walks by you, even the no-name ones, they usually stand out, partially because of the tailored clothes they wear.