You have to blend hybrids into your mix of clubs. Pay attention to shaft weight. Driver shaft is normally lightest, FW slightly heavier, and hybrids slightly heavier still.
If your Hs end up with lighter shafts than your FWs, you might have trouble feeling the H club "at the top" and dropping it into the slot consistently.
Note that different models of clubheads launch the ball differently. Initially I couldn't hit a hybrid to save my life, but I was just trying the wrong hybrids. Since then, I have found Callaway, Adams, Wilson, and Tour Edge Hs that I can hit quite well.
Also, consider mixing Hybrids with higher lofted 5W, 7W and 9W. Lots of enhancements in FWs the last two years. It just depends on what works.
I carry a 4W and 7W, and a 4H. The 7W carries about 200 yds., is great out of medium rough and for shots to elevated greens; the 4H carries about 185 yds., launches a bit lower, and is hotter out of light rough.