From a clubmaker point of view, here is a possible suggestion.
You will have to experiment with this change to see if it works for you. Remember, we are all unique and what works for one will not work for another.
The driver, being the longest club in the bag is the hardest to control. Sometimes it's the inability to close the face to square at impact and/or feel comfortable doing an inside to out swing.
If the driver is off the shelf, then it simply may not be the best fit for you.
But try this: get some lead tape. Wrap a whole bunch of it around the very end of the butt end of the handle. You will have to experiment with how much. Then try swinging your driver on the range. This counterbalance may help you feel the handle and as a result help you feel in an inside to out swing and close the face at impact. And many times it will produce more solid and consistent shots. If it does help, then find a clubmaker who can add the weight inside the butt end.
This is what club fitting is all about...finding what works and fits the player.
Hope this helps!
Rick
Columbus, Ohio
www.GolfClubPlayability.com