I don't like to hit drivers or woods out of a stall. It's just a personal thing.
Can holes cause aiming problems? Yes. Most courses have a couple of holes where the vector of the tee-box rectangle will point you into the treeline, or into the lake on the left rather than the fairway.
Sometimes this done by accident, sometimes on purpose, according to golf course design articles. Some architects think it's cruel, others think it's a clever deception that makes the player think before hitting.
St. Louis has the 9-hole TripleA-Highlands course in Forest Park. Hole No. 3 is a 350-yd. par 4, slight dogleg right. When I played it last summer, and my partner and I both clipped the right edge of the treeline with our drives. Before we went forward, I placed my driver down in the center of the tee box. The driver pointed about three yards deep into the treeline. So, you would need to aim at a 45-degree angle left on the tee box to hit the fairway.
Don't get hung up in psychosomatic unless you're going to turn pro - you'll get so tight worrying about things you can't swing. Just find what works, and go with it.