I was the exact same way. It has gotten better with time, but for me I had to just walk away from the game several times. Like me you probly want to be perfect at the game and that's just not realistic. Look how many times the pros hit there ball in OB, and they are the best in the world.
I've also realized no one like playing with that guy. >(gets mad guy).