Be ready to play when it's your turn, play your shot, then move out. Stop screwing around with things that don't matter to the shot (cleaning clubs, marking scorecards, picking your nose, etc) unless you are waiting on someone else, and even then if you have the opportunity, then play your shot out of turn. Order of play is irrelevant. If you aren't ready to play when it's time to play, then you are the problem.
And don't worry about this silly 2 foot gimme suggested above. If you make my first paragraph your mantra, you will have plenty of time to putt out and play by the rules.