When I first started playing golf I was behind a foursome of young guys (maybe 19 to 21 years old). In front of them was a single that was obviously a beginner (and slow).
As I pulled up to a tee box on a drivable par 4 the single was down on the green and the foursome were hitting at him. As soon as they would hit they would yell "Fore" and the guy on the green would run to the side under a tree. When he would come back out to putt they would hit at him again and he would run under the tree again.
None of it was any of my business but I couldn't resist telling them that it was a good thing that wasn't me down there on that green.
He said "We have golf clubs to take care of him if he wants to fight."
I said yeah, and he just might have something in his car just a little more powerful than a golf club.
One of them said "Yeah that might be right" and they stopped hitting at him.
Funny thing was that I didn't know any of those kids but I do now. They are all excellent golfers and really nice guys.
If I didn't know I would think they would have never done anything like that when they were younger because it would be totally out of character for them now.
BTW. I honestly don't know what I would have done in the OP's situation. Just depends on what I thought the intent was.