Yes, it's too delicate to handle this publicly.
Often times you can already judge by the form of the question if you should get involved.
Sufficient information provided? Signs of research done and attempts to self-solve? Professional and polite? If not, steer clear. Only points hunters will stay nevertheless.
Also quickly check the activity and content tab of the user, you can tell by the icon next to each question whether it was closed or not.
If you're a geek, you might be able to come up with a browser extension to show additional, user-based information (like dunce cap icons for your private black list...), I vaguely remember somebody doing this for the "old SCN" site.
Thomas