As someone who is on the top of some leaderboards just because I ID a specific genus that has a lot of observations, I share your situation to some extent. One approach I have taken is to write the extent of my expertise in my profile. If people tag me for things way outside that, I will sometimes write a brief comment (e.g., “Sorry, I really only know…” or just ignore the notifications without response. Since the person mentioning me didn’t really do their homework or invest much time in deciding who to mention, I don’t think it’s unjustified to invest little to no time in responding.
A similar thread with relevant content and links to other threads in the same vein:
https://forum.inaturalist.org/t/how-to-remove-myself-from-identification-leaderboards/65370