afaik inat doesnt reset annotations from votes as of now? i guess u only saw correlation where owner of observation/annotator explicitly reset (so the only solution now is to mention those two). its popular pending request
You might be right ! Maybe a small bug that makes the annotation visually disappear when downvoting, but still there. I upvoted the pending request 
u can try Announcing the Universal Metadata Tool Beta for the time being
Thank you @einsum for taking time sharing this @megachile tool, it seems to be a nice workaround. I am going to try it !