This is probably the case in regions with lots of iNat users like the United States, New Zealand (?), and now South Africa, but my experience in South Korea is much different.
Observations of waterfowl and passerines tend to receive identifications quickly but when it comes to observations like arthropods things are quite different. Until @wongun joined the majority of my Hemiptera observations were at Needs ID and the same was true in other areas as well (Orthoptera/@taewoo, Zygoptera&Salticidae/@bio96, etc.) If my identifications/votes no longer counted on my own observations I would imagine more than 70% of my Research Grade arthropod observations would return to Needs ID. This isn’t a case of the observations leaving the pool after getting one ID and thus not being seen any more – those were observations that were in the pool for more than a year without getting IDs.
Another issue about votes and the majority of iNat users living in North America is that I occasionally end up with users trying to be helpful but adding incorrect identifications. For example, adding an ID of a North American species (no previous observations) instead of the similar-looking Asian species (previous observations). When asked about their reasons for the ID those users have often told me they didn’t bother looking at the range map and just went by appearance; however, in some cases the user never writes back and the ID stays there. I worry that removing the vote from the original submitter would mean that more of my observations get misidentified and it would take more work on my part to prevent that from happening. (e.g., I identify something as ‘European Beak’ but two other people say it’s ‘American Beak’. My ID counts for 0 so now it’s a Research Grade ‘American Beak’ observation until I go to DQA and check “Can community ID still be improved?”.)
I agree that there are problems with how easy it is for users to blindly agree with the IDs made by others but I do hope that any solution takes into account that there are areas in iNaturalist that don’t see the same attention from identifiers and would thus suffer from making the threshold too high.