Use computer vision to annotate observations

It’s a bit of a vicious circle – to be able to recognize and annotate life stages correctly, the AI needs a suitable quantity of annotated material. So it seems to me that there is no way to avoid the necessity of humans annotating observations to start with.

Another issue is that it is currently not possible to correct annotations unless you are the observer or annotator. It seems to me that this would need to be fixed before any automatic AI annotation could be implemented. (I think automatic annotations would also need to have a different status than human-added ones, to make it possible to review them.)

For anyone who has not discovered this feature, the keyboard shortcuts in the Identify module are a reasonably fast way to add lots of annotations. There’s a tutorial here: https://forum.inaturalist.org/t/using-identify-to-annotate-observations/1417

(Given how much the CV struggles with hymenopterans, I wouldn’t trust the AI to annotate bees correctly, in spite of the fact that they often have distinct sexual dimorphism. I do, however, wonder whether incorporating annotations into the CV training might potentially result in improved suggestions – but again, this would require a suitably large annotated training set.)

6 Likes