Real-time Computer Vision predictions in Seek by iNaturalist 2.0

I have noticed difficulty in identifying organisms as well, but that is to be expected, given the higher confidence that should be required to prevent misidentifications.

One thing that I think is resolvable though is when my camera is clearly pointed at something borderline identifiable. I notice the ID will swing back and forth from genus to species, and when I try to time my capture to get the species ID, I’m not always successful (due to lag in the realtime ID I assume).

I think you could introduce a tolerance into the realtime camera feature, so that it will look at the submitted image, compare it to the last second or two of previous ID data for that camera, and assuming the image is roughly of the same thing (ie, you haven’t quickly moved your camera from your dog to your cat in the meantime), it takes the most granular ID. This would mean even if the ID dropped slightly below the species threshold just as you pressed the button, it would still ID the organism as what the app was showing as the ID at the time you pressed the button.

As it is, I get to the point where it IDs to species level, then just continually click and hope

Zooming might also be helpful. While it won’t improve the quality of your subject in the image, it will help to add a boundary to what the CV classifies on (ie, the bird in the tree, and not the tree)

6 Likes