Platform(s): All platforms URLs: N/A Description of need: iNaturalist’s computer vision is getting better and better, but at different rates for different taxa in different areas. It would be excellent if researchers and community naturalists wishing to assess the reliability of CV-generated IDs …

[image] kjhung: Ultimately if iNaturalist could provide some sort of rating in the CV-guess suggestions to the extent of “we’re 82% sure it’s this species and 99% sure it’s in this genus” based on comparison of CV-guesses versus community-validated IDs, I think everyone would benefit. it’s no…

I’d like to see some kind of analysis and breakdown of the two separate components that lead to inaccuracy. One component is the intrinsic accuracy of the CV model for a particular group and the other is some assessment of accuracy of the data being used for training. In my area, mycology, there are…

These are all good points! I think there’s a lot that can be learned here if iNaturalist logs (1) what the CV suggestion is at the time of upload, (2) the CV score, and (3) the model(s) used to produce the suggestion and score. If these fields are exportable (not reliant on API), it would be even be…

[image] kjhung: @pisum do you know if these scores are currently being systematically logged and kept as part of the record’s permanent data? I’m almost certain they are not logged. The workflow is that the client (e.g. browser) sends the image to iNat’s CV engine and it returns a ranked list…

i think the computre should assign a taxon ID with very low weighting, like 0.01% weighting compared to a human ID, or that can’t count towards research grade. or even a separate field entirely. So one could peruse the map and sort by computer IDs as another field. Might not be doable, especially if…

[image] kjhung: @pisum do you know if these scores are currently being systematically logged and kept as part of the record’s permanent data? i’m fairly certain the suggestions are not being recorded by the system. however, there has been at least one effort by a community member to capture t…

[image] pisum: so you can see it’s hard, if not impossible, to really track all the variables that would affect the suggestions that come out of the CV. Hmm, that’s too bad. Although, even despite all the variables, I think it’s STILL helpful to record the CV suggestions, since it would be RE…

I’m not an admin, but, in general, some requests are easy and have a clear benefit and are made quickly. Some are large/challenging and may be declined after discussion by staff as impossible/not worth it. Many are challenging but staff think they would be interesting or beneficial, but would take …

[image] kjhung: Ultimately if iNaturalist could provide some sort of rating in the CV-guess suggestions to the extent of “we’re 82% sure it’s this species and 99% sure it’s in this genus” based on comparison of CV-guesses versus community-validated IDs, I wonder what a creator of the computer…

Since we have an extension that makes those percentages visible, it is already plumbed into iNat.

Log computer vision taxon guesses

Feature Requests

Topic		Replies	Views
Computer Vision should tell us how sure it is of its suggestions Feature Requests web , mobile-app	62	7576	October 11, 2024
Problems with Computer Vision and new/inexperienced users General	132	6217	October 28, 2021
Recommendations on improving the AI algorithm? General	47	1152	April 13, 2025
Do you rely more on humans or on iNaturalist's computer vision? General question	48	2066	March 11, 2023
Computer suggestion being ''too precise'' General	22	1379	January 24, 2024

Log computer vision taxon guesses

Related topics