Take a look at the attached screenshot. The observation photo is clearly of a mite. However, the AI suggestions don’t include any mites, and instead include mostly aquatic invertebrates that don’t look anything like mites. After looking through the observations of the suggested organisms it quickly …

[I moved this to general as it isn’t a bug]

when the prompt above the suggestions says we’re not confident, you should believe the prompt. “top” suggestions doesn’t always mean good suggestions. it could just be the least bad suggestions.

There is still a lot of work to be done by observers and identifiers until the AI will become totally reliable some day. Speaking from own experience, the core problem with the iNat AI goes something like this: 99 out of 100 times the AI correctly identifies a mediterranean goby to species level (s…

[image] "rare" captive species remember, the CV is trained to recognize photos of an organism, not the actual organism itself. The CV simply can’t be trained to recognize all the various types of ex situ backgrounds.

[image] stefadrian: There is still a lot of work to be done by observers and identifiers until the AI will become totally reliable some day. This kind of machine learning will never be totally reliable, no matter how many observers and identifiers contribute. The larger and more correct the d…

Although there are certain things that can be tweaked in the algorithm to help minimise this problem to an extent, this is just a downside of the way this type of AI works. For shorthand, we say “the AI thinks the organism in your photo is X” but that misrepresents what’s really happening; more prop…

[image] stefadrian: but every 100th time the AI mistakes a fish for a bird This sums up the definition of AI so beautifully.

This happens a lot with plant-bug pairs, a specific example being the Dogbane Leaf Beetle. Uploading a photo of dogbane will often suggest the DBLB. It’s pretty funny, IMO.

Totally! I always take the AI suggestions with a grain of salt especially in cases where it says it’s not confident. I don’t expect the AI to be perfect, but I thought this might be a useful example for investigating ways to further improve the AI.

I had to smile when I saw this post. AI recognises patterns. If you train the AI with the same background pattern, the background becomes part of the identification. A story I heard was about AI being used for tank recognition but unfortunately all the images were taken with clear blue sky and so …

AI matching to background color instead of organism

General

luckilucki November 10, 2023, 3:15pm 14

Could you please elaborate what you mean by that? I’m quite new to this field and look into species and contexts on images right now.
Would be much appreciated! Thanks! :)

Topic		Replies	Views
The AI algorithm - confusing pathogen/host or subject/background General	18	1691	January 20, 2022
Did something change with the AI? General question	20	2530	March 12, 2021
"Helping" the computer vision - is this wrong? General	36	2794	July 12, 2020
Workings of iNat Artificial Intelligence (AI) aka Computer Vision (CV) General	28	2535	March 16, 2022
Artificial intelligence and misidentifications General	18	2312	December 5, 2019

AI matching to background color instead of organism

Related topics