Do observers’ hands often in the photographs help the computer vision (as a scale object?, for example)

It’s important to remember that computer vision is not trained on the organism itself, but on photos of the organism which have been submitted to iNaturalist . So if photos of a species on iNat often have hands in them, the computer vision model will have been trained on photos that include hands.…

Hands are one way to provide scale for users to confirm IDs. Tiwane, that is an interesting effect that hands had on CV!

[image] clay_s: Tiwane, that is an interesting effect that hands had on CV! I should say it’s just a hypothesis, but quite likely the cause. Another interesting example happened when I used some Ramalina menziesii for a live demonstration at the California Academy of Sciences one night. It wa…

Only problem I see with hands in obs is, I would never be able to get away with a crime. Any authority will have lots of images of finger prints, palm prints etc. With the amount of my obs with my hands in, I better stay the right side of the law.

I sometimes used my hands as a focusing tool for things like spiders in webs, eg. https://www.inaturalist.org/observations/29563139 And of course I also occasionally use my hands to hold up flowers eg. https://www.inaturalist.org/observations/39072540 It’s really just to make the picture “good e…

so did you happen to think that the Computer vision has learned to use the images of hands as a reference for color and size, thereby making correct IDs faster (working more efficiently)?

I’m not sure to be honest. I feel that at least if I make a better photo using my hand as a focusing tool then it would in general more likely to be reaching RG quality. If there are more RG photos for a particular species the computer vision has access to then I think it can make a more reliable su…

I would err on the side of taking a photo which another human identify, and a lot of times holding a flower is the easiest way to do that, especially for a smart phone camera. Don’t worry too much about how it will affect the machine learning.

Hands in observations

General

bobasil March 19, 2020, 10:36pm 3

I’ve seen observations of yellow flower’s petals held between an observer’s fingers, making it all look like a butterfly or a whimsical flower, yet the computer vision was the one IDing the flower correctly.

Topic		Replies	Views
Could CV be learning hand/fingerprints? General question	18	1589	September 29, 2022
Fingers in photos General	169	9767	February 4, 2023
What species should be identified? General question	19	1267	January 14, 2024
Proper Identification after computer ID General web , question , ios-classic-app , identification	14	1070	October 8, 2022
What Image(s) Are Used for "Training" Computer Vision? General	16	3513	May 24, 2019

Hands in observations

Related topics