# New Computer Vision Model Released **URL:** \ **Category:** News and Updates\ **Created:** [April 12, 2022, 8:51pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030 "2022-04-12T20:51:13Z")\ **Posts on this page:** 20\ **Page:** 3
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [April 17, 2022, 7:08pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/41 "2022-04-17T19:08:29Z")
![Screen Shot 2022-04-17 at 11.51.54 AM](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/7/f/7fa0244ca1a6d7fd14afb91fe3e9b02eb08f4780.png) Unless I’m misunderstanding, this doesn’t seem to be an example of the case you mentioned - where the model suggests “we’re pretty sure it’s in genus X” but then the top suggestion is “species Y” where Y is not a member of X. Thanks to the example you found, we now know that this can happen in cases with the seen nearby filter active, which is really helpful. I’m interested if it happens in other cases as well, since this could be a bug in the code or a problem in our algorithm. ---
**Author:** ![DianaStuder](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dianastuder/32/43358_2.png) [@DianaStuder](https://forum.inaturalist.org/u/DianaStuder)\ **Post date:** [April 17, 2022, 7:12pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/42 "2022-04-17T19:12:10Z")
Toggle to seen nearby? None of the ‘ **not** seen nearby’ IDs are right. Unless it is a cultivated garden plant, I will use seen nearby as it helps to avoid Northern (wrong) suggestions. ---
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [April 17, 2022, 7:41pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/43 "2022-04-17T19:41:48Z")
Ah, gotcha, I misunderstood, thanks! So this is indeed the problem, where we say "we’re pretty sure it’s in genus X” but then the top suggestion is “species Y” where Y is not a member of X, but I think it’s the same problem you identified earlier. I think the issue here is that we compute the “common ancestor” from the computer vision results, and that’s what we show in the “we’re pretty sure it’s in rank X.” We then use the common ancestor as a starting point to augment the vision results with geo frequency data. Ken-ichi explains it here, starting at the 16 minute mark: [https://www.youtube.com/watch?v=xfbabznYFV0](https://www.youtube.com/watch?v=xfbabznYFV0). As you can imagine, if the vision results are really wrong (as can happen), then we may end up with a really wrong common ancestor, and that throws the rest of the algorithm off. I think that’s what we’re seeing here. We are working on improving our approach to incorporating geo frequency data with vision results, but it might take a while before we can launch that. In the meantime, I’ll see if there’s anything we can do in edge cases like this. Perhaps we could update the wording to say something like “it looks like genus X, but **that is not typically seen nearby**. here are our top suggestions that **are seen nearby**.” ---
**Author:** ![DianaStuder](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dianastuder/32/43358_2.png) [@DianaStuder](https://forum.inaturalist.org/u/DianaStuder)\ **Post date:** [April 17, 2022, 7:50pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/44 "2022-04-17T19:50:34Z")
Yes please for rewording. The Santolina example needs a new line between pretty sure and suggestions. Visual match to the right **species** , which is not seen nearby. Then followed by the hopeful suggestions. ---
**Author:** ![DianaStuder](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dianastuder/32/43358_2.png) [@DianaStuder](https://forum.inaturalist.org/u/DianaStuder)\ **Post date:** [April 18, 2022, 12:13pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/45 "2022-04-18T12:13:59Z")
@alex In the few years I’ve been on iNat I have seen CV improve for our Cape Town fynbos (many obs, many IDs) Which motivates me to work thru Unknowns for the Rest of Africa. Can you tell us how many species you added for Africa with this model? ---
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [April 18, 2022, 2:59pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/46 "2022-04-18T14:59:56Z")
I can’t do this directly so I’ll have to ask for help from my co-workers to see if we can find an easy way to do it. Part of what’s hard to figure out here is that many of the taxa that appear to have been added to the model are actually just taxonomic churn - taxon A was replaced by taxon B, or split into taxon C and D. I don’t think we have programmatic ways of processing the taxon change history, so it’ll require a ton of bookkeeping. I’ll let you know if we can figure out a way to tease out the true number of new species. ---
**Author:** ![sbushes](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/sbushes/32/8217_2.png) [@sbushes](https://forum.inaturalist.org/u/sbushes)\ **Post date:** [April 18, 2022, 3:03pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/47 "2022-04-18T15:03:18Z")
> [@alex](#): > > I’m interested if it happens in other cases as well, since this could be a bug in the code or a problem in our algorithm. I made 130 observations yesterday and I noted this was visible in 4 of the autosuggests. As with @DianaStuder’s example, bug only visible when toggled to “seen nearby”. ---
**Author:** ![fluffyinca](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/fluffyinca/32/10786_2.png) [@fluffyinca](https://forum.inaturalist.org/u/fluffyinca)\ **Post date:** [April 18, 2022, 11:27pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/48 "2022-04-18T23:27:50Z")
![Screenshot (2)](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/f/9/f94dec05ff36db55737e93f84749d49303035104.png) (However, the first suggestion was _Amphineurus_ when I included suggestions not seen nearby.) ---
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [April 18, 2022, 11:28pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/49 "2022-04-18T23:28:40Z")
thanks, can you share the photo or an observation made from it? ---
**Author:** ![fluffyinca](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/fluffyinca/32/10786_2.png) [@fluffyinca](https://forum.inaturalist.org/u/fluffyinca)\ **Post date:** [April 18, 2022, 11:29pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/50 "2022-04-18T23:29:49Z")
@alex [https://www.inaturalist.org/photos/189112516](https://www.inaturalist.org/photos/189112516) ---
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [April 19, 2022, 12:21am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/51 "2022-04-19T00:21:06Z")
Thanks! ---
**Author:** ![thebeachcomber](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/thebeachcomber/32/12748_2.png) [@thebeachcomber](https://forum.inaturalist.org/u/thebeachcomber)\ **Post date:** [April 19, 2022, 4:51am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/52 "2022-04-19T04:51:30Z")
Another example for you if needed @alex Says it’s pretty sure it’s Crotalaria (which is correct), but neither species option is in Crotalaria. If I toggle off seen nearby, Crotalaria lanceolata is the top suggestion, which is correct ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/8/1/8111b07c77de0ab5892f57e2e879f91f3ebe4036.jpeg) ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/e/3/e34d54c083aed0c1a5ede0c18c4e638b7f83bb10.jpeg) Observation: [https://www.inaturalist.org/observations/112012459](https://www.inaturalist.org/observations/112012459) ---
**Author:** ![DianaStuder](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dianastuder/32/43358_2.png) [@DianaStuder](https://forum.inaturalist.org/u/DianaStuder)\ **Post date:** [April 19, 2022, 9:53am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/53 "2022-04-19T09:53:11Z")
I would be satisfied with the **available raw data number with churned taxa**. (Maybe superimposed on a world map so we could each see it for our chosen geography) That would be a number you could easily compare across each new model. I like to see patterns and trends, not needing to see a perfectly accurate number. I’m an enthusiastic iNatter not a research scientist. We anyway have to deal with - sigh - they have changed the name - again. ---
**Author:** ![annkatrinrose](https://avatars.discourse-cdn.com/v4/letter/a/e47774/32.png) [@annkatrinrose](https://forum.inaturalist.org/u/annkatrinrose)\ **Post date:** [April 19, 2022, 11:41am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/54 "2022-04-19T11:41:24Z")
There seem to have been a few weird, way out of range suggestions but I can no longer reproduce this. One example is [this observation](https://www.inaturalist.org/observations/111595445) from North Carolina where the original CV suggestion was for a species endemic to Australia, but this is now no longer showing up among the suggestions. Maybe a temporary glitch right after the new model was released? ---
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [April 19, 2022, 2:59pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/55 "2022-04-19T14:59:54Z")
Gotcha. I know that in the past this was something we were interested in as well. I’ll see what I can do. I might not get to it until next week, but it’s on my todo list. ---
**Author:** ![NoGenAI](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/nogenai/32/64043_2.png) [@NoGenAI](https://forum.inaturalist.org/u/NoGenAI)\ **Post date:** [April 20, 2022, 3:52am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/56 "2022-04-20T03:52:00Z")
I’m curious if this affected the Identify section - when you click on the observation in the Identify window, and it pulls up that observation, sometimes I cannot remember spelling or such close enough to get to what I know something should be, and I used to be able to use the “suggestions” tab. It seems like in line with the new CV model, now it no longer makes logical suggestions. Like. At all. Plant photos get bird & fish suggestions, for example. I should have taken a screenshot - I just went and did this one for example and at least it figured out ‘flying thing’ correctly, but still WAY wrong and this sort of issue wasn’t happening before. ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/e/7/e7a5fbccfaad833f8296a7878084046cdddbbc34.jpeg) Oh here we go, this one shows the issue well. ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/c/7/c7c30ddb8bc0a9340b48875e9f8c189fa91acd5b.jpeg) On any of these, if you click to the observation page, and _then_ use the CV, it works fine. ---
**Author:** ![egordon88](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/egordon88/32/29204_2.png) [@egordon88](https://forum.inaturalist.org/u/egordon88)\ **Post date:** [April 20, 2022, 4:20am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/57 "2022-04-20T04:20:58Z")
You’re filtering by Observations, not “visually similar” ---
**Author:** ![NoGenAI](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/nogenai/32/64043_2.png) [@NoGenAI](https://forum.inaturalist.org/u/NoGenAI)\ **Post date:** [April 20, 2022, 4:15pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/58 "2022-04-20T16:15:52Z")
I didn’t change the filter; it used to automatically do visually similar then. Could it be changed back to automatically default to visually similar, rather than default to observation? ---
**Author:** ![wildskyflower](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/wildskyflower/32/20372_2.png) [@wildskyflower](https://forum.inaturalist.org/u/wildskyflower)\ **Post date:** [April 20, 2022, 4:24pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/59 "2022-04-20T16:24:31Z")
It has always defaulted to observation for me. I think it is must be less computationally intensive to default that way; I have ok internet and it still slows the modal down a fair bit to have it tabbed to visually similar. I also suspect a lot of the people who use the modal are just using that tab as a sanity check to see what else has been seen in the county/region, which the visually similar tab can’t reliably do for species not in the CV. ---
**Author:** ![NoGenAI](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/nogenai/32/64043_2.png) [@NoGenAI](https://forum.inaturalist.org/u/NoGenAI)\ **Post date:** [April 20, 2022, 4:50pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030/60 "2022-04-20T16:50:28Z")
Interesting, thanks. I don’t use it that often, so maybe i’m just seeing it worse now by coincidence. Thanks everyone for solving the issue though, now I know where to click to get what I want! :) [Previous page](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030.md?page=2) [Next page](https://forum.inaturalist.org/t/new-computer-vision-model-released/31030.md?page=4)