# New Computer Vision model released! **URL:** \ **Category:** News and Updates\ **Created:** [July 13, 2021, 8:41pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729 "2021-07-13T20:41:12Z")\ **Posts on this page:** 20\ **Page:** 1
**Author:** ![tiwane](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/tiwane/32/54612_2.png) [@tiwane](https://forum.inaturalist.org/u/tiwane)\ **Post date:** [July 13, 2021, 8:41pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/1 "2021-07-13T20:41:12Z")
Hey all, the first update to the Computer Vision model since March of 2020 has been released! The iNaturalist website (and all network member sites) are using it as well as the Android and iOS iNaturalist apps. Seek, however, is still running on the older model as we still need to compress this new model so it will fit within the Seek app. You can read more details [on the iNaturalist blog](https://www.inaturalist.org/blog/54236-new-computer-vision-model) and geek out at @alex’s more technical forum thread [here](https://forum.inaturalist.org/t/computer-vision-update-july-2021/24728). Also, the About section of every species taxon page will let you know whether that species is included in the model: ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/3/8/3893d1755c87dd6bae0ec2e98fb0dc0ed8146512.png) ---
**Author:** ![zdanko](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/zdanko/32/20125_2.png) [@zdanko](https://forum.inaturalist.org/u/zdanko)\ **Post date:** [July 14, 2021, 4:15am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/5 "2021-07-14T04:15:04Z")
Awesome! I’m assuming that this change also applies to the [Computer Vision Demo](https://www.inaturalist.org/computer-vision-demo)… but just to be sure, does it? ---
**Author:** ![DianaStuder](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dianastuder/32/43358_2.png) [@DianaStuder](https://forum.inaturalist.org/u/DianaStuder)\ **Post date:** [July 14, 2021, 7:41pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/6 "2021-07-14T19:41:15Z")
There is also a new Pending - _The current Computer Vision Model does not know about this taxon, so while it might be included in automated suggestions with the “Nearby” label, it will not have the “Visually Similar” label. While the requirements for model inclusion change with each model, generally inclusion is based on number of observations, so to increase the chance of this taxon getting included during the next model training, add or identify more observations of this taxon._ [https://www.inaturalist.org/taxa/717367-Gladiolus-merianellus](https://www.inaturalist.org/taxa/717367-Gladiolus-merianellus) ---
**Author:** ![pleary](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/pleary/32/3211_2.png) [@pleary](https://forum.inaturalist.org/u/pleary)\ **Post date:** [July 14, 2021, 7:54pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/7 "2021-07-14T19:54:34Z")
Yes the CV Demo page uses the same model as the website and the mobile apps. As mentioned in the blog post, the only exception is the on-device CV model that Seek uses, which we plan to update in the near future. ---
**Author:** ![tlit46](https://avatars.discourse-cdn.com/v4/letter/t/50afbb/32.png) [@tlit46](https://forum.inaturalist.org/u/tlit46)\ **Post date:** [July 14, 2021, 9:45pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/8 "2021-07-14T21:45:48Z")
The taxon Osmunda spectabilis, the American royal fern, also has the “pending” label, and sure enough, it does not appear in CV suggestions. Yet there are over 8000 research grade observations for it. Why is this? ---
**Author:** ![zdanko](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/zdanko/32/20125_2.png) [@zdanko](https://forum.inaturalist.org/u/zdanko)\ **Post date:** [July 14, 2021, 9:58pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/9 "2021-07-14T21:58:00Z")
Presumably because people have identified those observations as such? One does not need the CV to identify something. ---
**Author:** ![tiwane](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/tiwane/32/54612_2.png) [@tiwane](https://forum.inaturalist.org/u/tiwane)\ **Post date:** [July 14, 2021, 10:34pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/10 "2021-07-14T22:34:22Z")
I suspect that’s due to the (relatively) recent split: [https://www.inaturalist.org/taxon\_changes/76311](https://www.inaturalist.org/taxon_changes/76311) _Osmunda regalis_ is in the model: [https://www.inaturalist.org/taxa/82303-Osmunda-regalis](https://www.inaturalist.org/taxa/82303-Osmunda-regalis) ---
**Author:** ![bouteloua](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/bouteloua/32/1180_2.png) [@bouteloua](https://forum.inaturalist.org/u/bouteloua)\ **Post date:** [July 14, 2021, 10:58pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/11 "2021-07-14T22:58:58Z")
Hmm, so one downside of using an output as an input in a taxon split like that is that Osmunda regalis sensu stricto computer vision suggestions are likely based in part on many photos of Osmunda spectabilis? ---
**Author:** ![zdanko](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/zdanko/32/20125_2.png) [@zdanko](https://forum.inaturalist.org/u/zdanko)\ **Post date:** [July 15, 2021, 12:39am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/12 "2021-07-15T00:39:55Z")
Ah, I had a lack of context. ---
**Author:** ![tlit46](https://avatars.discourse-cdn.com/v4/letter/t/50afbb/32.png) [@tlit46](https://forum.inaturalist.org/u/tlit46)\ **Post date:** [July 15, 2021, 12:45am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/13 "2021-07-15T00:45:08Z")
I thought it might be something like that. It is suggesting O. regalis if I “include suggestions not seen nearby.” This isn’t a big problem for me, and I don’t really need to pursue it. I’ll just input O. spectabilis manually for the time being. Thanks for looking into it. ---
**Author:** ![raymie](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/raymie/32/12650_2.png) [@raymie](https://forum.inaturalist.org/u/raymie)\ **Post date:** [July 26, 2021, 3:51pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/15 "2021-07-26T15:51:54Z")
Is anyone else noting the suggestions of Anseriformes being really bad now? They were reliable before but right now the CV is having trouble recognizing Mallard and Canada Goose. ---
**Author:** ![tiwane](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/tiwane/32/54612_2.png) [@tiwane](https://forum.inaturalist.org/u/tiwane)\ **Post date:** [July 26, 2021, 9:02pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/16 "2021-07-26T21:02:23Z")
Please include specific examples, it’s much easier to investigate a problem if we can try to replicate it on our end. ---
**Author:** ![raymie](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/raymie/32/12650_2.png) [@raymie](https://forum.inaturalist.org/u/raymie)\ **Post date:** [July 27, 2021, 1:09am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/17 "2021-07-27T01:09:49Z")
Mallards seem to be usually recognised at Mallard x American Black Duck hybrids, and Canada Geese as Canada Goose x Greylag Goose hybrids. ---
**Author:** ![alex](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/alex/32/13_2.png) [@alex](https://forum.inaturalist.org/u/alex)\ **Post date:** [July 27, 2021, 6:16am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/18 "2021-07-27T06:16:33Z")
Yeah, I’m concerned about vision accuracy on avian hybrids & related species. It’s turning out to be a hard problem for the vision system. We don’t train on subspecies, and it may be that we shouldn’t train on any infraspecific taxa. I’m planning to do experiments next month to decide whether we should exclude avian hybrids in future models, or otherwise treat them differently. The background is that previous versions of the model had far fewer avian hybrid photos to train on. We had a large growth in the number of avian hybrid identifications in the past year and for the first time, our (capped) training data had as many Mallard x American Black Duck photos as Mallard photos and American Black Duck photos. We didn’t exclude them from the training dataset because it wasn’t a known problem, but obviously I’m re-evaluating that now. ---
**Author:** ![shanesmicroscope](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/shanesmicroscope/32/18456_2.png) [@shanesmicroscope](https://forum.inaturalist.org/u/shanesmicroscope)\ **Post date:** [August 5, 2021, 1:55am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/19 "2021-08-05T01:55:18Z")
Is there any way certain taxa could be trained above the genus level? Many (most?) ciliates (to say nothing of other microbes) are not possible to identify to species with home equipment. Even genus can be quite challenging at times, sometimes impossible without complex staining techniques using chemicals not available to the amateur. ---
**Author:** ![zdanko](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/zdanko/32/20125_2.png) [@zdanko](https://forum.inaturalist.org/u/zdanko)\ **Post date:** [August 5, 2021, 11:15am UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/20 "2021-08-05T11:15:13Z")
I don’t think that’s possible, since taxa above genus level have many genera under them, which might have completely different habitus. The AI still will suggest families and the like if it finds multiple genera that look similar to the observation. ---
**Author:** ![shanesmicroscope](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/shanesmicroscope/32/18456_2.png) [@shanesmicroscope](https://forum.inaturalist.org/u/shanesmicroscope)\ **Post date:** [August 5, 2021, 12:37pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/21 "2021-08-05T12:37:42Z")
Genus level is exactly the level I would like to see (this is the typical goal of microbial ID). But since I see no computer vision note on the genus pages, I assume they are not being trained at that level. e.g. [https://www.inaturalist.org/taxa/1094458-Opercularia](https://www.inaturalist.org/taxa/1094458-Opercularia) ---
**Author:** ![thebeachcomber](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/thebeachcomber/32/12748_2.png) [@thebeachcomber](https://forum.inaturalist.org/u/thebeachcomber)\ **Post date:** [August 5, 2021, 12:53pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/22 "2021-08-05T12:53:53Z")
> [@shanesmicroscope](#): > > But since I see no computer vision note on the genus pages, I assume they are not being trained at that level. “We’ve also released a new feature for taxon pages on the website which allows you to see which taxa are included in the model. This badge only appears on species pages, not pages of genera, families, etc.” ---
**Author:** ![shanesmicroscope](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/shanesmicroscope/32/18456_2.png) [@shanesmicroscope](https://forum.inaturalist.org/u/shanesmicroscope)\ **Post date:** [August 5, 2021, 1:06pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/23 "2021-08-05T13:06:39Z")
That doesn’t address my question. So to put it clearly: can it be trained at the genus level? If so, how do we know? ---
**Author:** ![thebeachcomber](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/thebeachcomber/32/12748_2.png) [@thebeachcomber](https://forum.inaturalist.org/u/thebeachcomber)\ **Post date:** [August 5, 2021, 1:38pm UTC](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729/24 "2021-08-05T13:38:00Z")
> [@shanesmicroscope](#): > > can it be trained at the genus level? yes it can. To quote Alex who runs it, “If enough photos are present at the genus level, but not enough photos for any of the descendent species, then the genus will be placed in the training set” I posted the quote in my previous reply to explain why the tag symbol doesn’t show up on the genus pages > [@shanesmicroscope](#): > > If so, how do we know? no idea [Next page](https://forum.inaturalist.org/t/new-computer-vision-model-released/24729.md?page=2)