CV model included flag bug?

,

I got some weird behaviour when I just wanted to check whether taxa are included in the CV model!

Platform (Android, iOS, Website): Website, API

Browser, if a website issue (Firefox, Chrome, etc) : Firefox

URLs (aka web addresses) of any relevant observations or pages:
https://www.inaturalist.org/taxa/159098-Atropa-bella-donna

Screenshots of what you are seeing (instructions for taking a screenshot on computers and mobile devices: https://www.take-a-screenshot.org/):


Description of problem (please provide a set of steps we can use to replicate the issue, and make as many as you need.):
I tried to write a script that checks, whether specific taxa are included in the iNaturalist CV model.
I sent and API GET request to https://api.inaturalist.org/v1/taxa/159098 and the response indicated the taxon was not included in the CV model. I thought this had to be an error and visited the taxon website on Firefox. There, I confirmed the taxon was not included. I copied the url and sent it to a collegue, because it seemed very odd to me that such a common taxon should be missing in the CV model. However, he got another result. When I went back to the web page, I now also found the “included” flag, instead of “pending”. Fortunately, I have screenshots of both situations.

What is going on here??

Edit: I re-visited the website and the taxon is on “pending”, again. It appears to switch randomly(?)

2 Likes

I never filed a bug report, but I noticed this almost 2 years ago. Screenshot from back then:

1 Like

This behaviour is very strange and, obviously, it makes the CV model status entirely useless if there is a 50 % chance to get a wrong status displayed…

2 Likes

Atropa bella-donna was renamed last week: https://www.inaturalist.org/taxon_changes/136874 and I think the inclusion in the CV model was removed.
It will be probably be back in the next updated CV model.

1 Like

Hm, but it was on and off several times in one day? (It is also on again, at the moment.) Anyways, I hope this was an exceptional case. Else, somebody should probably look into this and fix the issue…

I think that the CV model was removed when the taxon was renamed. And it came back afterwards. You just happen to be looking at the moment it was moved.

2 Likes

I think I’m getting this as well. This is after today’s CV update which should have removed the species from the CV (we put some concerted effort this month into re-identifying all the observations back up to complex).
This was from two tabs open at the same time:

After refreshing the page, they both say that the species is included. It also still shows in CV recommendations with “Visually Similar”:

From quick testing, it seems like it says “Pending” if I navigate to the species page via the “Taxonomy” tab from the complex page. Going from any other way gets it saying “Included”.

2 Likes

I believe it’s still in the model. Training data for the CV 2.19 model was exported at the end of December, so if your work to remove it took place in January that won’t affect the latest release.

I think that’s this bug?

Yesterday I was surprised to see that the South American hoverfly Eristalis bogotensis was not included in the model. I was sure it had been in previous versions. Having seen this I’ve just checked back and, lo and behold, it now says that it is included!

1 Like

Ahh okay that makes sense, thanks.

I don’t think so… if you check my screenshots neither one has a place filter applied.

1 Like

Thanks. I suspect it’s related. I added to the GH issue: https://github.com/inaturalist/inaturalist/issues/4333

1 Like

Platform: Website

Browser: Firefox

URLs (aka web addresses) of any relevant observations or pages: https://www.inaturalist.org/taxa/62850-Conocarpus-erectus

Screenshots of what you are seeing:


Description of problem:

As the title says, a species which I know is in the cv model and has been for a while has the model status shown as pending on its taxon page

It shows Included for me, so I think it’s the same bug that’s causing the Pending/Included label to switch back and forth.

2 Likes