Anyone else finding that the change to "expected nearby" is actually making identification suggestions less accurate?

So, to start with I like the idea behind the addition of the “expected nearby” category in the CV IDs.

However this seems have come at the expense of the “seen nearby” aspect.

This is a bit of an issue as a whole bunch of species that are not found in the local area have now been added to the CV ID.

Seems like it might be a good idea for there to be both a ‘seen nearby;’ and a seperate ‘expected nearby’ tag, not a single joined category.

Anyone else finding this to be the case?

11 Likes

Yeah. I’ve found a few species where the CV wouldn’t suggest a locally abundant species because I happened to be just a couple hundred meters outside the model’s grid cell on the edge of the species’ range. While I agree with you that I like the idea behind this move, I also agree that ‘seen nearby’ and ‘predicted-by-an-elevation-model nearby’ are really separate categories.

6 Likes

It does feel like this is the case, but I don’t know if it truly is, without being able to see a real comparison between “seen nearby” vs “expected nearby”.

1 Like

In my area all of a sudden a bunch of species that are not here and were never recommended before have started popping up.

4 Likes

You can list the problem species on the iNat blog.
They would like to keep the discussion focused in that one place as they work on issues that arise.

1 Like

Today I noticed some issues. Here’s an example observation: https://www.inaturalist.org/observations/187781819

I found a group of Corvus frugilegus sitting on a rail way portal in Coevorden/The Netherlands/Europe and all kind of exotic birds were suggested. So yes, I have the idea that this is correct:
‘‘This is a bit of an issue as a whole bunch of species that are not found in the local area have now been added to the CV ID.’’


I retried it with the website but I got all kind of local species returned.
Maybe it is only an issue with the Android app?
@earthknight AndroidApp or Website?

https://nl.m.wikipedia.org/wiki/Bruine_gent

Only New Sealand: endemic to the South Island of New Zealand.
https://www.inaturalist.org/taxa/519843-Powelliphanta-superba-prouseorum

New World
https://www.inaturalist.org/taxa/4756-Cathartes-aura

North America
https://www.inaturalist.org/taxa/10369-Molothrus-aeneus

United States
https://www.inaturalist.org/taxa/8001-Corvus-ossifragus

1 Like

Website and IOS, I don’t use Android.

The “expected nearby” relies on different data than “seen nearby”, and casts a much wider net as a result. This means that in some areas a bunch of species that are actually not found in the area re now included in the CV results.

I suspect that this varies by region a bit. It’s probably less of an issue in large relatively homogenous areas, but there are large parts of the world that have significant non-homogeneity and in those areas the “seen nearby” system yields more accurate results.

This is why it would be useful to be able to toggle between “expected nearby” and “seen nearby” results.

2 Likes

I have been uncertain of my memory…but I think that before the change, I never saw “Looks similar” if it wasn’t ever seen nearby.

But as a confounding factor, I’ve been IDing somewhere without much in the CV.

Is this a bug in the software, my memory, or just a coincidence?

Thanks so much,

Confused in NY

You could always toggle to Visually Similar (I use that for cultivated plants, and also if the nearby list is LONG and unhelpful)

That was not the question. I am getting “visually similar” when I didn’t ask for it.

1 Like

I’ve noticed a huge drop in the quality of suggestions since this was implemented, unfortunately.

Today I posted a Western Azalea and got an “expected nearby” suggestion for Golden Azalea… the nearest observation of that species is almost 800 miles from me, and is not even RG. The nearest RG observation is in Ireland (and I am in California).

5 Likes

It’s definitely weird that Rhododendron luteum is expected nearby in Marin. The model was trained on month-old data, so maybe there were some uncorrected observations of it when training started.

I suspect that in this case the photo has a lot to do with it as well. I submitted a cropped photo of your photo from https://www.inaturalist.org/observations/188350095, with leaf detail featuring more prominently in the image, and with the same date and location and here’s what I got:

How often are these going to get retrained? Just curious what the turnaround on that will be to account for corrections being made for out-of-range observations. Is it going to be with every CV update, which now seem to come out on a monthly basis, or less frequently?

1 Like

Every CV update I’d assume, yes.

1 Like

Every month, as part of the computer vision model update.

For what it’s worth, the old “seen nearby” data was updated every two months or so.

2 Likes

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.