Search does not return pages beyond 333, e.g. https://www.inaturalist.org/observations/identify?page=334&place_id=97391 returns “No matching observations” even though there are over 21000 pages of observations from that place.
The problem is with the API, where calling
…returns this error
{"error":"Result window is too large, page * per_page must be less than or equal to 10000","status":403}
…even when per_page is within limits. Setting the page parameter above 333 will trigger the error.
We use Elasticsearch and keep their recommended limit of 10k records, which is why you’re hitting this limit. You can see the GitHub issue here: https://github.com/inaturalist/iNaturalistAPI/issues/134 We should, however, have an error message when this happens, I’ll make an issue for that.
The way to get around this would be to use more filters, such as filtering by taxon, dates, location, etc. For example, searching for all reptiles in Europe that Need ID returns just over 1k records: https://www.inaturalist.org/observations/identify?iconic_taxa=Reptilia&place_id=97391
Filtering by dates would be a strait-forward way of progressing through a list past 333. If you check the dates on page 332, then set your new filter to end at that date, your page 333 suddenly becomes page 1 or 2, and you can keep going.
I’ve encountered the same issue, but got around using filters. Thanks for posting @mikkohei13, now we know exactly what’s happening.
@tiwane can i suggest to broaden the error message with some type of recommendation like “please, use filters” or something similar? 'cause first time i bumped into this i thought there is some problem with my computer or browser until i cleared my cache and tried it on another machine, only then i figured out it was some kind of a system limit. Thank you for clearing this out!
I was curious what my first identification was on here (of the 36742 that I’ve made). But I get an error message when I attempt to look back beyond page 333.
This is because of a limit of elastic search (see Tony’s explanation above).
The “fix” is also the same as described above – use search parameters to get to what you want. You can use the API (info here), and pisum has already made a friendly tool for it here. If you’re just looking for your oldest ID, you can use https://jumear.github.io/stirfry/iNatAPIv1_identifications.html?user_login=joe_fish&order=asc.
You can also vote for the feature request to add better searching for IDs.
Platform:
Website
App version number, if a mobile app issue:
Browser, if a website issue:
Chrome
URLs (aka web addresses) of any relevant observations or pages:
Screenshots of what you are seeing:
Description of problem:
Step 1:
Go to a user’s profile page
Step 2:
Click “IDs” tab
Step 3:
At the bottom, between “Previous” and “Next” is a series of page number. Click on the last number. If the last number is greater than 333, it will give the error: " I ate iNaturalist.org, that’s why it’s not working."
see https://forum.inaturalist.org/t/cannot-fetch-pages-beyond-333/3861/2.
as a workaround to see the observations beyond page 333, use additional filter parameters to reduce the number of records returned or invert the sort order.
@jeffxvx Thanks for posting your bug report and welcome to the Forum!
I merged your report with this existing one since it is a known issue and this report has notes for workarounds.