Not all observations uploading

Just uploaded a batch of 17 obs, 49 photos, no problems

Have uploaded several batches today with no problems. Did you make any changes, Ken-ichi, or is today just a good day? :-)

Have uploaded several batches over the last two days with no problems (even when my connection has been iffy and dropped completely on occasion). @kueda, please could you index my two orphans:
https://www.inaturalist.org/observations/34964843
https://www.inaturalist.org/observations/35167681

I have checked both right now and they don’t load.

Ok, they’re indexed and loading.

1 Like

Thank you so much :-) And my ob count has gone up by 2 on my Explore page (as it should).

After several days of no problems, I’ve now got one non-indexer:
https://www.inaturalist.org/observations/35732453

Interestingly, it was the first ob in the batch (which is a first). Can see it on my Calendar, but the page does not load (i.e. same behaviour as previous non-indexers).

[Edit] Also https://www.inaturalist.org/observations/35742768

Not indexed:
https://www.inaturalist.org/observations/35889300

Not indexed:
https://www.inaturalist.org/observations/36725999

Not indexed:
https://www.inaturalist.org/observations/36939475

Not indexed:
https://www.inaturalist.org/observations/36966278

Not indexed:
https://www.inaturalist.org/observations/36999649

Not indexed:
https://www.inaturalist.org/observations/37027370

So far, all have been insects (was there one spider?). Perhaps there’s a problem with the Insect Life Stage field that populates the annotations? And/or the Sex field. I tend not to bother with annotations on other organisms.

Not indexed:
https://www.inaturalist.org/observations/37230146
https://www.inaturalist.org/observations/37230155

Edit: These two have indexed!! Did it happen by itself, or did you do it, @kueda ?

I didn’t do anything recently (at least not on purpose). To reiterate, telling us that the problem is still happening doesn’t help us solve the problem. What we need are steps we can follow to consistently recreate the problem. FWIW, if you want to force a re-indexing, you can fave and unfave an observation.

1 Like

I just re-indexed the unindexed observations after your latest post. I also tried again to replicate the indexing issue by making test observations with nearly your same attributes (same fields, added to the same project, etc) and still cannot replicate it.

2 Likes

Ken-ichi, I am recording the non-indexers here so that I have a record of them, not as a dig at you guys! I am totally grateful for all the help!

I can’t fave (or unfave) because the obs don’t load :-( The key to open the box is inside the box ;-)

1 Like

Thank you so much, Patrick!! I have checked them and they’re all there - yay!

On the one - https://www.inaturalist.org/observations/37027370 - I had the sex annotation female. When I tried to remove it now, it won’t go and the little wheel just spins. I waited 2 minutes and then refreshed the ob. The annotation was still there. Tried deleting it again, and it did delete after a few seconds.

Could there be a conflict between the field value and the annotation? If one tries to delete the annotation while the field value is still there, might the field value be trying to re-annotate at the same time? I deleted the field value after getting the annotation to finally delete. This may be a different problem altogether and not related to the non-indexing?

Sounds like a different problem. What we really need for the non-indexing problem is a list of steps to follow that consistently recreate the problem, e.g. “I upload this photo at this time with these values and every time I end up with an unindexed observation”

1 Like

I hear what you’re asking, but the problem is not consistent. Anyway, this is how it goes:

  1. Click on Upload
  2. Click on Choose Files
  3. Use shift-click (and sometimes ctrl-click) to select a bunch of files.
  4. Select cards with shift-click or ctrl-click, and click on Combine, or click-&-drag cards together. I use the first option if I’m happy that the first photo remains the first photo on the ob, and I use the second option is I want a photo other than the first photo as the first photo on the ob.
  5. Click on Select All and click on Locality. Type in a few letters into the pinned location field and wait for dropdown. Dropdown drops and disappears. Type in letters again. Dropdown drops down without filtering for locality. Type in letters again. Dropdown finds locality. Arrow down and dropdown disappears. Type in letters again. Dropdown finds locality. Click on it with mouse very quickly before it disappears again. If not fast enough - rinse and repeat. When I finally have the locality, click Update.
  6. I don’t have gps co-ords on pics, so I find them manually. I go back into the locality of each ob that is in a slightly different spot to the pinned locality, and move the pin.
  7. Click on Select All if all have the same habitat, otherwise shift-click or ctrl-click all obs with the same habitat. Then add Habitat (s Afr) field. Repeat for all different habitats in the batch.
  8. Click Select All, and add to Habitats (s Afr) project. Type H in the projects field, wait 15 seconds for the project name to appear in the dropdown, arrow down and it disappears. Type H again, wait for dropdown, click on Habitats project but by this stage all projects have suddenly dropped down and click on wrong project. Remove from that project. Type H in field again, and have mouse in position to click on the dropdown as soon as it appears. Success!
  9. Shift-click or Ctrl-click all insect adult obs and add field Insect Life Stage: Adult. Do the same for larvae, pupae, eggs and nymphs. Sometimes the fields disappear and I have to click out on the sidebar somewhere and then click back in the field to get them to appear again. This doesn’t always work, so I have to click on blank space, reselect the cards and try the field again. This is usually successful.
  10. Add obs to other projects if relevant, e.g. Nests & nesting (s Afr), Animated observations, Pillar Parade (s Afr) etc.
  11. Add taxon names to each observation, on its card. If more than one card has the same organism, then ctrl-click to select and add name in sidebar.
  12. Add text to descriptions where necessary.
  13. Add interaction fields if the other partner of the interaction is already uploaded and I have the URL. Add to Interactions (s Afr) project.
  14. Wait for all photos to upload.
  15. Click submit.
  16. Count the number of obs that have uploaded in the batch. If short, then refresh page (sometimes twice). If one or more obs are still missing, check the Calendar for that day. Open the missing obs. If they don’t load, then come here and add the URL as non-indexed for future reference.

All obs that have not indexed have been insects with Insect Life Stage: Adult field. I think this is where the problem lies. I will test tomorrow with batches without adding this field and see if the problem persists.

Thank you so much for your help!

1 Like

Have added 51 obs of insects this morning without adding life stage field, and lost none of them. Did all the other stuff as detailed above. So the non-indexing does seem to have something to do with the field and/or the annotation it populates?

It is also not messing up my order of obs, which was happening all the time before, and was a bit annoying because it all went out of order. Yes, yes, it is my mild ocd ;-D

1 Like