# Export is in queue for last five hours (has 13000 observations with many fields chosen))

**URL:** <https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004>\
**Category:** Bug Reports\
**Created:** [July 2, 2024, 7:53am UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004 "2024-07-02T07:53:17Z")\
**Posts on this page:** 15\
**Page:** 1

<div class="post-metadata">

**Author:** ![bhagwatn](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/bhagwatn/32/36989_2.png) [@bhagwatn](https://forum.inaturalist.org/u/bhagwatn)\
**Post date:** [July 2, 2024, 7:53am UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/1 "2024-07-02T07:53:17Z")

</div>

**Platform** (Android, iOS, Website): Website

**App version number** , if a mobile app issue (shown under Settings or About): na

**Browser** , if a website issue (Firefox, Chrome, etc) : chrome

**URLs (aka web addresses) of any relevant observations or pages**: [https://www.inaturalist.org/observations?place\_id=any&subview=table&taxon\_id=83736](https://www.inaturalist.org/observations?place_id=any&subview=table&taxon_id=83736)

 ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/1/a/1a09b682c0da14878a7ce30ef74d3e0547ecc181.png)

**Description of problem** (please provide a set of steps we can use to replicate the issue, and make as many as you need.):

step 1  
[https://www.inaturalist.org/observations](https://www.inaturalist.org/observations)?  
5place\_id=any&subview=table&taxon\_id=83736

step 2  
for the above url, I wanted maximum field data, so from filter, added many fields

step 3  
created the export, is said its in progress.

step 4  
however, its still in progress for 5 hours!

why ?

---

<div class="post-metadata">

**Author:** ![natev](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/natev/32/29855_2.png) [@natev](https://forum.inaturalist.org/u/natev)\
**Post date:** [July 2, 2024, 1:21pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/2 "2024-07-02T13:21:16Z")

</div>

I think the answer to “why” is that it has 13,000 observations with many fields chosen. Especially if your internet is spotty, 5 hours is not unreasonable.

---

<div class="post-metadata">

**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\
**Post date:** [July 2, 2024, 6:44pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/3 "2024-07-02T18:44:44Z")

</div>

> [@bhagwatn](#):
>
> however, its still in progress for 5 hours!

did you refresh the page? when you first create an export, there will be a little pop-up that sticks around for maybe a minute. if the export hasn’t completed within that time, you’ll be presented with an option to either get an e-mail when the export is done or to check the status yourself. if you choose to check the status yourself, you need to refresh that page occasionally to get the latest status.

if the status is up-to-date, then “Queued” would suggest that your job was stuck behind other jobs that others launched prior to yours. i just launched a small export job myself, and it completed just fine. so i assume that if your job was stuck behind other jobs, it’s no longer stuck.

if your job is still showing “Queued” however, it’s possible that something went wrong behind the scenes. in such a case, write a note here to indicate that the problem still exists, and then also contact the staff through the helpdesk at [help.inaturalist.org](http://help.inaturalist.org), referencing this post. (they’ll probably need to clear the job before you’ll be able to launch any additional jobs.)

---

<div class="post-metadata">

**Author:** ![thebeachcomber](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/thebeachcomber/32/12748_2.png) [@thebeachcomber](https://forum.inaturalist.org/u/thebeachcomber)\
**Post date:** [July 2, 2024, 11:41pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/4 "2024-07-02T23:41:15Z")

</div>

> [@natev](#):
>
> I think the answer to “why” is that it has 13,000 observations with many fields chosen. Especially if your internet is spotty, 5 hours is not unreasonable.

5 hours for 13,000 definitely seems like something is wrong from my experience; I’ve completed quite a lot of downloads of 100,000-200,000 records at once, including additional columns, and had them complete in 1.5-2 hours

---

<div class="post-metadata">

**Author:** ![earthknight](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/earthknight/32/32879_2.png) [@earthknight](https://forum.inaturalist.org/u/earthknight)\
**Post date:** [July 3, 2024, 9:18am UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/5 "2024-07-03T09:18:20Z")

</div>

That will vary enormously depending on the connection from your location to the iNat servers.

Where I am downloading that many observations would take a day or two and would probably time out and have to be restarted several times before it finally worked.

---

<div class="post-metadata">

**Author:** ![dinobiancolini](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dinobiancolini/32/37389_2.png) [@dinobiancolini](https://forum.inaturalist.org/u/dinobiancolini)\
**Post date:** [July 4, 2024, 5:11pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/9 "2024-07-04T17:11:02Z")

</div>

The download has not even been processed; there is a Queued date but no Started or Finished dates. So the issue is with the iNat server rather than the user’s connection. I’ve been trying to download only 5000 observations for the last 3 hours and have had the same problem.

---

<div class="post-metadata">

**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\
**Post date:** [July 4, 2024, 5:15pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/10 "2024-07-04T17:15:33Z")

</div>

i just exported a csv with 1 record. i don’t know exactly how iNat prioritizes jobs in its processing queue, but i wouldn’t have expected it to prioritize my export over any other jobs.

try refreshing your export page. does the page still show that your job is queued?

---

<div class="post-metadata">

**Author:** ![dinobiancolini](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dinobiancolini/32/37389_2.png) [@dinobiancolini](https://forum.inaturalist.org/u/dinobiancolini)\
**Post date:** [July 4, 2024, 5:17pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/11 "2024-07-04T17:17:10Z")

</div>

Yes, I have tried refreshing multiple times.  
Four days ago, I performed the same query, which was queued for only half an hour and completed in 13 minutes.

---

<div class="post-metadata">

**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\
**Post date:** [July 4, 2024, 5:37pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/12 "2024-07-04T17:37:04Z")

</div>

hmmm… i’m surprised that iNat wouldn’t process jobs first-in-first-out, but if you’re only trying to export a few thousand records, you can always do that via the API instead.

there’s a link to a Jupyter Notebook (using a variant of Python) that can help you accomplish this here: [https://forum.inaturalist.org/t/whats-the-best-way-to-share-python-code-nowadays/48554](https://forum.inaturalist.org/t/whats-the-best-way-to-share-python-code-nowadays/48554)

@kildor has a page that provides another way to export stuff: [https://kildor.name/inat/download-observations](https://kildor.name/inat/download-observations)

i’m sure there are other tools that can help with this, too, but those are the first ones i thought of off the top of my head.

---

<div class="post-metadata">

**Author:** ![dinobiancolini](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dinobiancolini/32/37389_2.png) [@dinobiancolini](https://forum.inaturalist.org/u/dinobiancolini)\
**Post date:** [July 4, 2024, 6:01pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/13 "2024-07-04T18:01:37Z")

</div>

Thanks! Perhaps the servers are overloaded?  
Is it possible to download also obscured observations from these alternative solutions?  
I’m trying to download the observations from a project that I administer.

---

<div class="post-metadata">

**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\
**Post date:** [July 4, 2024, 6:14pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/14 "2024-07-04T18:14:43Z")

</div>

> [@dinobiancolini](#):
>
> Is it possible to download also obscured observations from these alternative solutions?

it should be possible with the Jupyter Notebook. you have to get a JSON Web Token. search in the notebook for `jwt =`, and follow the instructions in the comments above. then in the section that defines which columns you want to get, uncomment the private location fields so that these will be included in the results. when you make the main call, make sure you set parameters `get_all_page=True` and `use_authorization=True`.

---

<div class="post-metadata">

**Author:** ![dinobiancolini](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dinobiancolini/32/37389_2.png) [@dinobiancolini](https://forum.inaturalist.org/u/dinobiancolini)\
**Post date:** [July 4, 2024, 7:43pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/15 "2024-07-04T19:43:01Z")

</div>

Thanks again! I will remember this for the next time, it appears it went through!  
Queued 16:27 Started 20:13 Finished 20:26

---

<div class="post-metadata">

**Author:** ![cthawley](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/cthawley/32/1445_2.png) [@cthawley](https://forum.inaturalist.org/u/cthawley)\
**Post date:** [July 5, 2024, 1:09pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/16 "2024-07-05T13:09:06Z")

</div>

That makes it seem like the queue is just long. The query finished quickly and reasonably (and in similar time to when you ran it earlier). So maybe there are just a lot of requests?

---

<div class="post-metadata">

**Author:** ![dinobiancolini](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/dinobiancolini/32/37389_2.png) [@dinobiancolini](https://forum.inaturalist.org/u/dinobiancolini)\
**Post date:** [July 6, 2024, 7:54am UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/17 "2024-07-06T07:54:31Z")

</div>

Yes, it seems the server was quite busy.

---

<div class="post-metadata">

**Author:** ![tiwane](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/tiwane/32/54612_2.png) [@tiwane](https://forum.inaturalist.org/u/tiwane)\
**Post date:** [July 15, 2024, 8:52pm UTC](https://forum.inaturalist.org/t/export-is-in-queue-for-last-five-hours-has-13000-observations-with-many-fields-chosen/53004/18 "2024-07-15T20:52:12Z")

</div>


