Strengths and Weaknesses of iNaturalist Data

I will mention that data does need a bit of curation and most of the dots on extreme edges of ranges need to be checked carefully.

1 Like

I will be mentioning that iNaturalistā€™s primary purpose is to get people to connect with nature. But I wanted to showcase that iNaturalistā€™s data is useful, and that people shouldnā€™t consider contributions to iNaturalist a waste of time scientifically. iNaturalist can not answer questions that the third breeding bird atlas for Ontario I am participating in next year. I believe breeding bird atlases do a great job in determining the population status of bird species, and is one of the best citizen scientist projects to participate in. That said, a breeding bird atlas needs a ton of volunteer effort to be successful (hundreds of thousands of hours) and ignores the other 99% of nature.

4 Likes

I spend quite a bit of time looking at range expansions of species I am familiar with. Itā€™s true most are false alarms but I just disagree with them. Occasionally they are real though! I think the data is very valuable when one checks the suspect observations themselves.

6 Likes

(reposted for clarification)

I use ā€œopt outā€ to manage my own observations. I have some desire to keep my records consistent, and having everything changing is too tricky to keep up with, so this allows me to go through them one-by-one and ā€œvetā€ the changes before agreeing to the updated ID.

Iā€™ve been given a hard time by people, who accuse me of being arrogant and rejecting the ā€œgreater cause and promise of data qualityā€. Because, yes, Iā€™m just one person and I canā€™t claim to have expertise everywhere. Iā€™m always than open to correcting and adjusting my ID if rational evidence is provided. If Iā€™m not adhering to community ID even after my ā€œreviewā€, then thereā€™s always a good reason for it. Personally I do believe that data wise, opt-out is arguably negative on average. But in my case Iā€™m very careful and Iā€™m certain it actually provides a small benefit. There are a few cases where letting the community ID override would have kept incorrect IDs (from non-experts, mostly) at the forefront. Or cases where people commit to species without adequate evidence (e.g. ā€œguessingā€ a species without reasoning).

But at no point am I letting ā€œincorrect IDsā€ stay around, in my case.

8 Likes

@astra_the_dragon @fffffffff @rayray Observer location bias will skew the spatial sampling distribution at a point in time but over time the spatial sampling distribution will converge on the actual distribution. Twelve years is nowhere like long enough to get complete coverage for an abundant, widely distributed species, especially in parts of the world with limited participation in iNat. I would argue that Marinaā€™s mallard map is actually pretty good, given the relatively short duration of the effort and the issues with collecting records in remote parts of the range. Does anybody believe that the blank areas on that map will not continue to fill in as time moves on and observation totals mount?

As others have noted, the issues with iNat are largely the same issues encountered with mapping presence/absence generally with slightly different details.

1 Like

Thatā€™s quite what I said, weā€™re making it better, though Mallard have over 100k observations that is pretty much enough to not have such big blank areas, as not many observers needed to cover them in sparse dots, itā€™s totally a problem of iNat (or similar systems, of course) not being a common thing in those areas, plus Mallard is the most observed species, others usually have worse maps.

1 Like

Iā€™m not trying to be a jerk here, and Iā€™m sure these ideas have already been argued at length for years on the forums, but I am curious since you are one of the more prominent and conscientious opt-outers Iā€™ve run into. (I do appreciate that youā€™ve always been responsive whenever Iā€™ve identified robber flies, and I admire your thirst to keep on learning!)

Butā€¦ Do you have a statement in your will to help your executors continue curating with your signature careful vetting after youā€™ve passed? Or to opt your account back in to community consensus? Because if neither of those is set to happen, then in a hundred years half of these observations will probably be broken, just due to ever-improving taxonomy. Maybe iNat will be long forgotten by then (after all, how many websites have lasted even the 25 years since the modern internet took off), but thatā€™s the kind of multi-generational perspective that museums and taxonomists have to plan for. iNat sometimes dreams of being useful for that world (e.g., pushing records to GBIF) but tension will remain so long as we try to serve two masters.

I figure this is one reason why some experts are loathe to spend time on here curating a resource that is ephemeral by design. I mostly gave up on BugGuide a few years ago when I realized that they were letting the eternal mirage of ā€œBugGuide 2.0ā€ keep them from making any real structural fixes and because iNat had the momentum and power backing to take BugGuideā€™s place. But I still worry sometimes whether my energy would be better spent curating physical bugs on pins that have a longer shelf life.

Anyway, carry onā€¦ Iā€™ll go back to my hole.

8 Likes

This is one of the central aspects why Iā€™d also support the removal of iNatā€™s global opt-out function while still allowing it on a case-by-case basis. Not the topic of this thread, though, so maybe better started as a new one.

Passing away is the most exteme case in that respect, but there are and will be loads of users who at some point simply stop using iNat without further thoughts concerning the afterlife of their data.

4 Likes

5 posts were split to a new topic: How to Note Extra Information / Inter-species Relationships?

Totally agree. With a bit of double-checking, you can fix all the false alarms rather easily. As long as you take all the observations with a grain of salt, iNaturalist is really useful for tracking range expansions.

4 Likes

As far as ā€œBugguide 2.0ā€ INat has a big advantage in usability than Bugguide, which is more old school and often tedious forum uploads one by one. I still think INat has a long time to go to catch Bugguide in the small and cryptic insect category, where there is sizable species-level identification by many experts. And because there is no community vetting, the specimens are readily searchable and not hidden in the vast dustbin of ā€œgenusā€ or ā€œfamilyā€ where very few experts will have the time or patience to plow through one by one (especially if they show no details). So I think Bugguide will always have a place, BUT I think these rare, tiny, or difficult to determine species SHOULD be added to iNaturalist by the experts so we have a full species inventory in place for ā€œIdentifyā€ tabs to at least inform people of this speciesā€™ presence. If people knew there were several similar species of Dung Beetle X, maybe they would stop labeling it as the most common species and help the future curation of the site. I know this is a big project given the thousands of species of tiny moths/beetles/flies/etc. but I think even adding singleton species bookmarks (dead museum specimens) is useful to give that species a presence on iNat finally.

1 Like

One thing Iā€™ve noticed on some of the iNat species pages is that the shaded range maps ā€“ the ones that show the supposed geographic distribution based on other sources outside of iNat ā€“ are often not very accurate. Not all species maps on iNat have such shading but, for example, many mammal pages do and they are often inaccurate. Since Iā€™m familiar with North American mammals, itā€™s probably the fault of the sources being used as many field guides have rather poor or out-of-date range maps. Unfortunately, iNatters might use those shaded maps as a guide to what their photo records should be.

2 Likes

This is a rapidly developing program, with burgeoning numbers of new users. Even though I joined with expert guidance during a bioblitz, I have found the learning curve to be much steeper than I expected for a non-expert. A photo or two might easily differentiate a regional species, but when you throw in the whole world of possibilities and varying taxonomic systems, itā€™s easy to miss a subtle point if youā€™re adding a number of observations at once and trying to move fast. For example, Alnus incana in north-central Minnesota is almost always Alnus rugosa or Alnus incana var. rugosa, if you wish.
The benefit of this, of course, is a deeper knowledge of plant taxonomy for an amateur naturalist like me, and an understanding of what photos are needed for a definitive ID. It has totally changed my outlook on this.

3 Likes

Long story short, no I do not. To be blatantly honest, it isnā€™t something Iā€™ve thought much over (and without considering the museum curation mindset, I imagine few people do). So, I can see why this is a potential problem, and frankly, I have no answer that I can give here, because opt-out is flawed in that respect.

But for me to feel the most fulfillment and enjoyment of using iNaturalist as my chosen archive and database, opt-out is still the way to go for me. I have that many observations and species that there are just too many cases for me to comfortably ā€œlet goā€. I still have a large number of obs where someone joined and IDed a random species that isnā€™t even from that continent, and using opt-in would diminish the value of those observations. Selectively opting-out is just too time-consuming and requires a lot of extra management, with the amount of observations I have.

Honestly itā€™s not so much a thirst to keep learning, although knowing the features to photograph is the crux of the hobby, so that I can provide better data in the long run. Itā€™s more a thirst for having the knowledge at least out there, on how this case was distinguished. BugGuide suffers from this a lot where an expert just moves something, and then 3 years later no one knows why or how that ID verdict was reached. This is especially pertinent for ā€œcitizen scientistsā€ or really even professional entomologists without the full expertise that one or two specialists have, and still want to help contribute to that dataset. Sometimes a search for literature answers, but itā€™s not always available or it is ambiguous. At least when I inquire, and an expert responds, that opinion can be expressed and referred to later.

7 Likes

The iNaturalist stengths are, in my opinion, LOTS of data points and the points are verifiable. (A researcher can check the records and decide if they are correct.)

Weaknesses are uneven sampling (geographically, taxonomically, in every possible way) and the identifications must be considered tentative until checked.

6 Likes

Actually, I think the opposite is true. I too work in museum collections and understand the pros and cons of each. When an iNat user passes on, the photo and the communityā€™s ability to modify IDs remains (unless they opted out of community IDā€“and in that case, those observations can be ignored or the researcher can document their own ID outside of iNat). Anyone who just downloads data from iNat (or a museum portal) and publishes with it is asking for biiiiig trouble. I donā€™t trust museum IDs in my own researchā€“I examine the specimens. I donā€™t trust iNat IDs in my own researchā€“I examine the specimens. I draw my own conclusions in both instances. Should museums be burned because we have iNat? Of course not. Should iNat have itā€™s plug pulled because we have museums. Of course not. They complement one another nicely.

7 Likes

Oh, yeah. The advantage is that a ton of data is provided for free, and easily accessible. The downside is that the quality/complexity of data is lower because the physical specimen is not present. Itā€™s a trade-off. Either way, any serious scientist has to double-check the accuracy of the data they use, of course!

3 Likes

The accuracy of iNatā€™s phenology will vary by species based on the volume of observations. In the case of insects, it is probably accurate for heavily recorded species, eg. Monarchs and Canadian Tiger Swallowtails, but possibly less so for an uncommon skipper. And in between there will be a distribution of accuracy. That is where other aggregators will be useful (like the Ontario Butterfly Atlas, which includes eButterfly, BAMONA and museum records). Of course, iNat data is a major component of datasets like the Atlas, so it depends on your level of interest.

On the other hand, I donā€™t know if there are other data sources for plants, but I suspect iNat may be the only one with accessible phenology for plants.

2 Likes

Whether this is a strength of the data or of the program itself is unlike other data repositories I can record everything in one place. Rather than uploading my birds to eBird and Ontario Breeding Bird Atlas, My herps to Ontario Reptile and Amphibian Atlas, My Invasives Species to EddMaps, my SARs and Rare Species to Natural Heritage Information Centre, My Ticks to eTick, My butterflies to eButterfly. I can put all my records in one place. If anything it has increased my interest and participation in these other projects but I much prefer if they have a project in INat that collects this data.

I routinely use INat to look for and manage Invasive Species in Northeastern Ontario.

12 Likes

iNat would greatly benefit from an eBird-style method of entering number of individuals observed for observations. Some people will upload 20 observations for 20 different plants of the same species they see, but people arenā€™t (and canā€™t be expected to) upload 20k observations for 20k, say, Snow Geese or Starlings. There should be a box under location on the Uploading page where users can enter the number of individuals observed. All prior observations to this should be marked with an ā€˜Xā€™, again taking from eBird.

3 Likes