A bit late to the discussion, but I face this issue constantly when working with myriapods (millipedes and centipedes): No matter where on Earth the observation was taken, the algorithm reliably suggests almost any dark millipede with yellow spots as Harpaphe haydeniana (a species in a genus restricted to Western North America), any long, banded millipede as either Narceus (Central-Eastern North America) or Paeromopus (California endemic), and any pale millipede (or frequently, beetle grubs) as the California endemic Xystocheir dissecta. I spend much time correcting these frequent mis-IDs: Like many invertebrate groups, myriapods at the species level are poorly known among the general public (or even biologists), and misidentification is rampant online. I think the AI is clearly biased by historic & current user base (California, North America). My question is: how do we bap the AI on the nose and say “NO!” (or how do we boost the “I” in AI)? Does setting Establishment statuses (e.g. “endemic to California”, “Native to the the United States”) lower the probability of that taxon (and/or its constituent taxa) being suggested in Asia or anywhere else? Maybe if an out-of-range suggestion is chosen by a user, a checkpoint message could be raised, something to the effect of “this taxon doesn’t appear to be known from this area, do you wish to proceed?”
Update (May 12): After poking around in some other observations I admit that I may be seeing a biased assortment myself, seeing only the obviously wrong IDs, and missing ones that don’t cross my radar because they were correctly suggested (either by AI or the user). I don’t have access to all the data, but I do see that the AI ranks certain suggestions higher or lower based on geography, contrary to my hyperbolic claim of “No matter where on Earth the observation was taken…”. I don’t think the AI is fatally flawed, but still would like to see some more cooperation between people and machines, e.g. maybe in the form of a checkpoint when choosing a taxon not known from the continent, as described above.