Wikipedia place page fragment is indexed by search engines

Platform (Android, iOS, Website): Website

URLs (aka web addresses) of any relevant observations or pages:

https://www.inaturalist.org/places/wikipedia/Botany%20Bay

Screenshots of what you are seeing (instructions for taking a screenshot on computers and mobile devices: https://www.take-a-screenshot.org/):

This is from the forum thread in General linked below, showing how the page fragment looks:

Description of problem (please provide a set of steps we can use to replicate the issue, and make as many as you need.):

As raised by @graysquirrel in https://forum.inaturalist.org/t/whats-with-the-places-wikipedia-pages-on-inat/57663 the iNat website html fragments containing wikipedia place descriptions show up in Google searches filtered by site://https://www.inaturalist.org/. These fragments, like https://www.inaturalist.org/places/wikipedia/Botany%20Bay , which comes up as the first hit when you search Google for botany bay site://https://www.inaturalist.org/, are not generally useful to end users. They are apparently there to provide content the “About” tab of iNaturalist place pages. In this case, the user-facing page is https://www.inaturalist.org/places/botany-bay--2 and that result also comes up in the same Google search.

Fortunately, the solution is simple. Add Disallow: /places/wikipedia/* to https://www.inaturalist.org/robots.txt and Google and other search engines will stop indexing these page fragments, while not affecting the indexing of the user-facing place pages themselves.

1 Like

When I saw that it said “bug reports” I thought it was about reporting an actual literal bug. Like a insect or spider.

1 Like

I never use Google search so I was confused at first but I was able to replicate. Made an issue: https://github.com/inaturalist/inaturalist/issues/4272

1 Like