# Seems like the CV suggestions in the web Upload screen might be based on a cropped image **URL:** \ **Category:** General\ **Tags:** web\ **Created:** [May 1, 2024, 12:54am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000 "2024-05-01T00:54:48Z")\ **Posts on this page:** 15\ **Page:** 1
**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\ **Post date:** [May 1, 2024, 12:54am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/1 "2024-05-01T00:54:48Z")
(This might be a quirk more than a bug exactly, but I wanted to point it out to see if it sparks any thoughts. Maybe others can verify this behavior? I’m using a Win 11 laptop running Chromium Edge browser.) I knew that the way the Computer Vision (CV) evaluates images on the web Upload screen is different from the way CV evaluation works on the Observation detail page, but I thought the differences were _conceptually_ minor. I always thought both were effectively evaluating a resized image, but it seems like the web Upload page might be cropping the image (as a square, keeping the ~~right side?~~ center) before resizing and evaluating it. Here’s an example case. Open the Observation detail page for this observation: [https://www.inaturalist.org/observations/212423206](https://www.inaturalist.org/observations/212423206). If you look at the suggestions that the CV provides on that page, they seem reasonable (Turkey Vulture): ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/b/6/b66acfbbc1d9ff9f3d1ee44ffeace6d932c6fd38.png) Now I’m gong to upload different variants of the image in the web Upload screen and compare the suggestions: - original 3840px x 2160px image → Swifts: - resized 2048px x 1152px image → Swifts (same as before): - square-cropped 2160px x 2160px image (keeping the left side of the image) → Turkey Vulture: - square-cropped 2160px x 2160px image (keeping the center of the image) → Swifts (but slightly different than suggestions for the original image): - square-cropped 2160px x 2160px image (keeping the right side of the image) → Swifts (same as suggestions for original image, but no higher-than-species suggestion): The suggestions for the uncropped images are bad. The cropped-keeping-right image seems to match those bad suggestions more or less, and the center-cropped image suggestions seem to be similar, too. So it seems like the suggestions on the Upload page might be based on a cropped image of some sort. (I didn’t test what happens for an image that is taller than wide, but I assume it’ll have similar results.) ---
**Author:** ![chrisangell](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/chrisangell/32/20651_2.png) [@chrisangell](https://forum.inaturalist.org/u/chrisangell)\ **Post date:** [May 1, 2024, 11:47pm UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/2 "2024-05-01T23:47:51Z")
I’d be interested to see, if you flipped that first photo horizontally (so the vulture is in the right side), does it indeed use the right side of the image to give better suggestions? That would be a way to test whether your suggestion that it’s keeping just the right side is correct. ---
**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\ **Post date:** [May 2, 2024, 12:03am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/3 "2024-05-02T00:03:09Z")
that’s a good suggestion. it looks like after flipping, the CV suggestions are still bad. so it must be effectively a center crop. also, maybe it’s not a crop then resize. maybe it’s just a reize based on the minimum dimension (instead of based on the max) and then a crop after that. (i guess i could just look at the code to see exactly what it’s doing.) ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/0/8/08e00bceb7f1f291aa5814f566f525bb31fd6dee.png) it’s worth noting that the aspect ratio of the image is 16:9 (since it’s a still from a video). so it’s relatively wide versus tall. if it were a 3:2 or 4:3 aspect ratio instead, it would be much less likely that the subject would ever fall outside of the center square. so maybe that’s why the weirdness is hard to notice. ---
**Author:** ![egordon88](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/egordon88/32/29204_2.png) [@egordon88](https://forum.inaturalist.org/u/egordon88)\ **Post date:** [May 3, 2024, 3:50am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/4 "2024-05-03T03:50:42Z")
If this deserves its own thread, that’s fine ![IMG_0755](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/1/1/1102559bd5790fc38cf10b33ddf9b9561ef6edc9.jpeg) ![IMG_0756](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/e/6/e67cb653f3567353c3a9fb3e0100c19f304702a3.jpeg) Location and date and time were set, privacy open, not marked captive … what’s going on here? Is it my back of camera image and cropping? ---
**Author:** ![thebeachcomber](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/thebeachcomber/32/12748_2.png) [@thebeachcomber](https://forum.inaturalist.org/u/thebeachcomber)\ **Post date:** [May 3, 2024, 3:53am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/5 "2024-05-03T03:53:18Z")
yeah I wonder if it’s the fabric background ---
**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\ **Post date:** [May 3, 2024, 4:05am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/6 "2024-05-03T04:05:41Z")
is this the android app? did you load an image into the app, crop in the app, and then get the cv suggestion? ---
**Author:** ![egordon88](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/egordon88/32/29204_2.png) [@egordon88](https://forum.inaturalist.org/u/egordon88)\ **Post date:** [May 3, 2024, 5:05am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/7 "2024-05-03T05:05:32Z")
iOS app and photo was cropped before uploading ---
**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\ **Post date:** [May 3, 2024, 6:45am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/8 "2024-05-03T06:45:42Z")
hmmm… i don’t have an iOS device to play around with, and it’s going to take me more time than i’m willing to spend to study the iOS app code to figure out exactly what it’s doing in your case. it looks like it’s using the same computer vision API to evaluate images as the web Upload screen, but i haven’t figured out exactly what the iOS app is sending to be evaluated. it looks like it’s trying to send a small cached version of the image, but i haven’t figured out what that means exactly. i’m guessing it might be doing some sort of crop because if i do a crop to get the center 240px x 240px (without resizing), i get a mix of results akin to what you’re seeing: ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/c/7/c78f81dbb9b06044c8f1c12da78e9ca2472a0c9c.jpeg) however, the question in my mind is: why would you see a problem in this particular case and not in other cases? are you seeing the problem only here? if so, is there something different about this photo vs other photos? is there something unusual about the process you used to upload in that particular case? ultimately, i think your example is probably a little different than whatever is going on in the web Upload screen, but in both cases, i’d guess that they’re probably doing unexpected (but probably different) transformations of the image that they’re sendng to the CV API to be evaluated. ---
**Author:** ![egordon88](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/egordon88/32/29204_2.png) [@egordon88](https://forum.inaturalist.org/u/egordon88)\ **Post date:** [May 3, 2024, 7:08am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/9 "2024-05-03T07:08:54Z")
I can’t be sure, but I think this is the first time I’ve had vertebrates suggested first on a moth photo. The all white background of the sheet confuses the CV a fair amount, but it usually associates it with some type of insect. Thanks for taking the time to look into this. ---
**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\ **Post date:** [May 10, 2024, 1:46pm UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/10 "2024-05-10T13:46:09Z")
> [@egordon88](#): > > iOS app and photo was cropped before uploading hey.-- quick clarification: did you crop in the iNat app? or did you crop outside the iNat app? ---
**Author:** ![egordon88](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/egordon88/32/29204_2.png) [@egordon88](https://forum.inaturalist.org/u/egordon88)\ **Post date:** [May 10, 2024, 1:56pm UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/11 "2024-05-10T13:56:04Z")
Outside, using the built in iPhone photos app editing tools. ---
**Author:** ![jasonhernandez74](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/jasonhernandez74/32/33615_2.png) [@jasonhernandez74](https://forum.inaturalist.org/u/jasonhernandez74)\ **Post date:** [May 10, 2024, 10:00pm UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/12 "2024-05-10T22:00:39Z")
> [@pisum](#): > > did you crop in the iNat app? I don’t know about iOS, but it is possible to crop in the Android app. You have to add the photo to the observation, then click on it to open it in edit mode. I recently discovered that this can be done after upload, too, by opening the observation for editing. ---
**Author:** ![pisum](https://avatars.discourse-cdn.com/v4/letter/p/91b2a8/32.png) [@pisum](https://forum.inaturalist.org/u/pisum)\ **Post date:** [May 11, 2024, 5:07am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/13 "2024-05-11T05:07:59Z")
i’m not sure if this applies in your case, but i would watch the progress on this and see if its resolution also resolves your case: [https://forum.inaturalist.org/t/inat-ai-bizarre-misidentifications-suggestions/51187/15](https://forum.inaturalist.org/t/inat-ai-bizarre-misidentifications-suggestions/51187/15) ---
**Author:** ![jewelwing66](https://sea2.discourse-cdn.com/flex016/user_avatar/forum.inaturalist.org/jewelwing66/32/34926_2.png) [@jewelwing66](https://forum.inaturalist.org/u/jewelwing66)\ **Post date:** [May 11, 2024, 6:17am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/14 "2024-05-11T06:17:22Z")
That’s exactly how I crop my photos too (iPhone with iOS 16.3.1), before submitting them using the iNat app. Here are some screenshots of iNat suggestions for my moths (notice it got the Three-spotted Fillip right when I used an uncropped image). ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/5/1/5113a67e96d4729650fb16a32feaf5c9be2f6b73.jpeg) ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/8/d/8d7ca2ab16ad9e0933858eced8877b1d5ff8c6fb.jpeg) ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/a/e/ae602d97527671c87721d6c3d2f4b421cbcba2d3.jpeg) ![image](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/3X/d/c/dc4dd803cc9360cbc3605b88621515995c6b525f.jpeg) ---
**Author:** ![system](https://us1.discourse-cdn.com/flex016/uploads/inaturalist/original/2X/7/7831452cf7f0d653ff1ffd34176334b7ef1b6a17.png) [@system](https://forum.inaturalist.org/u/system)\ **Post date:** [July 10, 2024, 6:18am UTC](https://forum.inaturalist.org/t/seems-like-the-cv-suggestions-in-the-web-upload-screen-might-be-based-on-a-cropped-image/51000/15 "2024-07-10T06:18:13Z")
Closed on July 10, 2024, 6:18am UTC This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.