As far as I know it’s a known issue and I agree, it’s annoying…
https://forum.inaturalist.org/t/identify-modal-sometimes-shows-information-from-previous-observation/8408