Feedback for vision language demo

I found out about this tool today and tried to test it with the simplest description possible.

Settings - taxon: Fulgoridae & description “a completely green bug with yellow with a long head which has a yellow tip and yellow spots on the forewings bordered with black.”

The only thing with such coloration in the family is Saiva nodata. Otherwise the head is not long and green tipped with yellow.

However I did not see that species anywhere.

This is just feedback, so take it positively. I wish we had a way to explain what we were looking for etc when giving feedback.

you may want to read this, if you haven’t already: https://www.inaturalist.org/blog/95911

It’s just a demo designed to test the concept of natural language queries, rather than being a finished tool. The language model wasn’t trained on iNaturalist data, and only a subset of iNaturalist photos was used. So if your target species isn’t in that subset, the demo won’t find it.

Also, your description is far from being the simplest possible. If you try “green with yellow spots” along with taxon Fulgoridae, the results do at least include one species from the genus Saiva. However, refining the taxon filter doesn’t improve matters. Thus, using tribe Pyropsini only returns species from the genus Pyrops, and using genus Saiva gets no hits at all - which obviously demonstrates the limitations of the training data.