Agreed. Especially in cases (like earthworms) where organisms may not even be identifiable to family without dissection, or where the majority of photos do not show any identifying characteristics, the CV operating entirely on visual similarity are just guesses that cannot be backed up with anything solid.
There are also some taxa in the CV like the pheretimoid earthworms and genus Aporrectodea that are non-monophyletic–explicitly so for the pheretimoids, where Metaphire and Amynthas and others are separated based on genital pore type, which has both changed between some close relatives and is conserved between distantly related taxa. Visually and genetically similar worms may belong to different genera as currently defined by morphology. That does not sound like a situation that the CV should be applying any IDs past family (except for extremely distinctive species that can be sight ID’d at least in parts of their range).