Starlings and House Sparrows are both invasive in North America, but I suspect the real reason people dislike them so intensely has to do with how many people feed birds, and especially with how many people at least try to have nest boxes for bluebirds.
That means more people actually see the aggressive behavior of these species, and worse, they see it directed at their beloved bluebirds! (People really love bluebirds.) And then they tell each other about it. There are native species that can also be pretty aggressive (even at a bird feeder), but without the negative PR, people mostly don’t notice.
Here is a really cool article about a study they did on inter-species competitive behavior at bird feeders. Note that in the little diagram (which only shows the top 13 feeder species), the House Sparrow lands about in the middle, and the tough starling loses rather badly to the Red-bellied Woodpecker. https://www.allaboutbirds.org/news/when-136-bird-species-show-up-at-a-feeder-which-one-wins/
I recently started seeing golden crowned kinglets around my property and understand what you are talking about. They’re the hardest bird I’ve ever tried to take photos of.
Mine must be the Spanish slug. Even if it’s one of my favorite slugs, it’s invasive in my village and it’s SUPER annoying to always look around not to step on a sticky slug that eats your salad for you…
Most annoying species, aside from the classic invaders, is wineberries. Everytime I’m out there pulling other invasives along with wineberries somehow I get some of the tiny prickly thorny hairs stuck on my gloved hand. They somehow pierce the thick gloves and get stuck in my hand or fingers! Very annoying!
Pure evil. I hate when invasive plants are in the same genus as natives, but just better at life in North America, so they displace native populations.
Wineberries/other brambles
Asian mulberries/American mulberries
Oriental bittersweet/American bittersweet
Himalayan balsam/jewelweed
Norway maple/sugar maple
Humans. Just look at them with their plastic wrappers and petroleum burners and all their zoom-zoomers racing to get nowhere. They have trinkets and bobbles, mowed grassy lawns, blowers and cutters, diggers and pavers. All trying to make the world something they’re not afraid of. “And then! Oh, the noise! Oh, the noise! Noise! Noise! Noise! There’s one thing I hate! All the NOISE! NOISE! NOISE! NOISE!”