Why are you concerned about a lack of power? Toyota sold a billion Corollas/Matrix/Vibes with that drivetrain/platform. Seems like a the motoring masses are fine with it.
Heck, I'm totally fine with ~50 hp in my ~1800 lb car (Firefly) and, yes I've driven it in & around Toronto. (I'd suggest a 49 hp Geo Metro XFi, but they were never sold in Canada
)
If you're looking for an "entertaining" drive, I'd say change your game!
So I'm going to second Daox's advice and suggest you try a used 2004+ Prius. It's a rolling video game - a different kind of game that is dead reliable and will get phenomenal mileage in your typical use (mostly 50 mph driving). It's probably the most entertaining car I've ever driven, in a nerdy sort of way (not that there's anything wrong with that). More room inside than the Matrix/Vibe, too.
Like you, I also
strongly prefer a manual transmission, but I'd give up a stick for the Prius electronic CVT.