I grew up in a village of 200 that had essentially no services. I wouldn't want to go back. After college I moved to Peoria IL -- I was OK with it but I didn't like the public schools. I now live in a town of about 30K not far from Peoria, so I can easily drive there for various things not available in my town. But honestly, I live a pretty simple life and don't often need to leave.
The sort of downtown I'm talking about has no high-rises -- we are talking old Courthouse squares surrounded by very old brick buildings! Some have been turned into cool spaces. Others hawk court-ordered drug and alcohol rehab services etc.