Walkable cities are actually illegal in much of the US due to zoning laws right now. The reason you don't see shops in residential suburban developments is not because there is no demand, it's because it's literally illegal.
Having walkable and bikeable destinations is compatible with back yards. It just needs to be legal to build it.
In general, I believe that it's the highway lobby who shaped the US into what it is today, not the NIMBY people. I think they have much more power than nimby, even if in certain situations, they seem to be on the same side. So what I say is that industry interest weighs more than voter interest.
But the US also allows suburbs, and it turns out a ton of people prefer those, having backyards for their kids.
I love cities but I'm also well aware that tons of people don't want to be stuck in cities.