I have already experienced it in small ways.
After paying off my mortgage, I decided it was time to get some damage to my car's body repaired. I discovered the repair shop was out of business. There are still others, but much further away making it a hassle. And, of course, there are only still others "for now".
On the drive to my farm I had specific gas stations where I liked to stop: clean bathrooms and not too busy. Every single one of the gas stations I would stop at are now out of business. Of course, there are still others "for now".
I haven't lost a dime in this economy. In fact, I actually benefitted from the downturn economically. Yet, for all my money, I still lost the above things. Apparently, those of us who could still frequent these businesses weren't enough to keep them alive.
If the customer base shrinks far enough, the wealthy will find life increasingly inconvenient. If only the wealthy can afford a car, their car buying options are going to become very limited.
And that doesn't even take into account crime and the possibility of civil unrest.
There is a reason the rich live better lives in countries where they share the wealth than in countries where a plutocracy hordes everything. And their inability to understand this could qualify them as delusional.