Like, look at your house. You may just have a 100 amp breaker box on it. Now you couldn’t handle a high-speed charger pulling 40 amps for your car, 30 for the hvac, 20 for lights/tv/computers etc, and then trying to get another 15 or so from and oven or vacuum cleaner. You’ll need a bigger amp breaker box
I'm not sure if you know this, but there are smart chargers that include a sensor to put on the feed going into your house. The charger can throttle up and down as you turn stuff on and off to keep the house's total power draw under the limit, so you run all your stuff and the car just gets whatever's left over. You can even have dozens of chargers in a parking garage and program the chargers to share a limited grid connection.
EVs aren't a fixed load, you can ramp them up or down or shut them off as needed, so they're pretty easy to accommodate.