My understanding of Kant isn't that the world exists outside of our brain, but that what we perceive as the world can never be determined because we perceive things differently. I mean, many of us don't even see the exact same colors for example. And this can be extended to quantum physics even when you consider that certain things are based on when they are observed.