I have upgraded my GPU on my desktop without upgrading anything else. Leaving me with a spare GPU and no other hardware.
Self hosting, I have also pulled GPUs out of systems to keep the power requirements down. As most of the time onboard GPUs are just fine for Self hosting applications. Also leaving me with a spare GPU.
However over the years GPUs have because more popular for processing there are more arguments to keep the GPU in a home server. So I can see how this is going away.