Yep this has been my hold up. It is mostly just a solution in search of a problem.
The best use case I have come up with is if you have an nice computer and an extra GPU laying around. You could turn the single computer into two workstation/gaming computers.
I have upgraded my GPU on my desktop without upgrading anything else. Leaving me with a spare GPU and no other hardware.
Self hosting, I have also pulled GPUs out of systems to keep the power requirements down. As most of the time onboard GPUs are just fine for Self hosting applications. Also leaving me with a spare GPU.
However over the years GPUs have because more popular for processing there are more arguments to keep the GPU in a home server. So I can see how this is going away.