Passthrough WITHOUT handoff?

Is there a way to have the host and guest use the same GPU? Handoff (where the host "loses" the GPU) is, for many reasons, useless for me.

I have an RX 7900XTX