Why do you need all that? I have my work laptop sitting at the back of my desk. Most monitors have two inputs. I've got an older 1080 with HMDI+DVI and a newer 1440p with DP/2xHDMI.
So I have the laptop in HDMI on both screens (it needed a USBC to HDMI cable for one of the outputs), and a simple USB3 switch for the mouse+keyboard.
So when I'm working I fire up the laptop, switch the USB over to that and swap the screens to the HDMI inputs. When I'm done working I can fire up the desktop, swap inputs and USB and in seconds I'm switched over.
I've been doing it this way for years and years now.