Reconnecting and Black Screens on some Connections

This started happening this week and I cannot tie this to any specific event. But with some connections I get a black screen and a reconnecting message before it finally connects. If I use regular Remote Desktop connection I connect immediately and there are no issues connecting. If I go back to RDM and connect to that server it will work as expected. If I restart the server I have this problem until I connect with regular RDP and then RDM will work until I restart the server again.

This doesn't happen with all connections just some. It seems related to Windows server 2016 as well.

I see nothing in the Event viewer that explains what is going on here.

Running RDM free
2022.1.20.0 64-bit