Session disconnects and only sometimes comes back

We have been having many issues where the session quickly reconnects showing a messaging stating that it is reconnecting. When it does this the display locks up in a way that when we click on something it displays nothing on our screen. If we right click on the session in along the top and click reconnect the session comes back and whatever we tried to click on is already open. It looks like the mouse clicks are being passed through the session but not displaying in the session window.

there have also been times where it will never come back to us and it gives us a black screen. When this happens the only way to get back into the machine is to reboot it completely. When we get the black screen issue we are unable to log into the machine with native remote desktop and the only way to get in is via the hypervisor console window. We see in the event viewer the following error:


Log Name: Application
Source: Microsoft-Windows-Winlogon
Date: 11/7/2016 9:55:43 AM
Event ID: 4005
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: ServerName.DomainName
Description:
The Windows logon process has unexpectedly terminated.
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="Microsoft-Windows-Winlogon" Guid="{DBE9B383-7CF3-4331-91CC-A3CB16A3B538}" EventSourceName="Winlogon" />
<EventID Qualifiers="49152">4005</EventID>
<Version>0</Version>
<Level>2</Level>
<Task>0</Task>
<Opcode>0</Opcode>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2016-11-07T14:55:43.000000000Z" />
<EventRecordID>13914</EventRecordID>
<Correlation />
<Execution ProcessID="0" ThreadID="0" />
<Channel>Application</Channel>
<Computer>ServerName.DomainName</Computer>
<Security />
</System>
<EventData>
<Binary>05400080</Binary>
</EventData>
</Event>


I have done some research and found that this could be due to bitmap caching so I have disabled that for all of our sessions. I was hoping that would resolve the reconnect issue but since making that change I have already seen the display issue crop up again. I have not seen the complete lock up as of yet but I just made he bitmap cache change an hour or so ago.

Any thoughts and assistance would be greatly appreciated.