Use Remote Desktop Manager with Azure AD App Proxy Pre Auth and Devolution Password Server
Also want to chime in here as potential new customer currently running a POC. It is very important to us, we are able to have the RDM working through Azure Application Proxy. Pass-through auth is unfortunately a "no-go".
Thanks,
Henrik Walther