I am not familiar with HEv2 or ADTS, but if have sample URLs that you want me to test on 20H1, please just send them to me or let me know where to find them and I'll report the results I get.
I tried running using Contest.exe on the 20H1 device, apparently it has the same issue, a bit worse. On the first run, it froze for a couple of minus (similar to what we had in UWP), then crashed. On the second run, it took the same few minutes then actually started playing the audio. I then reran the exact command on another device with older windows and it played just fine within a few seconds.
So, the issue is reproducible with Contest as well which I believe rules out bad configuration on our app's side.
Let me know if you have any further suggestions.
Thank you.