I also like envisioning how we can “see” a holographic image, just re-created by pure sound. If one think about that, and the tolerances involved for our brain to re-create such a holographic imaging, then it is clear (to me) that our brain is amazing at compute sound based on timing. Otherwise this is not possible to recreate in our brain. Those timing tolerance is really amazing and makes sense to me if they are challenging to measure. Now this does of course not relate or explain your issue, but is more a way to illustrate why i think timing is incredible important as we convert from digital into analogue.
Alpha Audio - Haarlem - Netherlands