Transforming Sound From The Transformers