Learning to Listen over a Brew