I have known for some time that there was a work being done on improving the sound handling in GNOME, but I somehow missed out on it until today. Decided to test a USB headset and figured I would need to edit a GStreamer pipeline to get Banshee to output to this USB device. Then someone pointed out that there is GNOME sound properties now which I then used and noticed a ‘USB audio’ option having popped up. And it just worked.
So to the authors of gnome sound properties a big thank you from a happy user!