Ubuntu Multimedia :: Setting-up System As Remote Desktop To Feed House-wide Audio?

We're in the final process of building a home, and I had them setup a wiring box where all the coax and cat5 terminates into one closet, which will also house my server. Once we get moved in I'd also like to add speakers in each room to have house-wide music, and ideally I'd like the audio to also run into this box with the master input coming from the server as well.My thought was to setup the server with some basic desktop manager like Fluxbox and use that to drive audio throughout the house, whether it be Pandora, Sirius Radio, or whatever. Since the server will be headless I'll need it setup so we can remote into it from our laptops, but I wasn't sure if VNC or some other RDP variant would work. Ideally we'll need to access a unified desktop so traditional terminal services where each users gets their own desktop might not be ideal