I used it up to about a year ago, and at that time it wasn't really bloated. Most of the extras are all offered through plug-ins which, much like Firefox, keep the main application pretty light.
Once Windows Media Player 11 hit I really liked it and have stuck with it, not to mention that it WMP11 integrates with my online XM radio.