Regardless of where the defect originates, if you want people to be able to use your product in different environments, you gotta test in different environments. The user won't care whether your product looks like crap because of a browser defect or because of a product defect; all they know is that it looks like crap. Of course, strike a balance; don't bother developing for IE6 on WinXP anymore.
Doesn't this denote a defect on the browser's part?