Yep! I couldn't agree more. My '01 Limited had the 6-disc changer and I used it quite a bit. When I was shopping for my '11 HL I decided to go for the SE model (mostly to avoid the silly 19" wheels) which meant I wasn't getting a 6-disc changer.
But I quickly found out that the USB port and more importantly the Bluetooth streaming audio gave me capabilities far beyond what the 6-disc changer ever could. I can now have hundreds upon hundreds of songs at my finger tips. What I find myself using most is the Bluetooth streaming from my iPhone. The sound quality is astonishing and I don't even need to take the phone out of my pocket.
At this point I would consider going to a 6-disc changer as a step backwards.