i used this function in CS all the time. this is my first time trying to use it in CS3 and the image quality looks compressed...shows bad quality...although when save for web i choose 100 quality jpeg.
I generally stick with the presets from the dropdown menu and get pretty good results when using the JPEG High preset. Save for web is a compressed option so it won't be pristine. It does a pretty good job imho.