MP3 Recompression

Back in yonder days when I started copying all my CDs to the computer, I decided to maximize the quality by encoding them at 320kbps. Teeny bit of overkill there. Is it reasonable to try to recompress them to a lower bitrate? Or will that lower the sound quality too much? Admittedly I could just try it, but I thought I’d ask instead 🙂