Music problems on iPhone 4

I have an iPhone 4. I have some mp3 files loaded on it. When I play them without headphones/earbids ... then it sounds OK (although it's only coming out of the iPhone speaker). If I plug in earbuds, then I can hardly hear any vocal at all.