Did you remove them by going to their profile and clicking Remove friend? I've had issues using this method before. Try going to My account > Friends & Foes > Manage friends (Or just click
here), Select their username (you can only select one at a time), and click Submit.