delete text message

I`m trying to delete a contact out of my iphone.  The contact no longer appears in my contacts but when you go into messages and type in a recipient, the name comes up.  I noticed that when I search the name some old text messages come up but when you click on them they lead nowhere.  I`m guessing these messages need to be gone for the contact to stop showing up.  How do you delete them?