If you haven't deleted them well then yes, they are visible, unread PM's can be read also and they will still look unread to you.
Every single one has been deleted, but I thought it might a bit like your computers hardrive, always there and accessable with the right software. As you say, if anybody would be bothered.