See this question on Yahoo Answers. TLDR: You have to delete your questions and answers separately..