You are right. Any updates on site will require you to think about SEO so there is no lost traffic here is a QA wordpress you can use http://www.designwall.com/wordpress/plugins/dw-question-answer/ Also this is good seo plugin as well https://yoast.com/wordpress/plugins/seo/