The Impact of Data Sets on Summerization Research

Using human as your source of data could introduce some problems. They could be fatigued, or they could misunderstand something and lack a certain context. Are there any techniques that are useful for refining the results you get back from the participants? What's the impact of data sets on automated summerization research? This is very important.