With scrappy you can parse the HTML, but in real world project, that's not the only task you need to do. You need to process the data as well. And when the data leaves scrappy, it's usable for whatever you want to use it for. So that's why I really like scrappy. But also, I think it's the best framework to maintain your spiders,. It will probably not work in the six months in the future, because the website changes or layout changes.