How to Optimize Your Machine Learning Model

We had to build a lot of infrastructure around AB testing and measuring the impact of our model. Quality is a very abstract concept, there's no single metric quantitative way to put a number to quality. So really it comes down to a lot of auditing, right? Qualitative stuff. We even have interviewed our labelers in the past to ask them how the tools are working for them. Just that word of mouth feedback to further improve our model.