How to Collect Pairwise Preferences for Generative Art

We did this on Amazon Mechanical Turk where we showed people pairs of art pieces. We wanted to make sure that the preferences that we are collecting are along specific dimensions. And based on that, we collected preferences so that we can then check for correlations across these. So it's perhaps an interesting kind of, there's a lot of debate in AI right now in terms of sort of neural networks kind of reasoning pattern matching or if we need more symbolic reasoning to do these things.