The Discontinuities of GPT-3

I think the alien framing is really productive because you could imagine super intelligent aliens coming to earth and essentially extracting whatever value they want. There's no principle reason to rule out that agency or goal-directedness can emerge from these systems. So if that is the hard stop on this particular paradigmatic approach to creating generally intelligent systems, then I don't think we have a lot to fear. The problem is in the discontinuities. We came about as a result of a blind, largely brute force or entirely brute force optimization process evolution. And so it's impossible to rule out.