The Importance of Reliability in AI

There seems to be an implicit assumption in a lot of people's AI predictions that they're like, oh, these systems are temporarily low reliability, but in the future, they'll just magically become higher reliability. And I don't know how safe that assumption is because it's easy to assume that you can take something that is currently low reliability and just assume that, yeah, hand wave away, it'll just get more reliable.