How to Deploy Machine Learning Models in the Wild?

There are three or four general setups you might have for deploying machine learning models. One is probably the most widely used still, which is a batch recommendation. Another way of deploying these types of models is to do on line predictions. The problem of actually serving these predictions is more traditional, soft engineering. If it needs to be served over anapi in real time to customers, there's obviously speed and other requirements.