:func:`deepspeed.init_inference` returns an inference engine of type :class:`InferenceEngine`.

for step, batch in enumerate(data_loader):
    #forward() method
    loss = engine(batch)

.. autofunction:: deepspeed.InferenceEngine.forward