Feature: Add inference recipes

[iankouls-aws]

Describe the feature you'd like

It is nice that there are so many pre-training and fine-tuning examples in this project. It would be great to add examples of how to deploy these models and use them for offline/batch job and online/service inference.

How would this feature be used?

Once I pre-train or fine-tune a model, I would like to serve it on SageMaker HyperPod, and use it either by submitting curl requests, or through a simple grad.io or other UI.

[julianhr]

Hi @iankouls-aws

Thank you for the feature request. We have created an internal backlog action item for it. We'll keep the ticket updated with any new information.