Skip to content

Latest commit

 

History

History
136 lines (117 loc) · 2.41 KB

examples.md

File metadata and controls

136 lines (117 loc) · 2.41 KB
hide
navigation
footer
<style> .md-main .md-main__inner.md-grid { flex-direction: row-reverse; } </style>

Deployment

Deploy Llama 3.1 with vLLM

Deploy Llama 3.1 with TGI

Deploy Llama 3.1 with NIM

Fine-tuning

    <p>
        Fine-tune Llama 3 on a custom dataset using Axolotl.
    </p>
</a>

<a href="/examples/fine-tuning/trl"
   class="feature-cell">
    <h3>
        TRL
    </h3>

    <p>
        Fine-tune Llama 3.1 8B on a custom dataset using TRL.
    </p>
</a>

Accelerators

    <p>
        Deploy and fine-tune LLMs on AMD
    </p>
</a>

<a href="/examples/accelerators/tpu"
   class="feature-cell sky">
    <h3>
        TPU
    </h3>

    <p>
        Deploy and fine-tune LLMs on TPU
    </p>
</a>

LLMs

    <p>
        Deploy and fine-tune Llama 3.1
    </p>
</a>
<a href="/examples/llms/llama32"
   class="feature-cell sky">
    <h3>
        Llama 3.2
    </h3>

    <p>
        Deploy Llama 3.2 vision models
    </p>
</a>

Misc

    <p>
        Use Docker and Docker Compose inside runs
    </p>
</a>