Fine-tune a language model with Microsoft Foundry
Intermediate
Data Scientist
AI Engineer
azure-ai-foundry
Train a base language model on a chat-completion task. The model catalog in Microsoft Foundry offers many open-source models that can be fine-tuned for your specific model behavior needs.
Learning objectives
By the end of this module, you'll be able to:
- Understand when to fine-tune a model.
- Explore different fine-tuning techniques including supervised fine-tuning, reinforcement fine-tuning, and direct preference optimization.
- Prepare your data to fine-tune a chat completion model, including generating synthetic data.
- Fine-tune a base model in the Microsoft Foundry portal.
Prerequisites
Before starting this module, you should be familiar with fundamental AI concepts and services in Azure.