Fine-tuning open AI models using Hugging Face TRL
Tutorial: Fine-tune Gemma 2 with Hugging Face TRL on GKE → https://goo.gle/3ZcLQiL
Hugging Face Deep Learning containers → https://goo.gle/3Otahn3
Docs: Hugging Face TRL → https://goo.gle/3ZgsyJs
Supervised fine-tuning of a pre-trained language model teaches a model to become better at a certain task by showing it many examples of input and their desired output. A smaller, fine-tuned model can actually outperform a much larger, general-purpose model on those specific tasks. Join Googler Wietse Venema as he dives into fine-tuning open models using Hugging Face Transformer Reinforcement Learning (TRL) using Google Kubernetes Engine (GKE).
More resources:
Learn more about Parameter Efficient Tuning (PEFT) → https://goo.gle/4eUb6js
Watch more Google Cloud: Building with Hugging Face → https://goo.gle/BuildWithHuggingFace
Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
#GoogleCloud #HuggingFace
Speaker: Wietse Venema
Products Mentioned: Gemma, Google Kubernetes Engine (GKE)
Hugging Face Deep Learning containers → https://goo.gle/3Otahn3
Docs: Hugging Face TRL → https://goo.gle/3ZgsyJs
Supervised fine-tuning of a pre-trained language model teaches a model to become better at a certain task by showing it many examples of input and their desired output. A smaller, fine-tuned model can actually outperform a much larger, general-purpose model on those specific tasks. Join Googler Wietse Venema as he dives into fine-tuning open models using Hugging Face Transformer Reinforcement Learning (TRL) using Google Kubernetes Engine (GKE).
More resources:
Learn more about Parameter Efficient Tuning (PEFT) → https://goo.gle/4eUb6js
Watch more Google Cloud: Building with Hugging Face → https://goo.gle/BuildWithHuggingFace
Subscribe to Google Cloud Tech → https://goo.gle/GoogleCloudTech
#GoogleCloud #HuggingFace
Speaker: Wietse Venema
Products Mentioned: Gemma, Google Kubernetes Engine (GKE)
Google Cloud Tech
Helping you build what's next with secure infrastructure, developer tools, APIs, data analytics and machine learning....