Fine-tune Google Gemma with Unsloth and Distilled DPO on Your Computer
Following Hugging Face’s Zephyr recipe Generated with DALL-E Finding good training hyperparameters for new LLMs is always difficult and time-consuming. With Zephyr Gemma 7B, Hugging Face seems to have found…