Show HN: Open-source fine-tuning in a Colab notebook https://ift.tt/KHda76o

Show HN: Open-source fine-tuning in a Colab notebook Posted before, but wanted to share if you want an open source alternative to OpenAI fine-tuning, give Unsloth a try! Phi 3.5 was just released, and is distilled from GPT4. Unsloth makes finetuning 2x faster, uses 70% less VRAM + has no accuracy degradations. We rewrite all backprop steps and reduce FLOPs and write everything in Triton (JIT low level CUDA). If you want to own the weights after fine-tuning, give Unsloth a spin! I have free Colabs and Kaggle notebooks as well at https://ift.tt/3vEWC24 https://ift.tt/VftEcjs August 20, 2024 at 10:34PM