Published on July 29, 2024, an open-source Colab notebook fine-tunes Llama 3 8B with domain knowledge generated by Llama 3 405B.
Published on July 29, 2024, this material presents an open-source Colab notebook that fine-tunes Llama 3 8B using domain-specific knowledge generated by Llama 3 405B. It is intended as a starting point for engineers seeking to transfer knowledge from a larger model to a smaller one.
The available summary does not detail evaluation results or execution requirements. Consult the original notebook to check its code, data, dependencies and terms of use before reproducing the experiment. If you use AI to study or adapt the material, avoid entering personal data or internal information without authorization, and verify outputs before applying them.