Skip to content

Radar ·

Notebook transfers domain knowledge to Llama 3 8B

Published on July 29, 2024, an open-source Colab notebook fine-tunes Llama 3 8B with domain knowledge generated by Llama 3 405B.

Published on July 29, 2024, this material presents an open-source Colab notebook that fine-tunes Llama 3 8B using domain-specific knowledge generated by Llama 3 405B. It is intended as a starting point for engineers seeking to transfer knowledge from a larger model to a smaller one.

The available summary does not detail evaluation results or execution requirements. Consult the original notebook to check its code, data, dependencies and terms of use before reproducing the experiment. If you use AI to study or adapt the material, avoid entering personal data or internal information without authorization, and verify outputs before applying them.

Original source: Fine-tuning do Llama 3 8B com conhecimento gerado pelo Llama 3 405B

Curation · AgentLog

Get the essentials

Privacy, AI engineering and security in your inbox.

At most one digest per day, when there is news. Cancel at any time. We use your account's verified email.

Privacy

Looking for something else?DocumentationContact