![](\"https://i.postimg.cc/KzQ5rfBC/button.png\"width=\"150\")
\n",
" ![](\"https://i.postimg.cc/L4wPdG9N/join-2.png\")
\n",
" \n",
" Join our Discord if you need help + ⭐ Star us on Github ⭐\n",
"| Step | \n", "Training Loss | \n", "
|---|---|
| 1 | \n", "7.342400 | \n", "
| 2 | \n", "7.534600 | \n", "
| 3 | \n", "9.473700 | \n", "
| 4 | \n", "4.720600 | \n", "
| 5 | \n", "5.680200 | \n", "
| 6 | \n", "3.815700 | \n", "
| 7 | \n", "5.580000 | \n", "
| 8 | \n", "4.242500 | \n", "
| 9 | \n", "5.318600 | \n", "
| 10 | \n", "4.605900 | \n", "
| 11 | \n", "5.133800 | \n", "
| 12 | \n", "3.160600 | \n", "
| 13 | \n", "2.873900 | \n", "
| 14 | \n", "2.490700 | \n", "
| 15 | \n", "2.824400 | \n", "
| 16 | \n", "8.742200 | \n", "
| 17 | \n", "11.397600 | \n", "
| 18 | \n", "3.157300 | \n", "
| 19 | \n", "3.475900 | \n", "
| 20 | \n", "2.405500 | \n", "
| 21 | \n", "1.764400 | \n", "
| 22 | \n", "4.982500 | \n", "
| 23 | \n", "3.095300 | \n", "
| 24 | \n", "1.628900 | \n", "
| 25 | \n", "1.476900 | \n", "
| 26 | \n", "0.821400 | \n", "
| 27 | \n", "0.791900 | \n", "
| 28 | \n", "0.864900 | \n", "
| 29 | \n", "0.781200 | \n", "
| 30 | \n", "0.491400 | \n", "
| 31 | \n", "0.648500 | \n", "
| 32 | \n", "0.412500 | \n", "
| 33 | \n", "0.450900 | \n", "
| 34 | \n", "0.313500 | \n", "
| 35 | \n", "0.394900 | \n", "
| 36 | \n", "0.227000 | \n", "
| 37 | \n", "0.213300 | \n", "
| 38 | \n", "0.202700 | \n", "
| 39 | \n", "0.190500 | \n", "
| 40 | \n", "0.086400 | \n", "
"
]
},
"metadata": {}
}
],
"source": [
"dtrainer_stats = trainer.train()"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "ekOmTR1hSNcr"
},
"source": [
"\n",
"### Inference\n",
"Let's run the model! You can change the instruction and input - leave the output blank!"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {
"id": "kR3gIAX-SM2q",
"colab": {
"base_uri": "https://localhost:8080/"
},
"outputId": "4a94b91e-43ef-4cee-a412-f5d9ea6a10bb"
},
"outputs": [
{
"output_type": "execute_result",
"data": {
"text/plain": [
"[' ### Instruction:\\nExplain how can I stay up to date with the CAMEL community.\\n\\n### Input:\\n\\n\\n### Response:\\nTo ensure that contributors can keep informed about upcoming meetings and community engagement, the CAMEL community emphasizes the importance of joining communication channels such as Discord, WeChat, and Slack.']"
]
},
"metadata": {},
"execution_count": 11
}
],
"source": [
"FastLanguageModel.for_inference(model) # Enable native 2x faster inference\n",
"inputs = tokenizer(\n",
"[\n",
"\n",
" AlpacaItem(\n",
" instruction=\"Explain how can I stay up to date with the CAMEL community.\",\n",
" input=\"\",\n",
" output=\"\", # leave this blank for generation!\n",
" ).to_string()\n",
"\n",
"], return_tensors = \"pt\").to(\"cuda\")\n",
"\n",
"outputs = model.generate(**inputs, max_new_tokens = 512, use_cache = True)\n",
"tokenizer.batch_decode(outputs)"
]
},
{
"cell_type": "markdown",
"metadata": {
"id": "xSepmhPrgOct"
},
"source": [
"**Summary**\n",
"\n",
"\n",
"We have generated realistic user queries and responses from a real page and trained on them to produce a model that understands the underlying content."
]
},
{
"cell_type": "markdown",
"source": [
"That's everything: Got questions about 🐫 CAMEL-AI? Join us on [Discord](https://discord.camel-ai.org)! Whether you want to share feedback, explore the latest in multi-agent systems, get support, or connect with others on exciting projects, we’d love to have you in the community! 🤝\n",
"\n",
"Check out some of our other work:\n",
"\n",
"1. 🐫 Creating Your First CAMEL Agent [free Colab](https://docs.camel-ai.org/cookbooks/create_your_first_agent.html)\n",
"\n",
"2. Graph RAG Cookbook [free Colab](https://colab.research.google.com/drive/1uZKQSuu0qW6ukkuSv9TukLB9bVaS1H0U?usp=sharing)\n",
"\n",
"3. 🧑⚖️ Create A Hackathon Judge Committee with Workforce [free Colab](https://colab.research.google.com/drive/18ajYUMfwDx3WyrjHow3EvUMpKQDcrLtr?usp=sharing)\n",
"\n",
"4. 🔥 3 ways to ingest data from websites with Firecrawl & CAMEL [free Colab](https://colab.research.google.com/drive/1lOmM3VmgR1hLwDKdeLGFve_75RFW0R9I?usp=sharing)\n",
"\n",
"5. 🦥 Agentic SFT Data Generation with CAMEL and Meta Models, Fine-Tuned with Unsloth [free Colab](https://colab.research.google.com/drive/1fdBns2QA1XNwF_tsvG3Hc27QGdViHH3b?usp=sharing)\n",
"\n",
"6. 🦥 Agentic SFT Data Generation with CAMEL and Qwen Models, Fine-Tuned with Unsloth [free Colab](https://colab.research.google.com/drive/1sMnWOvdmASEMhsRIOUSAeYuEywby6FRV?usp=sharing)\n",
"\n",
"Thanks from everyone at 🐫 CAMEL-AI\n",
"\n",
"\n",
"
\n",
" \n",
" \n",
"⭐ Star us on Github , join our [*Discord*](https://discord.camel-ai.org) or follow our [*X*](https://x.com/camelaiorg) ⭐\n",
"