-
Notifications
You must be signed in to change notification settings - Fork 41
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
What's the minimal device requirement on this project? #19
Comments
If you intend to perform full parameter fine-tuning, it should be carried out on the To mitigate hardware demands, consider utilizing a smaller language model, like phi-2. Fine-tuning for phi-2 is achievable on 3090 GPUs. I intend to enhance the code in the upcoming weeks to facilitate fine-tuning for phi-2. |
Hi,any plan to support some decent Chinese LLM models? There are now some hight quality Chinese video instruct data now. |
We will support fine-tuning of the Qwen and mixture of experts in the update. |
@jpthu17 Hoping for it! Please pin me once you guys got some upates. |
I'm trying this model , please provide the minimal device requirement information , such as GPU(type/memory) CPU SSD
The text was updated successfully, but these errors were encountered: