Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
thx~
The text was updated successfully, but these errors were encountered:
Looks like there's an undocumented way to run gguf files here: #1366
You can try downloading one of these gguf files but I have yet to be able to get it to work as I believe it may have to be customized in some way: https://huggingface.co/QuantFactory/Meta-Llama-3-8B-GGUF https://huggingface.co/NousResearch/Meta-Llama-3-8B-GGUF/tree/main
thx~
The text was updated successfully, but these errors were encountered: