https://github.com/ggerganov/llama.cpp/releases/tag/master-8b67998
* Uncensored data:
https://huggingface.co/anon8231489123/gpt4-x-alpaca-13b-native-4bit-128g/blob/main/gpt4-x-alpaca-13b-ggml-q4_1-from-gptq-4bit-128g/ggml-model-q4_1.bin
go.bat
- Code: Select all Expand view
- main -i --interactive-first -t 8 --temp 0.3 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m ggml-model-q4_1.bin
