Using free AI power from our Harbour apps !!!

[Antonio Linares]

A faster version named "vicuna" is already available:

Download the EXE from here, select the one that matches your CPU AVX, AVX2 or AVX512:
https://github.com/ggerganov/llama.cpp/releases

Download the data from here:
https://huggingface.co/eachadea/ggml-vicuna-13b-4bit/resolve/main/ggml-vicuna-13b-4bit.bin

Create this run.bat to execute it:

Code: Select all  Expand view

title llama.cpp
:start
main -i --interactive-first -r "### Human:" -t 8 --temp 0 -c 2048 -n -1 --ignore-eos --repeat_penalty 1.2 --instruct -m models/llama-7B/ggml-vicuna-13b-4bit.bin
pause
goto start

[Ari]

Hello Antonio

Congratulations !


Does it run on mod_harbour

[Otto]

Hello Antonio,
I use ChatGPT a lot as a kind of lexicon.
But I can't imagine what exactly AI could do starting inside my programme.
Does you have practical examples of use?

Best regards,
Otto

[Antonio Linares]

Dear Otto,

There is a new revolution named AutoGPT: (automatic prompting)
https://github.com/Torantulino/Auto-GPT

It is __literally__ mind blowing

look for autoGPT in youtube... get prepared for the BIG revolution!

This is evolving every day!

[Antonio Linares]

A powershell script to install and run vicuna:

https://github.com/mps256/vicuna.ps1

[Antonio Linares]

Hello Antonio

Congratulations !


Does it run on mod_harbour

Dear Ari,

This is changing everyday, so fast. Yes, it should work with mod_harbour fine too. We have not tested it yet