FiveTech Software tech support forums

... and write the answer in json format" 2. You tell chatgpt to do it again without including previous responses Once we have the dataset then we train tinyLlama and we get our own specialized IA model :-)

hi, the "Problem" is to train (fine tune) a base model for own Data as it need much PC-Power Question : is it possible to "rent" PC-Power to train own Model :?: Dear Jimmy, You can use Google Colab with T4. You have a ...

hi,

the "Problem" is to train (fine tune) a base model for own Data as it need much PC-Power

Question : is it possible to "rent" PC-Power to train own Model

Dear Leandro, The first step is to create a dataset with questions and answers to train (fine tune) a base model such as Microsoft phi-2, TinyLlama, etc. Once trained, a GGUF file is generated, which can be used with FWH using the llama64.dll. This is the free and ...

... I didn't know any better): Python installed, first 3.12 (does not support torch, then downgraded to 3.11.7) Torch installed Transformers installed train.py executed CPU utilization > 10% and 14.4GB RAM After 16min cached_lm_GPT2Tokenizer_128_fivetech_forums_20231222.sql prepared - only then ...

installed python 3.11.7
pip install torch
pip install transformers

python train.py

result: ready in 16min maybe with some errors - error messages can't be saved there!

if i run train.py again then comes terrible | 213/1628301 [05:57<1293:44:33, 2.86s/it]

can't wait so long

========================== RESTART: C:\fwh\AI\train.py =========================
Traceback (most recent call last):
File "C:\fwh\AI\train.py", line 1, in <module>
import torch
ModuleNotFoundError: No module named 'torch'

Dear Anton,

That one would be great!

Could you please try to run the previous python code and see how long time does it report ?

python train.py

I am emailing you the file

many thanks!

This code seems to work, though we still don't know how long it will take the training: I appreciate, if you have a pc with nvidia GPUs, to test it and report how long it takes. Just replace "fivetech_forums_20231222.sql" with a large text file you may ...

... C4267: "Initialisierung": Konvertierung von "size_t" nach "int", Datenverlust möglich 5>grammar-parser.cpp 5>train.cpp 5>Code wird generiert... 5>F:\llama.cpp\common\common.cpp(963): warning C4715: "gpt_random_prompt": Nicht alle Codepfade geben ...

... of the topics, with the name of the topic and the list of messages for such topic. Here you have the Google Colab file to run the fine tunning training from Microsoft Phi2: https://github.com/FiveTechSoft/FWH_tools/blob/master/fivetech_forums.ipynb ======== original post Some days ...

Instead of having to train our data and create a XML file ("Haar Cascade") we have found that for images matching it is much simpler to use cv.matchTemplate() as this way we don't need to train any data, we simply search an ...

Hopefully quite soon we can train our own neuronal networks with our data

book_train.py import numpy as npimport tensorflow as tfimport globbook_filenames = sorted( glob.glob( "*.txt" ) )print( "Found {} books".format( len( book_filenames ) ) ...

... SILLIAN on Sunday, 2nd of July, at some time in the afternoon if there are enough people who are interested. The alternative is an international train. We will calculate the costs and communicate them. Please tell me if you want to join. Kind regards Ruth