Artificial intelligence (AI) is intelligence demonstrated by machines, unlike the natural intelligence displayed by humans and animals, which involves consciousness and emotionality. The distinction between the former and the latter categories is often revealed by the acronym chosen.
It is called finetuning. I haven't tried it but oobagooba's text-generation-webui has a tab to do it and I believe it is pretty straightforward.
Fine tune a base model on your dataset and then tou will then need to format your prompt in the way your AIM logs are organized. e.g. you will need to add "" add the end of your text completion task. It will complete it in the way it learnt it.
If you don't have a the GPU for it, many companies offer fine-tuning as a service like Mistral
Why would you want this??? Anything I wrote from 16 years ago is so beyond cringey. You must have been a stellar kid.
Because funy
I have 26 years of saved outgoing email.
Recently I needed to redo a fix I learned about in 1998 and implemented then. I implemented it again to install a crappy software project that from its composition canNOT have been from before the post-y2k firing of so many mentors.
Only remembered after 3 hours of searching, saving myself another few hours and surely a nervous breakdown. But, after filtering AD on the client end, the project installed easily.
That's the best example, but the things I don't discover I answered already on Stackoverflow I discover I answered years ago in email.
The real question is why do you have 64 mb of aim conversations?
Because I communicated with a lot of people over AIM? It’s actually more than just high school. Covers 2004 to around 2012. Also it’s 64mb zipped. Actual size is much larger.
Not hard with Huggingface PEFT
Putting aside why you'd want to do this, it'd be pretty easy, actually. You'd still use a big model like GPT4 or Claude as your "base" but you would do two things:
you would then
You may try https://github.com/instructlab. You will need to transform those conversations to a specific yaml format.
Great tip! I got the demo project up and running in around 30 minutes. Glad to see it's running locally (and not too slowly on my CPU build).
Now to actually train the thing...