Yeah there is plenty more to come they just need to finish up S42 and get that on a slow burn to deal with the inevitable bugs, and reallocate resources to the verse.
Been out of the game for about a year now and a lot has changed and it seems like there are nearing completion on some of the major framework. I think with the reallocation and framework mostly complete we’ll finally get some real content.
Eventually.
O7
While you can run an llm on an “old” laptop with an Nvidia GC it will likely be really slow. Like several minutes to much much longer slow. Huggingface.co is a good place to start and has a ton of different LLMs to choose from that range from small enough to run on your hardware to ones that won’t.
As you are a teacher you know that research is going to be vital to your understanding and implementing this project. There is a plethora of information out there. There will not be a single person’s answer that will work perfectly for your wants and your hardware.
When you have figured out your plan and then run into issues that’s a good point to ask questions with more information about your situation.
I say this cause I just went through this. Not to be an ass.