download llamafile from github repo : https://github.com/mozilla-ai/llamafile/releases/tag/0.10.6
rename it to .exe
if using flash format it as extFAT
go to Hugging Face and downoad GGUF format of LLMS you want
open notepad and create a file named start.bat:
./llafial*.*.exe --server --model "llm-gguf-file.gguf" --ctx-size 32768

--host 0.0.0.0 
--port 8081


https://docs.mozilla.ai/llamafile/using-llamafile/api
https://github.com/mozilla-ai/llamafile