last ...

2026-09-25 19:48:39 +03:30
parent 6dff043457
commit f87b3d073c
4 changed files with 17 additions and 3 deletions
@@ -0,0 +1,14 @@
+
+download llamafile from github repo : https://github.com/mozilla-ai/llamafile/releases/tag/0.10.6
+rename it to .exe
+if using flash format it as extFAT
+go to Hugging Face and downoad GGUF format of LLMS you want
+open notepad and create a file named start.bat:
+./llafial*.*.exe --server --model "llm-gguf-file.gguf" --ctx-size 32768
+
+--host 0.0.0.0 
+--port 8081
+
+
+https://docs.mozilla.ai/llamafile/using-llamafile/api
+https://github.com/mozilla-ai/llamafile