diff --git a/Documents/Ai Serving.txt b/Documents/Ai Serving.txt new file mode 100644 index 0000000..7b4eb8d --- /dev/null +++ b/Documents/Ai Serving.txt @@ -0,0 +1,14 @@ + +download llamafile from github repo : https://github.com/mozilla-ai/llamafile/releases/tag/0.10.6 +rename it to .exe +if using flash format it as extFAT +go to Hugging Face and downoad GGUF format of LLMS you want +open notepad and create a file named start.bat: +./llafial*.*.exe --server --model "llm-gguf-file.gguf" --ctx-size 32768 + +--host 0.0.0.0 +--port 8081 + + +https://docs.mozilla.ai/llamafile/using-llamafile/api +https://github.com/mozilla-ai/llamafile \ No newline at end of file diff --git a/Modules/xAiModels b/Modules/xAiModels index 490058d..eb27e9c 160000 --- a/Modules/xAiModels +++ b/Modules/xAiModels @@ -1 +1 @@ -Subproject commit 490058d1a8399d91176e53e1c4d5407bc1ff6d59 +Subproject commit eb27e9ce1fc0fa662bdfac9430c54fce9977d127 diff --git a/Modules/xContentService b/Modules/xContentService index 7802ff9..18bd6b4 160000 --- a/Modules/xContentService +++ b/Modules/xContentService @@ -1 +1 @@ -Subproject commit 7802ff9561ff7613599d9f080d807e385f7ab69f +Subproject commit 18bd6b462e79996030c668263c3e752974ed8c22 diff --git a/xAiApi b/xAiApi index ae2713e..22de433 160000 --- a/xAiApi +++ b/xAiApi @@ -1 +1 @@ -Subproject commit ae2713edddd99c3166d61504ad9530884677b80f +Subproject commit 22de433023907fab9cc861e0717b062eedcab3ed