File tree Expand file tree Collapse file tree 1 file changed +25
-2
lines changed Expand file tree Collapse file tree 1 file changed +25
-2
lines changed Original file line number Diff line number Diff line change @@ -282,9 +282,9 @@ The following compilation options are also available to tweak performance (yes,
282282
283283#### w64devkit
284284
285- Download and extract [w64devkit](https://github.com/skeeto/w64devkit/releases).
285+ Download and extract [` w64devkit` ](https://github.com/skeeto/w64devkit/releases).
286286
287- Download and install the [Vulkan SDK](https://vulkan.lunarg.com/sdk/home#windows). When selecting components, only the Vulkan SDK Core is required .
287+ Download and install the [` Vulkan SDK` ](https://vulkan.lunarg.com/sdk/home#windows) with the default settings .
288288
289289Launch `w64devkit.exe` and run the following commands to copy Vulkan dependencies:
290290```sh
302302```
303303Switch into the `llama.cpp` directory and run `make GGML_VULKAN=1`.
304304
305+ #### Git Bash MINGW64
306+
307+ Download and install [`Git-SCM`](https://git-scm.com/downloads/win) with the default settings
308+
309+ Download and install [`Visual Studio Community Edition`](https://visualstudio.microsoft.com/) and make sure you select `C++`
310+
311+ Download and install [`CMake`](https://cmake.org/download/) with the default settings
312+
313+ Download and install the [`Vulkan SDK`](https://vulkan.lunarg.com/sdk/home#windows) with the default settings.
314+
315+ Go into your `llama.cpp` directory and right click, select `Open Git Bash Here` and then run the following commands
316+
317+ ```
318+ cmake -B build -DGGML_VULKAN=ON
319+ cmake --build build --config Release
320+ ```
321+
322+ Now you can load the model in conversation mode using `Vulkan`
323+
324+ ```
325+ build/bin/release/llama-cli -m "[PATH TO MODEL]" -ngl 100 -c 16384 -t 10 -n -2 -cnv
326+ ```
327+
305328#### MSYS2
306329Install [MSYS2](https://www.msys2.org/) and then run the following commands in a UCRT terminal to install dependencies.
307330 ```sh
You can’t perform that action at this time.
0 commit comments