You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+35-18Lines changed: 35 additions & 18 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -18,7 +18,11 @@ make chat
18
18
./chat
19
19
```
20
20
21
-
You can download the weights for `ggml-alpaca-7b-q4.bin` with BitTorrent `magnet:?xt=urn:btih:5aaceaec63b03e51a98f04fd5c42320b2a033010&dn=ggml-alpaca-7b-q4.bin&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337%2Fannounce&tr=udp%3A%2F%2Fopentracker.i2p.rocks%3A6969%2Fannounce`
21
+
You can download the weights for `ggml-alpaca-7b-q4.bin` with BitTorrent:
@@ -36,30 +40,43 @@ The weights are based on the published fine-tunes from `alpaca-lora`, converted
36
40
37
41
## Windows Setup
38
42
39
-
- Download and install CMake: <https://cmake.org/download/>
40
-
- Download and install `git`. If you've never used git before, consider a GUI client like <https://desktop.github.com/>
41
-
- Clone this repo using your git client of choice (for GitHub Desktop, go to File -> Clone repository -> From URL and paste `https://github.com/antimatter15/alpaca.cpp` in as the URL)
42
-
- Open a Windows Terminal inside the folder you cloned the repository to
43
-
- Run the following commands one by one:
43
+
1. Get the `chat.exe` binary
44
44
45
-
```ps1
46
-
cmake .
47
-
cmake --build . --config Release
48
-
```
45
+
a) Download a [prebuilt release](https://github.com/anzz1/alpaca.cpp/releases) and extract it.
49
46
50
-
- Download the weights via any of the links in "Get started" above, and save the file as `ggml-alpaca-7b-q4.bin` in the main Alpaca directory.
51
-
- In the terminal window, run this command:
52
-
```ps1
53
-
.\Release\chat.exe
54
-
```
55
-
- (You can add other launch options like `--n 8` as preferred onto the same line)
56
-
- You can now type to the AI in the terminal and it will reply. Enjoy!
47
+
or
48
+
49
+
b) Build it yourself:
50
+
- Download and install CMake: <https://cmake.org/download/>
51
+
- Download and install `git`. If you've never used git before, consider a GUI client like <https://desktop.github.com/>
52
+
- Clone this repo using your git client of choice (for GitHub Desktop, go to File -> Clone repository -> From URL and paste `https://github.com/antimatter15/alpaca.cpp` in as the URL)
53
+
- Open a Windows Terminal inside the folder you cloned the repository to
54
+
- Run the following commands one by one:
55
+
```ps1
56
+
mkdir build
57
+
cd build
58
+
cmake ..
59
+
cmake --build . --config Release
60
+
```
61
+
62
+
2. Download the weights via any of the links in "Get started" above, and save the file as `ggml-alpaca-7b-q4.bin` in the main Alpaca directory.
63
+
64
+
3. In the terminal window, run this command:
65
+
```ps1
66
+
.\chat.exe
67
+
```
68
+
- (You can add `--help` to view the launch options)
69
+
- You can now type to the AI in the terminal and it will reply. Enjoy!
0 commit comments