llama-cpp-sys-4 0.1.91

Low Level Bindings to llama.cpp
Documentation
1
2
3
4
5
6
7
8
9
10
11
12
# llama-cpp-sys

Raw bindings to llama.cpp with cuda support, including new Sampler API from llama-cpp.

See [llama-cpp-4](https://crates.io/crates/llama-cpp-4) for a safe API.

## OpenMPI support

```shell
brew install open-mpi
cargo build -F mpi
```