docs.rs failed to build llm_interface-0.0.2
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
Please check the build logs for more information.
See Builds for ideas on how to fix a failed build, or Metadata for how to configure docs.rs builds.
If you believe this is docs.rs' fault, open an issue.
llm_interface: The Backend for the llm_client Crate
This crate contains the build.rs, data types, and behaviors for LLMs.
- Llama.cpp (through llama-server)
- Various LLM APIs including support for generic OpenAI format LLMs
You can use this crate to run local LLMs and make requests to LLMs. It's set up to be easy to integrate into other projects.
See the various Builders implemented in the lib.rs file for an example of using this crate.
For a look at a higher level API and how it implements this crate, checkout the llm_client crate and it's lib.rs file.