local_inference 0.1.1 
local_inference: ^0.1.1 copied to clipboard
Run LLMs and AI agents on device in Dart: GGUF models via llama.cpp, tool calling, an agent loop with your own tools, verified downloads. Offline and private.
2 versions
Stable versions of local_inference
| Version | Min Dart SDK | Uploaded | Documentation | Archive | |
|---|---|---|---|---|---|
| 0.1.1 | 3.10 | 3 days ago |  |  | |
| 0.1.0 | 3.10 | 4 days ago | | |
Metadata
3
likes
160
points
95
downloads
Documentation
Publisher
unverified uploader
Weekly Downloads
Metadata
Run LLMs and AI agents on device in Dart: GGUF models via llama.cpp, tool calling, an agent loop with your own tools, verified downloads. Offline and private.
Repository (GitHub)
View/report issues
Topics
#llm #ai #agents #on-device #llama-cpp
License
MIT (license)
Dependencies
crypto, dinja, llamadart, meta, path, yaml