llama-cpp-agent
The llama-cpp-agent framework is a tool designed for easy interaction with Large Language Models (LLMs). Allowing users to chat with LLM models, execute structured function calls and get structured output. Works also with models not fine-tuned to JSO
llama-cpp-agent at a Glance
- Pricing
- Free
- How you use it
- Python framework installed with pip
- Works with
- llama.cpp llama-cpp-python TGI vllm llama-index
llama-cpp-agent Key Features
- Agent chains
- Function calling
- Retrieval augmented generation
- Structured output
Can't Find What You're Looking For?
We build custom AI agents tailored to your specific business needs. From ideation to deployment, TinyAI.Tools is your partner in AI innovation.
No commitment required. Let's discuss your ideas.
llama-cpp-agent Alternatives
Fine Tuner
Platform for no-code building of AI agents
HelloAgents
A agent framework based on the tutorial hello-agents - jjyaoao/HelloAgents
Llama Index
LlamaIndex is the leading framework for building LLM-powered agents over your data.
goose
Goose is an open-source AI tool that empowers developers to create and automate tasks efficiently.
Octochains
A lightweight Python framework for parallel, isolated, collaborative AI reasoning. - ahmadvh/octochains
Rig
Rig is a Rust library for building LLM-powered applications and AI agents — one unified API across 20+ providers, with type-safe tools, structured output, and production-ready performance.