llmaker
Models, vector DBs, embeddings, a retrieval agent, and evals: the whole modern LLM stack on your own hardware, from one command. OpenAI-compatible API + web UI per instance, GPU partitioning, no data leaving your machine.
llmaker at a Glance
- Pricing
- Free
- How you use it
- Terminal CLI that manages Docker-based services and exposes an OpenAI-compatible API and web UI
- Who it's for
- People who want to run LLMs and application stacks on their own hardware
- Works with
- Ollama Qdrant Chroma pgvector Weaviate Redis Whisper SearXNG Langfuse LangGraph
llmaker Key Features
- Built-in retrieval agent
- Deploy agent stacks
- GPU partitioning
- Manage model fleet
- Self-host LLM stacks
Can't Find What You're Looking For?
We build custom AI agents tailored to your specific business needs. From ideation to deployment, TinyAI.Tools is your partner in AI innovation.
No commitment required. Let's discuss your ideas.
llmaker Alternatives
platypus
Platypus is a self-hosted platform for always-on AI Agents that reason, use tools, and run on your own models and infrastructure — for your whole team.
Neuron AI
The Agentic Framework of the PHP ecosystem to build production-ready AI driven applications. Connect components (LLMs, Tools, vector DBs, memory) to agents that interact with your data and UI. - neuron-core/neuron-ai
Warp
Warp is an advanced terminal with built-in AI agents for enhanced software development workflows.
Cody by ajhous44
An AI assistant designed to let you interactively query your codebase using natural language. By utilizing vector embeddings, chunking, and OpenAI's language models, Cody can help you navigate through your code in an efficient and intuitive manner.
Cognee
Cognee is the open-source agent memory platform for LLM agents. Build persistent memory across sessions with graph, vector, and relational retrieval that runs self-hosted, in Docker, on-prem, or on Cognee Cloud.
Aurora
Aurora - a hardware-accelerated, AI-native developer terminal. GPU-rendered blocks, multi-provider AI routing, and a local agent sidecar.