1.3 KiB
miniLLMFlow
Minimalist LLM framework in 100 lines. Express popular paradigms like agents, task decomposition, RAG, and more.
- Install via
pip install minillmflow. Or just copy the source codes (it's only 100 lines) - We strongly recommened using LLMs (e.g., Claude, ChatGPT, Cursor) to develop LLM applications with this prompt
Why miniLLMFlow?
The future of programming will be heavily LLM-assited, and LLMs:
-
😀 Shine at Feature Implementation: With proper docs, LLMs can handle APIs, tools, chunking, prompt wrapping, etc. These are hard to maintain and optimize, so they don’t belong in the framework.
-
☹️ Struggle with Paradigm Design: Paradigms like MapReduce, task decomposition, and agents are powerful, even for LLMs. However, designing these elegantly remains challenging for LLMs.
To enable LLMs to develop LLM applications, a framework should (1) remove redunant feature implementations but (2) keep core paradigms to build on. It turns out that such a framework only needs 100 lines of code.
