2.9 KiB
Pocket Flow - LLM Framework in 100 Lines
A 100-line minimalist LLM framework for (Multi-)Agents, Workflow, RAG, etc.
-
Install via
pip install pocketflow, or just copy the source code (only 100 lines). -
If the 100 lines are too terse, check out a friendlier intro.
-
Documentation: https://the-pocket.github.io/PocketFlow/
Why Pocket Flow?
Pocket Flow may seem too minimal for humans. But here’s the crucial point: Pocket Flow is designed for
LLM Agents (e.g., Cursor AI) to build LLM Agents! LLM Agents (e.g., Cursor AI) to build LLM Agents! LLM Agents (e.g., Cursor AI) to build LLM Agents!
LLM Agents understand and use a minimal framework very well!
To set up:
-
Cursor Rules: Copy .cursorrules into your project’s root.
-
ChatGPT & Claude: Create a project (ChatGPT andClaude) and upload the docs folder to project knowledge.
What Is Pocket Flow?
The 100 lines capture what we believe to be the core abstraction of LLM projects:
- Computation: A graph that breaks down tasks into nodes, with branching, looping, and nesting.
- Communication: A shared store that all nodes can read and write to.
From there, it’s easy to implement popular design patterns like (Multi-)Agents, Workflow, RAG, etc.
- To learn more about how it works, check out the documentation
- For an in-depth dive into the design, check out the essay