Pocket Flow - LLM Framework in 100 Lines
A 100-line minimalist LLM framework for (Multi-)Agents, Prompt Chaining, RAG, etc.
-
Install via
pip install pocketflow, or just copy the source code (only 100 lines). -
If the 100 lines are too terse, check out a friendlier intro.
-
Documentation: https://the-pocket.github.io/PocketFlow/
Why Pocket Flow? Let LLM Agents Build LLM Agents for You!
Pocket Flow is designed to be the framework used by LLM Agents:
-
🧑 Human users only need to specify LLM project requirements.
-
🤖 LLM Agents build the LLM project for you, using Pocket Flow.
To build LLM projects with LLM Agents (Cursor, ChatGPT, Claude, etc.):
-
Cursor Rules: Copy and paste the .cursorrules (created from docs) into the root of your project.
-
ChatGPT Project: Create a project and upload the docs to project knowledge.
-
Claude Project: Create a project and upload the docs to project knowledge.
-
GPT Store: Try this GPT assistant. However, it uses older models and is not very good at coding.
What Is Pocket Flow? Graph + Shared Store
The 100 lines capture what we believe to be the core abstraction of LLM projects:
- Computation Model: A graph that breaks down tasks into multiple nodes, with branching, recursion, and nesting.
- Communication Model: A shared store that all graph nodes can read and write to.
From there, it’s easy to implement popular design patterns like (Multi-)Agents, Prompt Chaining, RAG, etc.
- To learn more about how it works, check out the documentation
- For an in-depth dive into the design, check out the essay