Pocket Flow - LLM Framework in 100 Lines

A 100-line minimalist LLM framework for (Multi-)Agents, Workflow, RAG, etc.

• Install via pip install pocketflow, or just copy the source code (only 100 lines).

• If the 100 lines are too terse, check out a friendlier intro.

• Documentation: https://the-pocket.github.io/PocketFlow/

Why Pocket Flow? Let LLM Agents Build LLM Agents for You!

Pocket Flow is designed to be the framework used by LLM Agents:

• 🧑 Human users only need to specify LLM project requirements.

• 🤖 LLM Agents build the LLM project for you, using Pocket Flow.

• Demo Cookbook can be found here

To build LLM projects with LLM Agents (Cursor, ChatGPT, Claude, etc.):

• Cursor Rules: Copy and paste the .cursorrules (created from docs) into the root of your project.

• ChatGPT Project: Create a project and upload the docs to project knowledge.

• Claude Project: Create a project and upload the docs to project knowledge.

• GPT Store: Try this GPT assistant. However, it uses older models and is not very good at coding.

What Is Pocket Flow? Graph + Shared Store

The 100 lines capture what we believe to be the core abstraction of LLM projects:

• Computation Model: A graph that breaks down tasks into multiple nodes, with branching, recursion, and nesting.
• Communication Model: A shared store that all graph nodes can read and write to.

From there, it’s easy to implement popular design patterns like (Multi-)Agents, Workflow, RAG, etc.

• To learn more about how it works, check out the documentation
• For an in-depth dive into the design, check out the essay