Pocket Flow - LLM Framework in 100 Lines

A 100-line minimalist LLM framework for (Multi-)Agents, Prompt Chaining, RAG, etc.

• Install via pip install pocketflow, or just copy the source code (only 100 lines)

• If the 100 lines are terse, check out a friendlier intro

• Documentation: https://the-pocket.github.io/PocketFlow/

Why Pocket Flow? Let LLM Agents Build LLM Agents for you!

Pocket Flow is designed to be the framework used by LLM Agents:

• 🧑 Human users only need to specify LLM project requirements

• 🤖 LLM Agents build the LLM project for you, using Pocket Flow

To build LLM projects with LLM Agents (Cursor, ChatGPT, Claude, etc.):

• Cursor Rules: Copy and paste the .cursorrule (created from docs) into the root of your project.

• ChatGPT Project: Create a project and upload the docs to project knowledge

• Claude Project: Create a project and upload the docs to project knowledge

• GPT Store: Try this GPT assistant. However, it uses older models and is not good at coding.

What's Pocket Flow? Graph + Shared Store

The 100 lines capture what we believe to be the core abstraction of LLM projects:

• Computation Model: Graph that breaks down tasks into multiple nodes, with branching, recursion and nesting
• Communication Model: Shared Store that all graph nodes can read and write to

From there, it’s easy to implement popular design patterns like (Multi-)Agents, Prompt Chaining, RAG, etc.

• To learn about how Pocket Flow works, check out the documentation
• For an in-depth dive on the design, check out the essay