![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg) [![Docs](https://img.shields.io/badge/docs-latest-blue)](https://the-pocket.github.io/PocketFlow/) Pocket Flow is a [100-line](pocketflow/__init__.py) minimalist LLM framework - **Lightweight**: Just 100 lines. Zero bloat, zero dependencies, zero vendor lock-in. - **Expressive**: Everything you love from large frameworks—([Multi-](https://the-pocket.github.io/PocketFlow/design_pattern/multi_agent.html))[Agents](https://the-pocket.github.io/PocketFlow/design_pattern/agent.html), [Workflow](https://the-pocket.github.io/PocketFlow/design_pattern/workflow.html), [RAG](https://the-pocket.github.io/PocketFlow/design_pattern/rag.html), and more. - **AI-Friendly**: Let AI Agents (e.g., Cursor AI) build Agents—10x productivity boost! - To install, ```pip install pocketflow```or just copy the [source code](pocketflow/__init__.py) (only 100 lines). - To learn more, check out the [documentation](https://the-pocket.github.io/PocketFlow/). For an in-depth design dive, read the [essay](https://github.com/The-Pocket/.github/blob/main/profile/pocketflow.md). - 🎉 We now have a [discord](https://discord.gg/hUHHE9Sa6T)! ## Why Pocket Flow? Current LLM frameworks are bloated. You only need 100 lines for LLM Framework!
| | **Abstraction** | **App-Specific Wrappers** | **Vendor-Specific Wrappers** | **Lines** | **Size** | |----------------|:-----------------------------: |:-----------------------------------------------------------:|:------------------------------------------------------------:|:---------------:|:----------------------------:| | LangChain | Agent, Chain | Many
(e.g., QA, Summarization) | Many
(e.g., OpenAI, Pinecone, etc.) | 405K | +166MB | | LlamaIndex | Agent, Graph | Native for RAG
(Summarization, KG Indexing) | Many [Optional]
(e.g., OpenAI, Pinecone, etc.) | 77K
(core-only) | +189MB
(core-only) | | CrewAI | Agent, Chain | Many
(e.g., FileReadTool, SerperDevTool) | Many
(e.g., OpenAI, Anthropic, Pinecone, etc.) | 18K | +173MB | | Haystack | Agent, Graph | Many
(e.g., QA, Summarization) | Many
(e.g., OpenAI, Anthropic, Pinecone, etc.) | 31K | +195MB | | SmolAgent | Agent | Some
(e.g., CodeAgent, VisitWebTool) | Some
(e.g., DuckDuckGo, Hugging Face, etc.) | 8K | +198MB | | LangGraph | Agent, Graph | Some
(e.g., Semantic Search) | Some
(e.g., PostgresStore, SqliteSaver, etc.) | 37K | +51MB | | AutoGen | Agent | Some
(e.g., Tool Agent, Chat Agent) | Many [Optional]
(e.g., OpenAI, Pinecone, etc.) | 7K
(core-only) | +26MB
(core-only) | | **PocketFlow** | **Graph** | **None** | **None** | **100** | **+56KB** |
Pocket Flow also makes an excellent educational resource by revealing exactly how an LLM framework works under the hood—without the heavy abstractions of larger libraries. ## How does Pocket Flow work? The [100 lines](pocketflow/__init__.py) capture the core abstraction of LLM frameworks: Graph!
From there, it’s easy to implement popular design patterns like ([Multi-](https://the-pocket.github.io/PocketFlow/design_pattern/multi_agent.html))[Agents](https://the-pocket.github.io/PocketFlow/design_pattern/agent.html), [Workflow](https://the-pocket.github.io/PocketFlow/design_pattern/workflow.html), [RAG](https://the-pocket.github.io/PocketFlow/design_pattern/rag.html), etc.
## How to Use Pocket Flow? 🚀 It's highly recommended to **build Agents with Agents**—the fastest development paradigm! - 😎 **Humans** craft the **high-level requirements and system design**. - 🤖 **AI agents** (e.g., Cursor AI) handle the **low-level implementation**. Check out the video to see the process in action!
IMAGE ALT TEXT

## What can Pocket Flow build? ✨ Below are examples of LLM Apps:
| Formal App Name | Informal One-Liner |Difficulty | Learning Objectives | | :------------- | :------------- | :-------------: | :--------------------- | | [Ask AI Paul Graham](https://github.com/The-Pocket/Tutorial-YC-Partner) | Ask AI Paul Graham, in case you don't get in | ★★☆
*Medium* | [RAG](https://the-pocket.github.io/PocketFlow/design_pattern/rag.html)
[Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html)
[Text-to-Speech](https://the-pocket.github.io/PocketFlow/utility_function/text_to_speech.html) | | [Youtube Summarizer](https://github.com/The-Pocket/Tutorial-Youtube-Made-Simple) | Explain YouTube Videos to you like you're 5 | ★☆☆
*Beginner* | [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) | | [Cold Opener Generator](https://github.com/The-Pocket/Tutorial-Cold-Email-Personalization) | Instant icebreakers that turn cold leads hot | ★☆☆
*Beginner* | [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html)
[Web Search](https://the-pocket.github.io/PocketFlow/utility_function/websearch.html) |
- Want to learn how I built these LLM Apps? Check out [my YouTube](https://www.youtube.com/@ZacharyLLM?sub_confirmation=1)! - Want to create your own Python project? Start with [this template](https://github.com/The-Pocket/PocketFlow-Template-Python)!