Merge branch 'main' of https://github.com/zachary62/miniLLMFlow
This commit is contained in:
zachary62
commit
b53230c230
77
README.md
77
README.md
|
|
@ -26,7 +26,7 @@ Pocket Flow is a [100-line](pocketflow/__init__.py) minimalist LLM framework
|
|||
|
||||
## Why Pocket Flow?
|
||||
|
||||
Current LLM frameworks are bloated. You only need 100 lines for LLM Framework!
|
||||
Current LLM frameworks are bloated... You only need 100 lines for LLM Framework!
|
||||
|
||||
<div align="center">
|
||||
<img src="./assets/meme.jpg" width="400"/>
|
||||
|
|
@ -35,9 +35,7 @@ Current LLM frameworks are bloated. You only need 100 lines for LLM Framework!
|
|||
| | **Abstraction** | **App-Specific Wrappers** | **Vendor-Specific Wrappers** | **Lines** | **Size** |
|
||||
|----------------|:-----------------------------: |:-----------------------------------------------------------:|:------------------------------------------------------------:|:---------------:|:----------------------------:|
|
||||
| LangChain | Agent, Chain | Many <br><sup><sub>(e.g., QA, Summarization)</sub></sup> | Many <br><sup><sub>(e.g., OpenAI, Pinecone, etc.)</sub></sup> | 405K | +166MB |
|
||||
| LlamaIndex | Agent, Graph | Native <sup><sub>for RAG <br>(Summarization, KG Indexing)</sub></sup> | Many <sup><sub>[Optional] <br>(e.g., OpenAI, Pinecone, etc.)</sub></sup> | 77K <br><sup><sub>(core-only)</sub></sup> | +189MB <br><sup><sub>(core-only)</sub></sup> |
|
||||
| CrewAI | Agent, Chain | Many <br><sup><sub>(e.g., FileReadTool, SerperDevTool)</sub></sup> | Many <br><sup><sub>(e.g., OpenAI, Anthropic, Pinecone, etc.)</sub></sup> | 18K | +173MB |
|
||||
| Haystack | Agent, Graph | Many <br><sup><sub>(e.g., QA, Summarization)</sub></sup> | Many <br><sup><sub>(e.g., OpenAI, Anthropic, Pinecone, etc.)</sub></sup> | 31K | +195MB |
|
||||
| SmolAgent | Agent | Some <br><sup><sub>(e.g., CodeAgent, VisitWebTool)</sub></sup> | Some <br><sup><sub>(e.g., DuckDuckGo, Hugging Face, etc.)</sub></sup> | 8K | +198MB |
|
||||
| LangGraph | Agent, Graph | Some <br><sup><sub>(e.g., Semantic Search)</sub></sup> | Some <br><sup><sub>(e.g., PostgresStore, SqliteSaver, etc.) </sub></sup> | 37K | +51MB |
|
||||
| AutoGen | Agent | Some <br><sup><sub>(e.g., Tool Agent, Chat Agent)</sub></sup> | Many <sup><sub>[Optional]<br> (e.g., OpenAI, Pinecone, etc.)</sub></sup> | 7K <br><sup><sub>(core-only)</sub></sup> | +26MB <br><sup><sub>(core-only)</sub></sup> |
|
||||
|
|
@ -45,7 +43,41 @@ Current LLM frameworks are bloated. You only need 100 lines for LLM Framework!
|
|||
|
||||
</div>
|
||||
|
||||
Pocket Flow also makes an excellent educational resource by revealing exactly how an LLM framework works under the hood—without the heavy abstractions of larger libraries.
|
||||
**Pocket Flow** is also a educational resource for understanding LLM frameworks:
|
||||
|
||||
- Larger frameworks are overly abstract and hide away details.
|
||||
|
||||
- **Pocket Flow** shows exactly how everything works under the hood.
|
||||
|
||||
## How to Use Pocket Flow?
|
||||
|
||||
🚀 Through **Agent Coding**—the fastest LLM App development paradigm-where humans design and agents code!
|
||||
|
||||
<br>
|
||||
<div align="center">
|
||||
<a href="https://youtu.be/Cf38Bi8U0Js" target="_blank">
|
||||
<img src="./assets/tutorial.png" width="500" alt="IMAGE ALT TEXT" style="cursor: pointer;">
|
||||
</a>
|
||||
</div>
|
||||
<br>
|
||||
|
||||
|
||||
✨ Below are examples of LLM Apps:
|
||||
|
||||
<div align="center">
|
||||
|
||||
| App Name | Difficulty | Topics | Human Design | Agent Code |
|
||||
| :-------------: | :-------------: | :---------------------: | :---: | :---: |
|
||||
| [Ask AI Paul Graham](https://github.com/The-Pocket/Tutorial-YC-Partner) <br> <sup><sub>Ask AI Paul Graham, in case you don't get in</sup></sub> | ★★☆ <br> *Medium* | [RAG](https://the-pocket.github.io/PocketFlow/design_pattern/rag.html) <br> [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) <br> [TTS](https://the-pocket.github.io/PocketFlow/utility_function/text_to_speech.html) | [Design Doc](https://github.com/The-Pocket/Tutorial-AI-Paul-Graham/blob/main/docs/design.md) | [Flow Code](https://github.com/The-Pocket/Tutorial-AI-Paul-Graham/blob/main/flow.py)
|
||||
| [Youtube Summarizer](https://github.com/The-Pocket/Tutorial-Youtube-Made-Simple) <br> <sup><sub> Explain YouTube Videos to you like you're 5 </sup></sub> | ★☆☆ <br> *Beginner* | [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) | [Design Doc](https://github.com/The-Pocket/Tutorial-Youtube-Made-Simple/blob/main/docs/design.md) | [Flow Code](https://github.com/The-Pocket/Tutorial-Youtube-Made-Simple/blob/main/flow.py)
|
||||
| [Cold Opener Generator](https://github.com/The-Pocket/Tutorial-Cold-Email-Personalization) <br> <sup><sub> Instant icebreakers that turn cold leads hot </sup></sub> | ★☆☆ <br> *Beginner* | [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) <br> [Web Search](https://the-pocket.github.io/PocketFlow/utility_function/websearch.html) | [Design Doc](https://github.com/The-Pocket/Tutorial-Cold-Email-Personalization/blob/master/docs/design.md) | [Flow Code](https://github.com/The-Pocket/Tutorial-Cold-Email-Personalization/blob/master/flow.py)
|
||||
|
||||
</div>
|
||||
|
||||
- Want to learn **Agent Coding**? Check out [my YouTube](https://www.youtube.com/@ZacharyLLM?sub_confirmation=1)!
|
||||
|
||||
- Want to build your own LLM App? Start with [this template](https://github.com/The-Pocket/PocketFlow-Template-Python)!
|
||||
|
||||
|
||||
## How does Pocket Flow work?
|
||||
|
||||
|
|
@ -64,43 +96,6 @@ From there, it’s easy to implement popular design patterns like ([Multi-](http
|
|||
|
||||
|
||||
|
||||
## How to Use Pocket Flow?
|
||||
|
||||
|
||||
🚀 It's highly recommended to **build Agents with Agents**—the fastest development paradigm!
|
||||
|
||||
- 😎 **Humans** craft the **high-level requirements and system design**.
|
||||
|
||||
- 🤖 **AI agents** (e.g., Cursor AI) handle the **low-level implementation**.
|
||||
|
||||
Check out the video to see the process in action!
|
||||
|
||||
<br>
|
||||
<div align="center">
|
||||
<a href="https://youtu.be/Cf38Bi8U0Js" target="_blank">
|
||||
<img src="./assets/tutorial.png" width="500" alt="IMAGE ALT TEXT" style="cursor: pointer;">
|
||||
</a>
|
||||
</div>
|
||||
<br>
|
||||
|
||||
|
||||
## What can Pocket Flow build?
|
||||
|
||||
✨ Below are examples of LLM Apps:
|
||||
|
||||
<div align="center">
|
||||
|
||||
| Formal App Name | Informal One-Liner |Difficulty | Learning Objectives |
|
||||
| :------------- | :------------- | :-------------: | :--------------------- |
|
||||
| [Ask AI Paul Graham](https://github.com/The-Pocket/Tutorial-YC-Partner) | Ask AI Paul Graham, in case you don't get in | ★★☆ <br> *Medium* | [RAG](https://the-pocket.github.io/PocketFlow/design_pattern/rag.html) <br> [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) <br> [Text-to-Speech](https://the-pocket.github.io/PocketFlow/utility_function/text_to_speech.html) |
|
||||
| [Youtube Summarizer](https://github.com/The-Pocket/Tutorial-Youtube-Made-Simple) | Explain YouTube Videos to you like you're 5 | ★☆☆ <br> *Beginner* | [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) |
|
||||
| [Cold Opener Generator](https://github.com/The-Pocket/Tutorial-Cold-Email-Personalization) | Instant icebreakers that turn cold leads hot | ★☆☆ <br> *Beginner* | [Map Reduce](https://the-pocket.github.io/PocketFlow/design_pattern/mapreduce.html) <br> [Web Search](https://the-pocket.github.io/PocketFlow/utility_function/websearch.html) |
|
||||
|
||||
</div>
|
||||
|
||||
- Want to learn how I built these LLM Apps? Check out [my YouTube](https://www.youtube.com/@ZacharyLLM?sub_confirmation=1)!
|
||||
|
||||
- Want to create your own Python project? Start with [this template](https://github.com/The-Pocket/PocketFlow-Template-Python)!
|
||||
|
||||
|
||||
|
||||
|
|
|
|||
Loading…
Reference in New Issue