pocketflow/docs/index.md

1023 B

layout title nav_order
default Home 1

Mini LLM Flow

A 100-line minimalist LLM framework for agents, task decomposition, RAG, etc.

We model the LLM workflow as a Nested Flow:

  • Each Node handles a simple LLM task.
  • Nodes are chained together to form a Flow for more complex tasks.
  • One Node can be chained to multiple Nodes based on Actions.
  • A Flow can be treated as a Node for Nested Flows.
  • Both Nodes and Flows can be Batched for data-intensive tasks.
  • Nodes and Flows can be Async.

Core Abstraction

Paradigm Implementation

  • Task Decomposition
  • Agent
  • Map Reduce
  • RAG
  • Structured Output

Example Use Cases

TODO