1.1 KiB

Raw Blame History

layout	title	nav_order
default	Home	1

Mini LLM Flow

A 100-line minimalist LLM framework for agents, task decomposition, RAG, etc.

We model the LLM workflow as a Nested Flow:

Each Node handles a simple LLM task.
Nodes are chained together to form a Flow for compute-intensive tasks.
One Node can be chained to multiple Nodes through Actions as an agent.
A Flow can be treated as a Node for Nested Flows.
Both Nodes and Flows can be Batched for data-intensive tasks.
Nodes and Flows can be Async for user inputs.

Preparation

LLM Integration

Core Abstraction

Paradigm Implementation

Task Decomposition
Agent
Map Reduce
RAG
Structured Output

Example Use Cases

TODO