pocketflow/cookbook/pocketflow-map-reduce

Resume Qualification - Map Reduce Example

A PocketFlow example that demonstrates how to implement a Map-Reduce pattern for processing and evaluating resumes.

Features

• Read and process multiple resume files using a Map-Reduce pattern
• Evaluate each resume individually using an LLM with structured YAML output
• Determine if candidates qualify for technical roles based on specific criteria
• Aggregate results to generate qualification statistics and summaries

Getting Started

1. Install the required dependencies:

pip install -r requirements.txt

2. Set your OpenAI API key as an environment variable:

export OPENAI_API_KEY=your_api_key_here

3. Run the application:

python main.py

How It Works

The workflow follows a classic Map-Reduce pattern with three sequential nodes:

flowchart LR
    ReadResumes[Map: Read Resumese] --> EvaluateResumes[Batch: Evaluate Resumes]
    EvaluateResumes --> ReduceResults[Reduce: Aggregate Results]

Here's what each node does:

1. ReadResumesNode (Map Phase): Reads all resume files from the data directory and stores them in the shared data store
2. EvaluateResumesNode (Batch Processing): Processes each resume individually using an LLM to determine if candidates qualify
3. ReduceResultsNode (Reduce Phase): Aggregates evaluation results and produces a summary of qualified candidates

Files

• main.py: Main entry point for running the resume qualification workflow
• flow.py: Defines the flow that connects the nodes
• nodes.py: Contains the node classes for each step in the workflow
• utils.py: Utility functions including the LLM wrapper
• requirements.txt: Lists the required dependencies
• data/: Directory containing sample resume files for evaluation

Example Output

Starting resume qualification processing...

===== Resume Qualification Summary =====
Total candidates evaluated: 5
Qualified candidates: 2 (40.0%)

Qualified candidates:
- Emily Johnson
- John Smith

Detailed evaluation results:
✗ Michael Williams (resume3.txt)
✓ Emily Johnson (resume2.txt)
✗ Lisa Chen (resume4.txt)
✗ Robert Taylor (resume5.txt)
✓ John Smith (resume1.txt)

Resume processing complete!