- Chain of Thought (CoT): Generates explicit reasoning paths
- Self-Instruct: Produces instruction-following data from both humans and machines
- Source2Synth: Synthesizes multi-hop QA from source text or code
- Self-Improving CoT: Iteratively improves reasoning through agent self-critique
Chain of Thought (CoT) Data Generation
Key Features
Key Features
- Monte Carlo Tree Search (MCTS) for solution exploration
- Binary Search Error Detection for precise error localization
- Dual-Agent Verification System for quality assurance
- Solution Tree Management for tracking reasoning paths
Core Components
Core Components
- Dual-Agent Architecture: Supports both single-agent (legacy) and dual-agent modes
- Answer Generation: Sophisticated answer generation with MCTS
- Answer Verification: Robust verification system using golden answers
- Error Detection: Binary search-based error detection in solutions
- Solution Management: Comprehensive solution tree management and export
Quick Start: CoT Data Generation
Data Import/Export for CoT
Solution Generation Process
Solution Generation Process
Direct Solution Attempt
MCTS-Based Exploration
Error Detection & Correction
Solution Verification
Configuration Options
Configuration Options
search_limit: Maximum number of search iterations (default: 100)generator_agent: Specialized agent for answer generationverifier_agent: Specialized agent for answer verificationgolden_answers: Pre-defined correct answers for validation
Output Format
Output Format
- Solutions with intermediate steps
- Golden answers used for verification
- Export timestamp
Self-Instruct: Instruction Generation
Key Features
Key Features
- Combines human-written and machine-generated instructions using configurable ratios
- Supports both classification and non-classification task types
- Built-in instruction filtering and validation
- Automatic instance generation for tasks
- JSON-based data input/output
Core Components
Core Components
InstructionFilter – Handles validation and filtering of all generated instructions:
- Length-based, keyword, and punctuation checks
- Non-English text detection
- ROUGE similarity filtering for deduplication
- Extensible registry for custom filters
Quick Start: Self-Instruct Generation
Custom Filtering Example
Pipeline Stages
Pipeline Stages
Seed Loading
Instruction Generation
Task Classification
Instance Generation
Data Output
Pipeline Parameters
Pipeline Parameters
agent: ChatAgent instance for generating instructionsseed: Path to human-written seed tasks in JSONL formatnum_machine_instructions: Number of machine-generated instructions (default: 5)data_output_path: Path for saving generated data (default:./data_output.json)human_to_machine_ratio: Ratio of human to machine tasks (default: (6, 2))instruction_filter: CustomInstructionFilterinstance (optional)filter_config: Configuration dictionary for default filters (optional)
Filter Configuration
Filter Configuration
- length: Configure length constraints for instructions
- keyword: Set up keyword-based filtering rules
- punctuation: Define punctuation validation rules
- non_english: Non-English text detection
- rouge_similarity: Set ROUGE similarity thresholds for deduplication
Input/Output Format
Input/Output Format
Source2Synth: Multi-hop Question-Answer Generation
Core Components
Core Components
ExampleConstructor: Builds multi-hop QA examples, extracting premise, intermediate steps, and conclusions.
DataCurator: Filters, deduplicates, and samples the final dataset to match quality and complexity requirements.
Key Features
Key Features
- Batch or single text processing
- Switchable AI or rule-based question generation
- Multi-hop QA and complexity scoring
- Integrated curation, deduplication, and reproducible sampling
- Seamless MultiHopGeneratorAgent integration
Quick Start: Source2Synth Pipeline
ProcessorConfig Parameters
ProcessorConfig Parameters
seed: Random seed for reproducibilitymin_length: Minimum text length for processingmax_length: Maximum text length for processingcomplexity_threshold: Minimum complexity score (0.0–1.0)dataset_size: Target size for the final datasetuse_ai_model: Toggle between AI model and rule-based generationhop_generating_agent: CustomMultiHopGeneratorAgent(optional)
Pipeline Stages
Pipeline Stages
Text Preprocessing
Information Extraction
QA Generation
Dataset Curation
Self-Improving CoT Data Generation
Key Components
Key Components
- Customizable reasoning and evaluation agents
- Support for reward models and custom thresholds
- Few-shot learning and rich output options
Architecture Stages
Architecture Stages
Initial Reasoning Trace Generation
Self-Evaluation
Feedback-Based Improvement
Iterative Refinement
Quick Start: Self-Improving CoT Pipeline
Advanced: External Reward Model Integration
Input/Output Format
Input/Output Format
- Original problem
- Final reasoning trace
- Improvement history with iterations
- Evaluation scores and feedback per iteration
Configuration Options
Configuration Options
max_iterations: Maximum number of improvement iterations (default: 3)score_threshold: Minimum quality thresholds for evaluation dimensions (default: 0.7)few_shot_examples: (Optional) Examples for few-shot learningoutput_path: (Optional) Path for saving generated results