Enhanced meta-orchestration for selecting and combining reasoning patterns...
Purpose: Select and orchestrate optimal reasoning pattern(s) for your problem. V2 addresses limitations of v1: adds new patterns, replaces order-dependent decision tree with weighted scoring, includes feedback loops, and fixes confidence aggregation.
| Pattern | Purpose | Best For |
|---|---|---|
| Tree of Thoughts (ToT) | Find optimal solution through deep exploration | Optimization, clear criteria, find THE best |
| Breadth of Thought (BoT) | Map solution space comprehensively | Unknown space, need multiple options |
| Self-Reflecting Chain (SRC) | Sequential reasoning with validation | Dependent steps, proofs, linear traces |
| Hypothesis-Elimination (HE) | Systematic elimination through evidence | Diagnosis, debugging, root cause |
| Adversarial Reasoning (AR) | Stress-test through attack simulation | Validation, security, pre-mortems |
| Dialectical Reasoning (DR) | Synthesize opposing valid perspectives | Trade-offs, conceptual conflicts |
| Analogical Transfer (AT) | Solve via cross-domain parallels | Novel problems, no direct precedent |
| Rapid Triage Reasoning (RTR) | Fast decisions under time pressure | Incidents, emergencies, time-boxed choices |
| Negotiated Decision Framework (NDF) | Multi-stakeholder coordination | Politics, competing interests, buy-in needed |
Score each dimension (1-5):
| Dimension | Score | Description |
|-----------|-------|-------------|
| **Sequential Dependencies** | _/5 | Do steps depend on previous steps? |
| **Criteria Clarity** | _/5 | Can you clearly evaluate solutions? |
| **Solution Space Known** | _/5 | Do you know the options? |
| **Single Answer Needed** | _/5 | Need ONE answer vs multiple options? |
| **Evidence Available** | _/5 | Can you gather discriminating evidence? |
| **Opposing Valid Views** | _/5 | Are there legitimate conflicting perspectives? |
| **Problem Novelty** | _/5 | Is this unprecedented in your domain? |
| **Robustness Required** | _/5 | Need to stress-test before committing? |
| **Solution Exists** | _/5 | Do you have a candidate solution to evaluate? |
| **Time Pressure** | _/5 | How constrained is decision time? (5=minutes) |
| **Stakeholder Complexity** | _/5 | Multiple parties with competing interests? |
CRITICAL: If Time Pressure = 5 (emergency/incident):
If Time Pressure β₯ 4:
ToT = (Criteria Γ 0.35) + (SingleAnswer Γ 0.30) + (SpaceKnown Γ 0.20) + ((6-Novelty) Γ 0.15)
BoT = ((6-SpaceKnown) Γ 0.35) + ((6-SingleAnswer) Γ 0.30) + ((6-Criteria) Γ 0.20) + (Novelty Γ 0.15)
SRC = (Sequential Γ 0.45) + (Criteria Γ 0.25) + (SingleAnswer Γ 0.20) + ((6-OpposingViews) Γ 0.10)
HE = (Evidence Γ 0.40) + (SingleAnswer Γ 0.30) + ((6-Novelty) Γ 0.20) + ((6-OpposingViews) Γ 0.10)
AR = (Robustness Γ 0.40) + (SolutionExists Γ 0.30) + ((6-Novelty) Γ 0.15) + (Evidence Γ 0.15)
# NOTE: AR requires SolutionExists β₯ 3, otherwise score = 0
DR = (OpposingViews Γ 0.50) + (Criteria Γ 0.20) + ((6-Evidence) Γ 0.15) + (MIN(SingleAnswer, OpposingViews) Γ 0.15)
# NOTE: V2.1 fix - SingleAnswer no longer penalized when OpposingViews is high
AT = (Novelty Γ 0.45) + ((6-SpaceKnown) Γ 0.30) + ((6-Evidence) Γ 0.15) + ((6-Sequential) Γ 0.10)
RTR = (TimePressure Γ 0.50) + (SingleAnswer Γ 0.25) + (Evidence Γ 0.15) + ((6-Novelty) Γ 0.10)
# NOTE: RTR auto-selected when TimePressure = 5
NDF = (StakeholderComplexity Γ 0.45) + (OpposingViews Γ 0.25) + ((6-Criteria) Γ 0.15) + ((6-TimePressure) Γ 0.15)
# NOTE: NDF requires StakeholderComplexity β₯ 3 to be considered
Formula Validation Rules (V2.1):
When dimension scores are uncertain, propagate uncertainty to pattern selection:
## Uncertainty Assessment
For each dimension where you're unsure (Β±1 point uncertainty):
1. Calculate pattern scores at LOW end (dimension - 1)
2. Calculate pattern scores at HIGH end (dimension + 1)
3. If different pattern wins at each end β **Flag as uncertain selection**
### Handling Uncertain Selections
**If same pattern wins both ends**: Proceed with confidence
**If different patterns win**:
- Run BOTH patterns in parallel (if time permits)
- OR use the pattern that's more robust to being wrong
- OR gather more information to reduce dimension uncertainty
### Uncertainty Discount
Apply -5% to final confidence for each uncertain dimension that affects the winning pattern.
| Scenario | Action |
|---|---|
| One pattern scores >4.0 | Use that pattern directly |
| Top 2 within 0.5 of each other | Consider multi-pattern orchestration |
| Top 3 within 0.3 of each other | Apply uncertainty propagation first |
| All patterns <3.0 | Problem may need decomposition first |
| Top pattern <2.5 | None fit well; use Direct Analysis |
When all pattern scores are below 2.5, no specialized methodology is warranted:
## Direct Analysis
**When to use**: All patterns score <2.5 (problem doesn't match any pattern's strengths)
**Approach**:
1. No special framework needed
2. Just think through the problem directly, step by step
3. Use common sense and straightforward reasoning
4. Appropriate for simple problems that don't need cognitive overhead
**Examples**:
- Simple factual questions
- Straightforward calculations
- Basic lookups or translations
- Problems with obvious solutions
**Confidence**: Use intuitive confidence based on problem clarity
- Clear problem + clear answer = high confidence
- Any ambiguity = document it explicitly
Use Direct Analysis (no specialized pattern) when:
Direct Analysis = simple step-by-step reasoning without framework overhead.
BoT β ToT β AR (explore β optimize β validate)
HE β SRC β AR (diagnose β trace β validate fix)
AT β DR β ToT (analogize β synthesize β optimize)
RTR β HE β ToT (triage β root cause β proper fix)
NDF β ToT β AR (align stakeholders β optimize β validate)
DR β NDF β ToT (resolve concepts β negotiate politics β optimize)
AT β BoT β ToT (find analogies β explore adaptations β select best)
BoT || AT (parallel exploration from different angles)
ToT || DR (optimize while synthesizing trade-offs)
HE branches (test multiple hypotheses simultaneously)
AR attack vectors (stress-test from multiple directions at once)
Complete end-to-end flow for IR-v2 orchestration:
1. **Problem Input**
βββ Receive problem statement, constraints, and context
2. **Score 11 Dimensions**
βββ Sequential Dependencies, Criteria Clarity, Solution Space Known,
Single Answer Needed, Evidence Available, Opposing Valid Views,
Problem Novelty, Robustness Required, Solution Exists,
Time Pressure, Stakeholder Complexity
3. **Fast-Path Check**
βββ TimePressure = 5? β RTR immediately (skip remaining steps)
4. **Pattern Selection**
βββ IR-v2 calculates affinity scores for all 9 patterns
βββ Apply validation rules (AR needs solution, NDF needs stakeholders)
5. **Direct Analysis Check**
βββ All patterns < 2.5? β Use Direct Analysis (no framework)
6. **Orchestration Decision**
βββ Single pattern > 4.0? β Use that pattern directly
βββ Top 2 within 0.5? β Consider multi-pattern orchestration
βββ Top 3 within 0.3? β Apply uncertainty propagation first
βββ Decide: Sequential or Parallel execution?
7. **Pattern Execution**
βββ Apply selected pattern(s) using their methodologies
βββ Track confidence and key findings
8. **Checkpoint (15 min)**
βββ Progress check, pattern fit check, new information check
βββ Re-evaluate and potentially switch patterns if needed
9. **Handover (if multi-pattern)**
βββ Transfer context via .reasoning/ directory
βββ Preserve insights from completed pattern
βββ Set up next pattern with full context
10. **Synthesis (if multi-pattern)**
βββ Combine findings from all patterns
βββ Resolve conflicts, identify agreements
11. **Confidence Aggregation**
βββ Single pattern: use internal confidence
βββ Multi-pattern: apply agreement analysis
βββ Apply uncertainty discounts if applicable
12. **Output**
βββ Deliver answer with reasoning trail
βββ Document confidence level and key uncertainties
βββ Provide actionable recommendations
Sequential Orchestration (most common):
Parallel Orchestration (when patterns are complementary):
Nested Orchestration (when patterns address different aspects):
| Pattern A High | Pattern B High | Orchestration |
|---|---|---|
| BoT | ToT | Sequential: BoT (explore) β ToT (optimize top options) |
| BoT | HE | Sequential: BoT (generate hypotheses) β HE (eliminate) |
| ToT | AR | Sequential: ToT (select) β AR (validate before commit) |
| ToT | SRC | Sequential: ToT (decide) β SRC (plan implementation) |
| DR | ToT | Sequential: DR (resolve tension) β ToT (optimize within synthesis) |
| AT | ToT | Sequential: AT (find analogies) β ToT (evaluate derived solutions) |
| AT | BoT | Parallel: Both explore, merge findings |
| HE | SRC | Sequential: HE (find cause) β SRC (trace mechanism) |
| RTR | HE | Sequential: RTR (immediate triage) β HE (post-incident RCA) |
| RTR | AR | Sequential: RTR (quick decision) β AR (post-decision validation) |
| NDF | ToT | Sequential: NDF (get buy-in) β ToT (optimize within agreed bounds) | | NDF | DR | Sequential: DR (resolve conceptual tension) β NDF (negotiate stakeholders) | | BoT | NDF | Sequential: BoT (explore options) β NDF (negotiate which to pursue) |
RTR Orchestration Rules:
NDF Orchestration Rules:
Parallel execution is appropriate when independent reasoning paths can run concurrently without blocking each other:
| Condition | Parallelization Strategy |
|---|---|
| Top 2 patterns within 0.3 of each other | Run both patterns in parallel, compare results |
| BoT natural parallelism | 8-10 branches can explore simultaneously |
| Hypothesis testing (HE) | Parallel evidence gathering for multiple hypotheses |
| Multi-perspective needs (MoA pattern) | Different "expert personas" analyze in parallel |
| Pattern Combination | Parallel Strategy | Merge Approach |
|---|---|---|
| BoT || AT | Parallel exploration from different angles | Merge findings, deduplicate insights |
| ToT branches | Parallel subtree exploration at each level | Take best-scoring subtree |
| HE hypotheses | Parallel evidence collection for each hypothesis | Aggregate evidence, eliminate losers |
| AR attacks | Parallel threat simulation (different attack vectors) | Union of discovered vulnerabilities |
parallel_config:
max_concurrent_patterns: 3 # Max patterns running simultaneously
max_concurrent_branches: 8 # Max branches within a single pattern
merge_strategy: "consensus" # "consensus" | "voting" | "aggregation" | "best-of-n"
timeout_per_branch_ms: 60000 # 60 second timeout per branch
early_termination_threshold: 0.95 # Stop early if confidence exceeds this
Configuration Guidelines:
max_concurrent_patterns: 2 for typical orchestrationmax_concurrent_branches: 8 for BoT explorationtimeout_per_branch_ms for complex sub-problemsearly_termination_threshold (e.g., 0.85) when speed matters more than certainty| Strategy | When to Use | Behavior |
|---|---|---|
| Consensus | High-stakes, need confidence | All must agree β boost confidence by +10%; any disagreement β flag for review |
| Voting | Multiple viable options | Majority wins; ties broken by highest individual confidence |
| Aggregation | Complementary findings | Synthesize all findings into unified result; no filtering |
| Best-of-N | Competitive exploration | Take highest confidence result; discard others |
Merge Strategy Selection:
If robustness critical β "consensus"
If options are mutually exclusive β "voting"
If findings are additive β "aggregation"
If racing for speed β "best-of-n"
Parallel execution integrates with the .reasoning/ handover protocol:
.reasoning/
βββ current-context.md # Master context (shared by all branches)
βββ parallel-session/
β βββ config.yaml # Parallel execution configuration
β βββ branch-001/
β β βββ approach.md # Pattern being applied
β β βββ findings.md # Intermediate findings
β β βββ confidence.json # Branch confidence score
β βββ branch-002/
β β βββ approach.md
β β βββ findings.md
β β βββ confidence.json
β βββ branch-N/
β βββ ...
βββ merge-result.md # Synthesized output from all branches
βββ handover.md # Final handover (captures all branch insights)
Protocol Rules:
branch-{id}/ directorystatus: failed)Branch Handover Template:
## Branch {id} Summary
- **Pattern Applied**: [pattern name]
- **Conclusion**: [finding]
- **Confidence**: [X]%
- **Key Insights**: [unique contributions]
- **Disagreements**: [where this branch diverged from others]
After 15 minutes of applying selected pattern:
## Checkpoint Evaluation
### Progress Check
- [ ] Have I made meaningful progress toward goal?
- [ ] Is my confidence increasing?
### Pattern Fit Check
- [ ] Am I fighting the methodology?
- [ ] Have I discovered new problem characteristics?
### New Information
- [ ] Has the problem changed?
- [ ] Do my characteristic scores need updating?
### Decision
If 2+ checks FAIL:
β PAUSE: Re-score characteristics
β If different pattern scores highest: SWITCH
β If same pattern: Continue with awareness
If all checks PASS:
β Continue current pattern
β Set next checkpoint at 30 min mark
V1 Problem: Additive confidence boosting was statistically invalid.
V2 Approach: Agreement-based bounded adjustment.
Use the pattern's internal confidence score (per its methodology).
## Multi-Pattern Synthesis
### Raw Scores
- Pattern A conclusion: [Answer A] at [X]% confidence
- Pattern B conclusion: [Answer B] at [Y]% confidence
- Pattern C conclusion: [Answer C] at [Z]% (if used)
### Agreement Analysis
**FULL AGREEMENT** (same conclusion):
- Final Confidence = MIN(MAX(X, Y, Z) + 5%, 95%)
- Rationale: Independent paths converging increases trust
**Confidence Bounds**:
- Floor: 10% (never report lower confidence)
- Ceiling: 95% (never report higher confidence)
**PARTIAL AGREEMENT** (2/3 agree):
- Final Confidence = (AVG of agreeing Γ 0.7) + (disagreeing Γ 0.15)
- Must document the disagreement
- Consider: Why does one pattern disagree?
**NO AGREEMENT** (different conclusions):
- Final Confidence = MIN(X, Y, Z) - 10%
- This is a FEATURE not a bug - disagreement reveals complexity
- Action: Either (a) gather more information, or (b) present trade-offs to stakeholder
### Shared Assumption Discount
If patterns share significant assumptions, apply -5% adjustment.
(Same LLM, same problem framing, same information = shared blind spots)
Tree of Thoughts (ToT):
Breadth of Thought (BoT):
Self-Reflecting Chain (SRC):
Hypothesis-Elimination (HE):
Adversarial Reasoning (AR):
Dialectical Reasoning (DR):
Analogical Transfer (AT):
Rapid Triage Reasoning (RTR):
Negotiated Decision Framework (NDF):
"I need to find the BEST option among known choices"
β Tree of Thoughts
"I need to explore ALL possible approaches"
β Breadth of Thought
"I need to trace through a logical chain step by step"
β Self-Reflecting Chain
"I need to find THE CAUSE of something"
β Hypothesis-Elimination
"I need to VALIDATE a solution before committing"
β Adversarial Reasoning
"I'm stuck between two valid but opposing approaches"
β Dialectical Reasoning
"This problem is novel - no one has solved it in my domain"
β Analogical Transfer
"I need to decide RIGHT NOW (minutes, not hours)"
β Rapid Triage Reasoning
"Multiple stakeholders with competing interests must agree"
β Negotiated Decision Framework
"I'm not sure which to use"
β Score the dimensions (Step 1)
--- Parallelism Quick-Reference ---
"Top 2 patterns scored within 0.3"
β Run both in parallel, merge with "consensus" or "voting"
"Need to explore many options fast"
β Use BoT with max_concurrent_branches: 8
"Testing multiple hypotheses"
β HE with parallel evidence gathering
"Need diverse perspectives on same problem"
β MoA pattern: parallel expert personas
"Running parallel but need to merge"
β consensus (high-stakes) | voting (exclusive) | aggregation (additive) | best-of-n (speed)
Problem: "Design our company's approach to AI governance"
| Dimension | Score | Reasoning |
|---|---|---|
| Sequential Dependencies | 2 | Not really step-by-step |
| Criteria Clarity | 3 | Some criteria, but subjective |
| Solution Space Known | 2 | Emerging field, options unclear |
| Single Answer Needed | 4 | Need one policy |
| Evidence Available | 2 | Few precedents to learn from |
| Opposing Valid Views | 5 | Big tension: innovation vs caution |
| Problem Novelty | 5 | Very new challenge |
| Robustness Required | 4 | High stakes, need validation |
| Solution Exists | 1 | No candidate solution yet |
| Time Pressure | 2 | Strategic decision, not urgent |
Primary: Analogical Transfer (4.45) - Look at how other governance challenges were solved Secondary: Dialectical Reasoning (3.80) - Innovation vs caution tension needs synthesis
Orchestration: AT β DR β AR
V2.1 (Current):
V2.0:
V1.0 (Deprecated):