Tier 4

upth - Unproceduralized Thinking

Unproceduralized Thinking

Input: $ARGUMENTS


Step 1: Observe the Thinking Process

Watch how the task or domain is actually approached, step by step.

DOMAIN: [what area of thinking is being examined]
TASK: [specific task or class of tasks]

OBSERVABLE STEPS (what people visibly do):
1. [step] — Seems to require: [skill/knowledge]
2. [step] — Seems to require: [skill/knowledge]
...

DECISION POINTS (where choices are made):
1. [decision] — Based on: [criteria, if visible]
2. [decision] — Based on: [criteria, if visible]

Step 2: Identify Implicit Steps

Find the steps people take without articulating them.

IMPLICIT STEPS (done automatically, rarely explained):
1. [step] — Evidence it's happening: [how we know]
   Currently described as: [vague description like "use judgment" or "just know"]
2. [step] — Evidence it's happening: [how we know]
   Currently described as: [vague description]

MAGIC STEPS (described as "intuition" or "experience"):
1. [step] — What's actually happening: [hypothesis]
2. [step] — What's actually happening: [hypothesis]

GAP PHRASES (language that hides unformalized thinking):
- "It depends" → Depends on what? [specifics]
- "Use your judgment" → What criteria? [specifics]
- "You just know" → Know from what signals? [specifics]

Step 3: Surface Tacit Knowledge

Extract the knowledge that experts have but can’t easily articulate.

TACIT KNOWLEDGE INVENTORY:
1. [knowledge item]
   Expert has it: [YES]
   Can articulate it: [NO / PARTIALLY]
   Extraction method: [observation / probing questions / contrasting cases]

2. [knowledge item]
   Expert has it: [YES]
   Can articulate it: [NO / PARTIALLY]
   Extraction method: [method]

PATTERN RECOGNITION (experts see patterns novices miss):
- Pattern: [what they notice] → Meaning: [what it indicates]

HEURISTICS (rules of thumb used unconsciously):
- [heuristic]: used when [context]

Step 4: Formalize Into Explicit Steps

Convert implicit knowledge into a followable procedure.

FORMALIZED PROCEDURE:

Step 1: [explicit action]
  - Input: [what you need]
  - Decision criteria: [how to choose]
  - Output: [what you produce]

Step 2: [explicit action]
  - Input: [from previous step]
  - Decision criteria: [how to choose]
  - Output: [what you produce]
...

DECISION TREES (for "it depends" moments):
If [condition A] → do [X]
If [condition B] → do [Y]
Otherwise → do [Z]

QUALITY CHECKS (for "you just know" moments):
- Check: [specific thing to verify]
- Good looks like: [concrete description]
- Bad looks like: [concrete description]

Step 5: Test the Procedure

Evaluate whether the formalized procedure actually works.

TEST CASES:
1. [scenario] — Procedure output: [result] — Expert would do: [result] — Match? [Y/N]
2. [scenario] — Procedure output: [result] — Expert would do: [result] — Match? [Y/N]

EDGE CASES WHERE PROCEDURE FAILS:
- [case]: procedure says [X] but correct answer is [Y]
  Missing element: [what the procedure doesn't capture]

COVERAGE: [what % of cases does the procedure handle correctly?]

Step 6: Refine

REFINEMENTS NEEDED:
1. [gap in procedure] → Add: [new step or criterion]
2. [gap in procedure] → Add: [new step or criterion]

REMAINING TACIT KNOWLEDGE (cannot yet be proceduralized):
- [item]: Why resistant: [explanation]

FINAL PROCEDURE QUALITY:
- Explicitness: [HIGH/MED/LOW]
- Completeness: [HIGH/MED/LOW]
- Usability by non-expert: [HIGH/MED/LOW]

RECOMMENDED USE: [who should use this procedure and when]

Integration

Use with:

  • /gapf -> Find gaps in the formalized procedure
  • /dxpt -> Have a domain expert validate the procedure
  • /nusr -> Test if newcomers can follow the procedure