Feedback Loops (L8) β
Evaluation signals mapped to actions across layers. In 0.1 only two automatic loops are enabled; others produce recommendations.
Signals β Actions by Layer (0.1) β
L1 Noosphere (retrieval)
- Signals: recall@k, mrr@10, groundedness/faithfulness, source_hygiene
- Auto actions:
- rerank_tweak: adjust semantic/BM25 weights; adjust k within safe bounds
- source_blacklist(id, ttl): blacklist lowβquality/poisoned sources (TTL)
- Recommendations: reindex segments, refresh embeddings, normalize duplicates
L3 Workshop (tools)
- Signals: tool_success_rate, error_rate, p95_latency, error taxonomy
- Auto actions:
- tool_blacklist(tool_id, ttl)
- retry_policy_tune (limits only)
- Recommendations: fallback chain updates, parameter tuning, deprecation candidates
L5 Memory
- Signals: contradiction/contamination, suspect entries, consolidation score
- Recommendations: mark_suspect(ids), reconsolidate, tighten retention policy
Orchestration (ACS/CEO/HCS)
- Signals: e2e p95, strategy failure patterns
- Recommendations: strategy switch, stop criteria updates, routing changes
Event Model (minimal) β
- evaluation_observation: raw facts (latency_ms, tokens, tool outcome, retrieved_ids)
- evaluation_result: metric/value/threshold/verdict + links to observations
- feedback_action:
{ type, scope, ttl, reason, request_id, ts }
Safety & Rollback β
- All auto actions must be scoped and reversible (TTL)
- Keep audit trail with request_id and who/what triggered
- Canary and shadow evaluation before enabling broader scope