AnythingLLM adds Model Router for dynamic local and cloud AI routing

{
  "event_id": "event_be3323ee7ff005f3",
  "topic_id": "consumer_ai_applications",
  "event_type": "Release",
  "event_time": "2026-05-26T19:08:06Z",
  "title": "AnythingLLM adds Model Router for dynamic local and cloud AI routing",
  "summary": "AnythingLLM v1.13.0 introduces a Model Router that dynamically directs individual messages within a single conversation to either local or cloud AI models based on user-defined rules, eliminating the manual tradeoff between local privacy and cloud performance.",
  "contribution": "Added a user-defined intelligent routing system that evaluates message keywords, token counts, and intent to automatically select the optimal local or cloud LLM for each specific query in a unified chat interface.",
  "impact": "Consumers and developers can now reduce API costs and protect data privacy by automatically sending simple queries to local models and complex tasks to cloud models within the same chat, without manual switching. The underlying rule-based and LLM-classified routing engine requires continued observation to ensure that intent misclassification does not accidentally leak sensitive prompts to external cloud providers or introduce noticeable latency during message analysis.",
  "maturity": "Production",
  "confidence": 0,
  "importance_score": 0.85,
  "risk_flags": [
    "Data Privacy Leakage Via Misrouting",
    "Routing Latency Overhead",
    "Intent Classification Errors"
  ],
  "evidence_count": 1
}