Skip to content
OBLAIDISH NEWS
signal_tag · 2_broadcasts

#self-hosted-llm

// 2 transmissions tagged with #self-hosted-llm

Pi-tree cuts token usage by 80% with tree-structured conversations
TX_266510· AI

Pi-tree cuts token usage by 80% with tree-structured conversations

Pi-tree, a self-hosted AI reading companion, uses tree-structured conversations to reduce token usage and hallucinations. It ships as an AGPL-3.0 Docker image with a TypeScript plugin SDK [Dev.to][GitHub].

Self-hosted Claude Code speedup: caching fix eliminates 15× slowdown
TX_797693· AI

Self-hosted Claude Code speedup: caching fix eliminates 15× slowdown

Self-hosted Claude Code ran 15× slower because a rotating billing header broke caching in vllm‑mlx’s SimpleEngine; a shim and upstream patch restore caching and cut latency to 7‑8 seconds.