#large-language-models

Δ-Mem cuts memory use in large language models without performance loss

Δ-Mem, a new memory optimization technique, reduces memory consumption in LLMs by compressing key-value states and reusing memory slots, maintaining full model performance [arXiv].