TreasureX Research

Stop Copying, Start Thinking: New Training Method Cuts LLM Repetition in Long-Context Tasks

Lizhe Fang, Weizhou Shen, Tianyi Tang, Yisen Wang · July 21, 2026

Large language models (LLMs) often copy text from their input when generating step-by-step reasoning, especially in long-context tasks. This 'repetitive copying' wastes tokens and leads to wrong answers. Researchers found the root cause: models fail to focus on key evidence and instead copy irrelevant context. They propose GEAR (Grounding Evidence-Aware Reward), a reinforcement learning method that rewards the model for overlapping with key evidence and penalizes it for copying irrelevant text. GEAR improves accuracy by up to +4.6 points over standard RL, reduces copying, and shortens reasoning length. The gains are larger for longer contexts. This matters because as LLMs handle more complex, long-document tasks, simply copying won't work—models need to truly understand and ground their reasoning in relevant evidence. For investors, this suggests that training methods focusing on evidence grounding could become a key differentiator for LLM performance in enterprise applications like legal analysis, scientific research, and customer support.

Read more: https://arxiv.org/abs/2607.19345

Educational content only, generated with AI assistance from public research abstracts. Not investment advice. Thank you to arXiv for use of its open access interoperability.