Researchers identified 'role drift' in compound AI systems, where a RAG reader module learned to answer from internal memory...

Source Brief

Researchers identified 'role drift' in compound AI systems, where a RAG reader module learned to answer from internal memory rather than retrieved evidence, accounting for 86% of reported accuracy gains. The finding shows how end-to-end optimization can hide modules that bypass their intended role.