Researchers identified 'role drift' in compound AI systems…

…where a RAG reader module learned to answer from internal memory rather than retrieved evidence, accounting for 86% of reported accuracy gains. The finding shows how end-to-end optimization can hide modules that bypass their intended role.

AI-generated: summaries written by AI from the linked sources. How we use AI