A tiny GPT memorized every fact I gave it, then couldn’t answer a single question that needed two of them. I tested the one-line fix from a recent paper, and it only half worked.The post Why a Tiny GPT Can Know Two Facts and Still Not Connect Them appeared first on Towards Data Science.
Source: Towards Data Science · Summarized by HeadlinesBriefing