ध्यान-तन्त्र: एआई बुद्धि का केंद्र

Everything from the AI economy to Chat GPT's capabilities traces back to a 2014 breakthrough by Dzmitry Bahdanau, a 23-year-old intern at the University of Montreal. Working with Yoshua Bengio and Kyunghyun Cho, Bahdanau tackled machine translation—a deceptively complex task involving idioms, grammar, and context. Traditional neural networks struggled with long sentences due to a memory bottleneck.

Bahdanau's solution—"attention"—allowed networks to dynamically focus on relevant parts of input, solving the scalability issue. This innovation quickly spread through AI research. In 2017, Google's transformer architecture, powered by attention, revolutionized the field with the seminal paper "Attention Is All You Need" (cited 250,000+ times).

Large language models like Chat GPT and Claude followed. Attention enables AI to handle pronouns, context, and complex reasoning—leading researchers to ask: is this mechanism the essence of intelligence itself?.

स्रोत: Hacker News · HeadlinesBriefing द्वारा सारांशित