from
Hacker News
Top
New
Extending GPT-3’s context window infinitely
by
mayerwin
on 6/7/21, 3:24 AM with 2 comments
by
mayerwin
on 6/7/21, 3:24 AM
What do you think of this idea to infinitely extend GPT-3's context window, by storing context in GPT-3 itself or in secondary layers?