by panabee on 6/13/24, 5:57 PM with 3 comments
by jiggawatts on 6/13/24, 10:20 PM
Seems like it scales better than transformers, but this would only be really obvious at parameter counts far in excess of the experiments in this paper.