by ekez on 11/18/23, 11:09 PM with 1 comments
by ekez on 11/18/23, 11:09 PM
The title is an allusion to the experiment which samples the output of the 12th layer of LLaMA-7b. Surprisingly, there is a fair bit of structure on the principle components of those samples.