by davidajackson on 5/13/25, 2:56 PM with 0 comments
FYI... has anyone here considered how to represent background information (background context) at the beginning of a transformer sequence? Specialized tokens that refer to user attributes (a token preamble, if you will...).