Unlimiformer: Long-Range Transformers with Unlimited Length Input

Keyphrases

• Transformer 100%
• K-nearest 100%
• Token 66%
• Decoder 33%
• Truncation 33%
• Publicly Available 33%
• Input Sequence 33%
• Long Documents 33%
• Sublinear Time 33%
• Dot Product 33%
• Llama 33%
• Cross-attention 33%
• Bounded Inputs 33%
• Neighbor Distance 33%
• Encoder-Decoder Transformer 33%
• Longformer 33%

Engineering

• Nearest Neighbor 100%
• Test Time 33%
• Summarization 33%
• Truncation 33%
• Linear Time 33%
• Dot Product 33%
• Graphics Processing Unit 33%
• Input Sequence 33%
• Bounded Input 33%

Computer Science

• Graphics Processing Unit 100%