Article
Sliding window beats linear attention, but only on short answers
sirluk
• • 5
Lukas
sirluk
AI & ML interests
None yet
Recent Activity
published an article 3 days ago
Sliding window beats linear attention, but only on short answers commentedon their article 6 days ago
Efficient LLM Pretraining: Packed Sequences and Masked Attention upvoted a paper 17 days ago
Kronecker Delta Rule for Long Context Linear AttentionOrganizations
published an article 3 days ago
published an article about 2 years ago
Article
Efficient LLM Pretraining: Packed Sequences and Masked Attention
sirluk
• • 74 published an article almost 3 years ago
Article
Multilabel Classification using Mistral-7B on a single GPU with quantization and LoRA
sirluk
• • 26