Lukas

sirluk

·

AI & ML interests

None yet

Recent Activity

published an article 1 day ago

Sliding window beats linear attention, but only on short answers

commentedon their article 4 days ago

Efficient LLM Pretraining: Packed Sequences and Masked Attention

upvoted a paper 14 days ago

Kronecker Delta Rule for Long Context Linear Attention

View all activity

Organizations

Articles 3

Article

5

Sliding window beats linear attention, but only on short answers

Article

74

Efficient LLM Pretraining: Packed Sequences and Masked Attention

View all Articles

Papers 3

arxiv:2607.05061

arxiv:2603.15590

arxiv:2410.07170

spaces 1

Trl Lora Without Regret Smollm3

Display tracking information

models 1

sirluk/Qwen3-8B-KVpop-4x

Text Generation • 8B • Updated Jul 13 • 42 • 3

datasets 0

None public yet