harvardMadsys/freeinference_agentic_trace
Viewer • Updated • 2.51M • 5.43k • 56
ZMC PRO
ZMC2019
AI & ML interests
None yet
Recent Activity
liked a dataset 19 days ago
harvardMadsys/freeinference_agentic_trace upvoted a paper 30 days ago
MagicPIG: LSH Sampling for Efficient LLM Generation updated a dataset 3 months ago
ZMC2019/KBenchOrganizations
liked a
dataset 19 days ago
upvoted a paper 30 days ago
updated a
dataset 3 months ago
published a
dataset 3 months ago
updated a
dataset 3 months ago
published a
dataset 4 months ago
updated a
dataset 4 months ago
published 2
models 11 months ago
upvoted a paper over 1 year ago
commented a
paper over 1 year ago
authored 9
papers over 1 year ago
SpecInfer: Accelerating Generative LLM Serving with Speculative Inference and Token Tree Verification
Paper • 2305.09781 • Published • 4
GNNPipe: Scaling Deep GNN Training with Pipelined Model Parallelism
Paper • 2308.10087 • Published • 1
Sequoia: Scalable, Robust, and Hardware-aware Speculative Decoding
Paper • 2402.12374 • Published • 4
TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding
Paper • 2404.11912 • Published • 17
SpecExec: Massively Parallel Speculative Decoding for Interactive LLM Inference on Consumer Devices
Paper • 2406.02532 • Published • 13
MagicDec: Breaking the Latency-Throughput Tradeoff for Long Context Generation with Speculative Decoding
Paper • 2408.11049 • Published • 14
MINI-SEQUENCE TRANSFORMER: Optimizing Intermediate Memory for Long Sequences Training
Paper • 2407.15892 • Published
Sirius: Contextual Sparsity with Correction for Efficient LLMs
Paper • 2409.03856 • Published • 1
MagicPIG: LSH Sampling for Efficient LLM Generation
Paper • 2410.16179 • Published • 1