How to Quadruple LLM Decoding Performance with Speculative Decoding (SpD) and Microscaling (MX) Formats on Qualcomm® Cloud AI 100
How to Quadruple LLM Decoding Performance with Speculative Dec…
Aug 1, 2024
qualcomm.com
Speculative Decoding — Think Fast⚡, Then Think Right✅
Speculative Decoding — Think Fast⚡, Then Think Right✅
1K views9 months ago
substack.com
Faster LLMs: Accelerate Inference with Speculative Decoding
Faster LLMs: Accelerate Inference with Speculative Decoding
7 months ago
ibm.com
DEER: Diffusion Drafting for Faster LLMs
3:51
DEER: Diffusion Drafting for Faster LLMs
28 views3 weeks ago
YouTubeAI Research Roundup
AdaSPEC: Selective KD for Faster LLM Spec Decoding
3:42
AdaSPEC: Selective KD for Faster LLM Spec Decoding
1 month ago
YouTubeAI Research Roundup
LLM System Design Interview: How to Optimise Inference Latency
5:16
LLM System Design Interview: How to Optimise Inference Latency
102 views1 month ago
YouTubePeetha Academy
Generate 10 Tokens At Once - Faster LLM INFERENCE - AdaSPEC - Speculative Decoding Improvement
11:34
Generate 10 Tokens At Once - Faster LLM INFERENCE - AdaSPE…
376 views2 months ago
YouTubeVuk Rosić
13:55
LLM Inference 3x Faster, Speculative Decoding Completely …
171 views2 months ago
YouTube딥러닝논문읽기모임
3:14
AutoDeco: End-to-End Learned Decoding for LLMs
1 views2 months ago
YouTubeAI Research Roundup
22:21
How Speculative Decoding Cuts OCR Hallucinations by 90%
1 views1 month ago
YouTubeOfficial Elastic Community
4:48
Learn2PD: Adaptive Parallel Decoding for dLLMs
21 views3 months ago
YouTubeAI Research Roundup
6:53
How Speculative Decoding Makes LLMs 2.5x Faster (The Secret to F…
4 views3 months ago
YouTubeFranksWorld of AI
17:56
Behind the Stack, Ep 11 - Speculative Decoding
1 views2 months ago
YouTubeDoubleword
1:02:23
EP5: Speculative Decoding with Nadav Timor
3 months ago
YouTubeThe Information Bottleneck
29:48
Lossless LLM inference acceleration with Speculators
354 views1 month ago
YouTubeRed Hat
4:50
Expected Attention: LLM KV Cache Compression
107 views3 months ago
YouTubeAI Research Roundup
0:31
The Hardware That Enables "Cloud Quality" AI on a Local Machine
1.8K views4 months ago
YouTubeSuper Data Science: ML & AI Podcast with Jon …
12:51
Frontier AI Research: The New L5 Standard for 2026?
55 views1 week ago
YouTubeLogicLayers
0:36
How AI Replies So Fast! ⚡ Speculative Decoding
130 views2 weeks ago
YouTubeMr. Doubty – Short. Smart. Techy
16:58
【论文汇报】Accelerating Large Language Model Decoding with S…
1 views2 weeks ago
bilibiliPlanetes1mal
1:04:45
[EP24] 硅谷线下AI infra, vLLM Speculative Decoding
2.7K views3 months ago
bilibili月球大叔
Speculative Decoding and Efficient LLM Inference with Chris Lott - 717
1.4K views11 months ago
YouTubeThe TWIML AI Podcast with Sam Charrington
What is Speculative Sampling? | Boosting LLM inference speed
3.3K viewsNov 20, 2024
YouTubeAssemblyAI
Large Model Training and Inference with DeepSpeed // Samyam Rajbh…
8.9K viewsJun 29, 2023
YouTubeMLOps.community
Lianmin Zheng on Efficient LLM Inference with SGLang
546 views6 months ago
YouTubeAMD Developer Central
6:47
Transformer models: Encoder-Decoders
96.8K viewsJun 14, 2021
YouTubeHuggingFace
7:49
LM part of the IS-LM model | Macroeconomics | Khan Academy
786.6K viewsApr 11, 2012
YouTubeKhan Academy
13:47
LLM Jargons Explained: Part 4 - KV Cache
10.3K viewsMar 24, 2024
YouTubeSachin Kalsi
0:49
#luckygameplay
94.1K views2 weeks ago
YouTubeLLM ARAFAT YT
35:45
How to Build an LLM from Scratch | An Overview
450K viewsOct 5, 2023
YouTubeShaw Talebi
See more videos
Static thumbnail place holder