vLLM's speculative decoding on AMD GPUs can verify multiple drafted tokens in a single pass, improving output-token throughput.

Source Brief

vLLM's speculative decoding on AMD GPUs can verify multiple drafted tokens in a single pass, improving output-token throughput. Results vary by drafting method, model family, and workload.