Skip to content

[CK] Add FP8 KV_BLOCKSCALE support for batch prefill - #3696

Closed
Jeff-Huang wants to merge 6 commits into
developfrom
batch-prefill-fp8-kvcache-blockscale
Closed

[CK] Add FP8 KV_BLOCKSCALE support for batch prefill#3696
Jeff-Huang wants to merge 6 commits into
developfrom
batch-prefill-fp8-kvcache-blockscale

Split kv_block_descale_ptr into k_descale_ptr and v_descale_ptr to ma…

c093935
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar