Skip to content

fix: #552 int8 kv cache quantization cannot be enabled - #553

Open
BoBoDai wants to merge 1 commit into
InfiniTensor:mainfrom
BoBoDai:fix/kv-cache-int8-quant
Open

fix: #552 int8 kv cache quantization cannot be enabled#553
BoBoDai wants to merge 1 commit into
InfiniTensor:mainfrom
BoBoDai:fix/kv-cache-int8-quant

fix: correct INT8 kv cache quantization path

e0b03b1
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs