block_q8_K Struct Reference

#include <ckernel_quant.h>

Data Fields
int16_t	bsums [256/16]
float	d
int8_t	qs [256]

Detailed Description

Definition at line 170 of file ckernel_quant.h.

Field Documentation

bsums

int16_t block_q8_K::bsums[256/16]

Definition at line 173 of file ckernel_quant.h.

Referenced by dot_q4_k_q8_k_ref(), dot_q5_0_q8_k_32_sse(), fused_rmsnorm_linear_q4k(), gemv_q4_k_q8_k_sse(), quantize_row_q8_k_ref(), quantize_row_q8_k_sse(), and rmsnorm_q8_k_fused().

d

float block_q8_K::d

Definition at line 171 of file ckernel_quant.h.

Referenced by ck_debug_check_q8k(), dot_q4_k_q8_k_ref(), dot_q5_0_q8_k_32_sse(), dot_q6_k_q8_k_256_sse(), dot_q6_k_q8_k_ref(), fused_rmsnorm_linear_q4k(), gemv_q4_k_q8_k_sse(), quantize_row_q8_k_ref(), quantize_row_q8_k_sse(), and rmsnorm_q8_k_fused().

qs

int8_t block_q8_K::qs[256]

Definition at line 172 of file ckernel_quant.h.

Referenced by dot_q4_k_q8_k_ref(), dot_q5_0_q8_k_32_sse(), dot_q6_k_q8_k_256_sse(), dot_q6_k_q8_k_ref(), fused_rmsnorm_linear_q4k(), gemv_q4_k_q8_k_sse(), quantize_row_q8_k_ref(), and rmsnorm_q8_k_fused().

---

The documentation for this struct was generated from the following file:

• ckernel_quant.h