block_q4_K Struct Reference

#include <ckernel_quant.h>

Data Fields
ck_half	d
ck_half	dmin
uint8_t	qs [256/2]
uint8_t	scales [12]

Detailed Description

Definition at line 178 of file ckernel_quant.h.

Field Documentation

d

ck_half block_q4_K::d

Definition at line 179 of file ckernel_quant.h.

Referenced by dequant_q4_k_block(), gemv_q4_k_backward_ref(), gemv_q4_k_q8_k_sse(), gemv_q4_k_ref(), pack_q4_k_to_packed_meta(), pack_q4_k_to_packed_meta_x16(), pack_q4_k_to_packed_meta_x8(), pack_q4_k_to_packed_u8(), pack_q4_k_to_packed_u8_x16(), pack_q4_k_to_packed_vnni_x16(), and pack_q4_k_to_packed_vnni_x8().

dmin

ck_half block_q4_K::dmin

Definition at line 180 of file ckernel_quant.h.

Referenced by dequant_q4_k_block(), gemv_q4_k_backward_ref(), gemv_q4_k_q8_k_sse(), gemv_q4_k_ref(), pack_q4_k_to_packed_meta(), pack_q4_k_to_packed_meta_x16(), pack_q4_k_to_packed_meta_x8(), pack_q4_k_to_packed_u8(), pack_q4_k_to_packed_u8_x16(), pack_q4_k_to_packed_vnni_x16(), and pack_q4_k_to_packed_vnni_x8().

qs

uint8_t block_q4_K::qs[256/2]

Definition at line 182 of file ckernel_quant.h.

Referenced by dequant_q4_k_block(), dot_q4_k_q8_k_ref(), gemv_q4_k_backward_ref(), gemv_q4_k_q8_k_sse(), gemv_q4_k_ref(), pack_q4_k_to_packed_meta(), pack_q4_k_to_packed_meta_x16(), pack_q4_k_to_packed_meta_x8(), pack_q4_k_to_packed_u8(), pack_q4_k_to_packed_u8_x16(), pack_q4_k_to_packed_vnni_x16(), and pack_q4_k_to_packed_vnni_x8().

scales

uint8_t block_q4_K::scales[12]

Definition at line 181 of file ckernel_quant.h.

Referenced by dequant_q4_k_block(), gemv_q4_k_backward_ref(), gemv_q4_k_q8_k_sse(), gemv_q4_k_ref(), pack_q4_k_to_packed_meta(), pack_q4_k_to_packed_meta_x16(), pack_q4_k_to_packed_meta_x8(), pack_q4_k_to_packed_u8(), pack_q4_k_to_packed_u8_x16(), pack_q4_k_to_packed_vnni_x16(), and pack_q4_k_to_packed_vnni_x8().

---

The documentation for this struct was generated from the following file:

• ckernel_quant.h