#include <ckernel_model.h>
Data Fields | |
| size_t | attn_proj_bias_offset |
| size_t | attn_proj_weight_offset |
| size_t | fc1_bias_offset |
| size_t | fc1_weight_offset |
| size_t | fc2_bias_offset |
| size_t | fc2_weight_offset |
| size_t | ln1_bias_offset |
| size_t | ln1_weight_offset |
| size_t | qkv_bias_offset |
| size_t | qkv_weight_offset |
Simplified forward-only model layout.
This is the first step toward the full TransformerModel / TrulyOptimalLayer / GradientStorage design. It focuses on:
Backward/optimizer offsets and KV cache layout will be layered on later.
Definition at line 20 of file ckernel_model.h.
| size_t CKLayerLayout::attn_proj_bias_offset |
Definition at line 29 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::attn_proj_weight_offset |
Definition at line 28 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::fc1_bias_offset |
Definition at line 32 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::fc1_weight_offset |
Definition at line 31 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::fc2_bias_offset |
Definition at line 35 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::fc2_weight_offset |
Definition at line 34 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::ln1_bias_offset |
Definition at line 23 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::ln1_weight_offset |
Definition at line 22 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::qkv_bias_offset |
Definition at line 26 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().
| size_t CKLayerLayout::qkv_weight_offset |
Definition at line 25 of file ckernel_model.h.
Referenced by ck_model_load_weights_flat(), and layout_transformer_from_ir().