QWEN2_0_5B_DECODEFooterOffsets Struct Reference

#include <ck-kernel-inference.h>

Data Fields
size_t	final_ln_weight
size_t	final_output
size_t	lm_head_weight
size_t	logits

Detailed Description

Definition at line 654 of file v6.5/test_generated/ck-kernel-inference.h.

Field Documentation

final_ln_weight

size_t QWEN2_0_5B_DECODEFooterOffsets::final_ln_weight

Definition at line 655 of file v6.5/test_generated/ck-kernel-inference.h.

Referenced by qwen2_0_5b_decode_decode_token(), and qwen2_0_5b_decode_forward_prefill_impl().

final_output

size_t QWEN2_0_5B_DECODEFooterOffsets::final_output

Definition at line 656 of file v6.5/test_generated/ck-kernel-inference.h.

Referenced by qwen2_0_5b_decode_decode_token(), and qwen2_0_5b_decode_forward_prefill_impl().

lm_head_weight

size_t QWEN2_0_5B_DECODEFooterOffsets::lm_head_weight

Definition at line 657 of file v6.5/test_generated/ck-kernel-inference.h.

Referenced by qwen2_0_5b_decode_decode_token(), and qwen2_0_5b_decode_forward_prefill_impl().

logits

size_t QWEN2_0_5B_DECODEFooterOffsets::logits

Definition at line 658 of file v6.5/test_generated/ck-kernel-inference.h.

Referenced by ck_model_get_logits(), qwen2_0_5b_decode_decode_token(), and qwen2_0_5b_decode_forward_prefill_impl().

---

The documentation for this struct was generated from the following file:

• v6.5/test_generated/ck-kernel-inference.h