QWEN2_0_5B_DECODEHeaderOffsets Struct Reference

#include <ck-kernel-inference.h>

Data Fields
size_t	embedded_input
size_t	token_emb
size_t	vocab_merges
size_t	vocab_offsets
size_t	vocab_strings

Detailed Description

Definition at line 49 of file v6.5/test_generated/ck-kernel-inference.h.

Field Documentation

embedded_input

size_t QWEN2_0_5B_DECODEHeaderOffsets::embedded_input

Definition at line 54 of file v6.5/test_generated/ck-kernel-inference.h.

Referenced by qwen2_0_5b_decode_decode_token(), qwen2_0_5b_decode_forward_prefill_impl(), qwen2_0_5b_decode_layer_0_decode(), and qwen2_0_5b_decode_layer_0_prefill().

token_emb

size_t QWEN2_0_5B_DECODEHeaderOffsets::token_emb

Definition at line 50 of file v6.5/test_generated/ck-kernel-inference.h.

Referenced by qwen2_0_5b_decode_decode_token(), and qwen2_0_5b_decode_forward_prefill_impl().

vocab_merges

size_t QWEN2_0_5B_DECODEHeaderOffsets::vocab_merges

Definition at line 53 of file v6.5/test_generated/ck-kernel-inference.h.

vocab_offsets

size_t QWEN2_0_5B_DECODEHeaderOffsets::vocab_offsets

Definition at line 51 of file v6.5/test_generated/ck-kernel-inference.h.

vocab_strings

size_t QWEN2_0_5B_DECODEHeaderOffsets::vocab_strings

Definition at line 52 of file v6.5/test_generated/ck-kernel-inference.h.

---

The documentation for this struct was generated from the following file:

• v6.5/test_generated/ck-kernel-inference.h