TinyLLMConfig Struct Reference

Configuration for the transformer model. More...

#include <TinyLLMAsset.h>

Public Attributes
int32_t	dim = 0
int32_t	hidden_dim = 0
int32_t	n_layers = 0
int32_t	n_heads = 0
int32_t	n_kv_heads = 0
int32_t	vocab_size = 0
int32_t	seq_len = 0

Detailed Description

Configuration for the transformer model.

Member Data Documentation

dim

int32_t TinyLLMConfig::dim = 0

hidden_dim

int32_t TinyLLMConfig::hidden_dim = 0

n_heads

int32_t TinyLLMConfig::n_heads = 0

n_kv_heads

int32_t TinyLLMConfig::n_kv_heads = 0

n_layers

int32_t TinyLLMConfig::n_layers = 0

seq_len

int32_t TinyLLMConfig::seq_len = 0

vocab_size

int32_t TinyLLMConfig::vocab_size = 0

---

The documentation for this struct was generated from the following file:

• Engine/Source/Engine/Assets/TinyLLMAsset.h