model_config Struct Reference

Public Member Functions
	model_config (int batch, int num_heads, int num_layers, int max_sqlen, int embed_dim, int hidden_dim, int vocsize, int padding_idx, float rms_norm_eps)
	model_config (int batch, int num_heads, int num_kv_heads, int num_layers, int max_sqlen, int embed_dim, int hidden_dim, int vocsize, int padding_idx, float rms_norm_eps)
	model_config (int batch, int num_heads, int num_layers, int max_sqlen, int embed_dim, int hidden_dim, int vocsize, int padding_idx, float rms_norm_eps, int image_size, int patch_size, int projection_dim, int mmproj_dim)

Public Attributes
int	batch
int	num_heads
int	num_kv_heads
int	num_layers
int	max_sqlen
int	embed_dim
int	hidden_dim
int	vocsize
int	padding_idx
float	rms_norm_eps
int	image_size
int	patch_size
int	projection_dim
int	mmproj_dim

---

The documentation for this struct was generated from the following file:

• llm/include/model.h