llama_vocab Struct Reference

Classes
struct	token_score

Public Attributes
std::unordered_map< std::string, int32_t >	token_to_id
std::vector< token_score >	id_to_token

---

The documentation for this struct was generated from the following file:

• llm/include/LLaMATokenizer.h