TinyLLMManager.h File Reference

Singleton manager for TinyLLM inference. More...

#include "PolyphaseAPI.h"
#include "Assets/TinyLLMAsset.h"
#include <string>
#include <vector>
#include <stdint.h>

Go to the source code of this file.

Classes
class	TinyLLMManager
	Singleton that manages LLM inference state. More...
struct	TinyLLMManager::ProbIndex

Detailed Description

Singleton manager for TinyLLM inference.