llama.cs

This asset serves as an excellent starting point for exploring and utilizing Large Language Models (LLMs) within the Unity environment. It comes equipped with the llama.cs binding, precompiled binaries for Windows (instructions for compiling binaries on other platforms, available in the orginal llama.cpp repository), and a straightforward and simplistic user interface. Whether you are a developer looking to integrate LLMs into your Unity projects or an enthusiast eager to experiment with language models, this asset provides the essential tools.

IMPORTANT: Ensure that you are comfortable with https://github.com/ggerganov/llama.cpp

GPT 4 integration example:

https://github.com/Battlehub0x/OpenAI-Unity?tab=readme-ov-file#importing-the-package

Documentation | Telegram | llama.cpp repository