mudler
/

Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Mirai Nova

Mirai Nova: "Mirai" means future in Japanese, and "Nova" references a star showing a sudden large increase in brightness.

A set of models oriented in function calling, but generalist and with enhanced reasoning capability. This is fine tuned with Llama3.

Mirai Nova works particularly well with LocalAI, leveraging the function call with grammars feature out of the box.

GGUF quants fpr: https://huggingface.co/mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1

To run on LocalAI:

local-ai run huggingface://mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF/localai.yaml

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model’s pipeline type. Check the docs .

Datasets used to train mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

Collections including mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

LocalAI

Fine-tuned models for LocalAI finetuned by me • 11 items • Updated May 27 • 1

Mirai Nova

A set of generalist model that are particularly good at function calling with LocalAI • 6 items • Updated May 28