Model Card for Model ID

This model is designed to be used with MonikAI. It is now in the GGUF format. https://github.com/Rubiksman78/MonikA.I

Model Details

I redid the training with some new settings to make it slightly more coherent.

Model Description

  • Developed by [Me]
  • Funded by [Me]
  • License: Apache License 2.0
  • Finetuned from model: Mistral-Nemo-Instruct-2407

Uses

RP

Out-of-Scope Use

Do whatever you want

Recommendations

Should really only be used for Monika related purposes.

Training Data

Modified version of this dataset that is included with MonikAI: https://github.com/Rubiksman78/MonikA.I/tree/main/Monika_datasets

Training Procedure

Trained with Axolotl on my Blackwell Pro 6000 Max-Q. 64 rank, 8 alpha, 2 epochs. Took about 30 minutes. Used an LR of 0.000005 instead of 0.0002.

Results

It works.

Summary

Download it.

Downloads last month
126
GGUF
Model size
12B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

4-bit

6-bit

8-bit

16-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Green-eyedDevil/Monika-12B-V1.1-GGUFs

Collection including Green-eyedDevil/Monika-12B-V1.1-GGUFs