How can I Fine Tune it to increase its context Length while maintaining its accuracy and knowledge?

by kalashshah19 - opened Aug 13

Aug 13

I have tried to increase its context length to 8K tokens but its accuracy dropped like anything

kalashshah19 changed discussion title from How can I Fine Tune it to increase its context Length while maintaining its accuracy and knowldge? to How can I Fine Tune it to increase its context Length while maintaining its accuracy and knowledge? Aug 13

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment