Article
Meta-learning Meets Small Models
•
1
appvoid
appvoid
AI & ML interests
Working on symbolic models
Recent Activity
updated
a model about 12 hours ago
appvoid/dot replied to their post about 13 hours ago
Let's keep the momentum for small models. I just published dot. It's the first pretrained causal model that is trained on math/symbols rather than english. The goal is to get an agnostic fewshot meta learner that learns from reality itself instead of language.
It's already decent at some tasks, with next version coming in a few weeks.
https://huggingface.co/appvoid/dot replied to their post about 16 hours ago
Let's keep the momentum for small models. I just published dot. It's the first pretrained causal model that is trained on math/symbols rather than english. The goal is to get an agnostic fewshot meta learner that learns from reality itself instead of language.
It's already decent at some tasks, with next version coming in a few weeks.
https://huggingface.co/appvoid/dot Organizations
published an
article 4 months ago