schonsense/slim405B_Inst
Text Generation
•
157B
•
Updated
•
4
Mark Fenlon PRO
schonsense
AI & ML interests
Testing ground repo for merging, finetuning, and LORA manipulations.
Recent Activity
updated
a model
about 3 hours ago
schonsense/slim405B_Inst
liked
a dataset
4 days ago
Intel/orca_dpo_pairs
new activity
6 days ago
DontPlanToEnd/UGI-Leaderboard:Eval request
Organizations
updated
a
model
about 3 hours ago
liked
a
dataset
4 days ago
Eval request
#521 opened 6 days ago
by
schonsense
updated
a
model
6 days ago
published
a
model
6 days ago
updated
a
model
27 days ago
published
a
model
27 days ago
updated
3
models
28 days ago
published
a
model
28 days ago
updated
a
model
28 days ago
published
a
model
28 days ago
commented on
The Optimal Architecture for Small Language Models
28 days ago
Very interesting, thank you.
commented on
The Optimal Architecture for Small Language Models
29 days ago
Interesting. If you compare only the model layer parameters to their performances, are any different trends seen? Thank you for responding.
commented on
The Optimal Architecture for Small Language Models
29 days ago
Can you discuss the additional things contributing to param count that were not mentioned in your article? embedding/head size, intermediate dimensions? I'm struggling to see how a 768x4 has equivalent params to a 512x12.
published
a
model
29 days ago
updated
3
models
about 1 month ago