Question
#1
by
Clemylia
- opened
Hello
Are you doing fine-tuning or creating from scratch?
Hello, most of my models focus on fine-tuning rather than being pretrained from scratch due to hardware limitations. Additionally, pretraining requires multiple iterations and large amounts of high-quality data to achieve good performance.
I kind of suspected that
Personally, I do a bit of both.
I designed my SLM "Charlotte-amity" entirely from scratch.
But I can understand that it's difficult.
Cool!!