huggingface/trl
FeaturesSFT default loss_type is now "chunked_nll" The flip announced in v1.6 has landed. Setting loss_type is optional, and the default now resolves to "chunked_nll" — giving every SFTTrainer run...
FeaturesSFT default loss_type is now "chunked_nll" The flip announced in v1.6 has landed. Setting loss_type is optional, and the default now resolves to "chunked_nll" — giving every SFTTrainer run...