Skip to content

Commit 2fa8ffb

Browse files
committed
Align Unsloth SFT weight decay defaults
1 parent 9c474c9 commit 2fa8ffb

1 file changed

Lines changed: 0 additions & 1 deletion

File tree

src/art/unsloth/service.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -759,7 +759,6 @@ async def train_sft(
759759
self._state,
760760
batches,
761761
verbose=verbose,
762-
weight_decay=0.01,
763762
max_grad_norm=1.0,
764763
):
765764
yield {

0 commit comments

Comments
 (0)