Training procedure
The following bitsandbytes
quantization config was used during training:
- loadin8bit: True
- loadin4bit: False
- llmint8threshold: 6.0
- llmint8skip_modules: None
- llmint8enablefp32cpu_offload: False
- llmint8hasfp16weight: False
- bnb4bitquant_type: fp4
- bnb4bitusedoublequant: False
- bnb4bitcompute_dtype: float32
The following bitsandbytes
quantization config was used during training:
- loadin8bit: True
- loadin4bit: False
- llmint8threshold: 6.0
- llmint8skip_modules: None
- llmint8enablefp32cpu_offload: False
- llmint8hasfp16weight: False
- bnb4bitquant_type: fp4
- bnb4bitusedoublequant: False
- bnb4bitcompute_dtype: float32
Framework versions
PEFT 0.6.0.dev0
PEFT 0.6.0.dev0
评论