add freeze options

docs/finetune.md

@@ -49,6 +49,10 @@ python tools/scp2jsonl.py \
 
 ## Finetune
 
+Modify the `audio_encoder_conf.freeze`, `audio_adaptor_conf.freeze`, and `llm_conf.freeze` in `finetune.sh`.
+
+Set the `freeze` parameter of the modules to be fine-tuned to false(by default, only the LLM is fine-tuned).
+
 ```
 bash finetune.sh
 ```

docs/fintune_zh.md

@@ -53,6 +53,10 @@ python tools/scp2jsonl.py \
 
 ## 启动训练
 
+修改 `finetune.sh` 中的 `audio_encoder_conf.freeze`, `audio_adaptor_conf.freeze` 和 `llm_conf.freeze`。
+
+将需要微调的模块 `freeze` 设置成 `false`（默认只微调 llm）。
+
 ```
 bash finetune.sh
 ```

finetune.sh

@@ -68,4 +68,7 @@ ${train_tool} \
 ++train_conf.use_deepspeed=false \
 ++train_conf.deepspeed_config=${deepspeed_config} \
 ++optim_conf.lr=0.0002 \
+++audio_encoder_conf.freeze=true \
+++audio_adaptor_conf.freeze=true \
+++llm_conf.freeze=false \
 ++output_dir="${output_dir}" &> ${log_file}