Skip to content

Commit 0c92360

Browse files
author
ubuntu
committed
default accelerate config
1 parent 20b9308 commit 0c92360

File tree

2 files changed

+54
-0
lines changed

2 files changed

+54
-0
lines changed
Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
command_file: null
2+
commands: null
3+
compute_environment: LOCAL_MACHINE
4+
deepspeed_config:
5+
gradient_accumulation_steps: 1
6+
offload_optimizer_device: cpu
7+
offload_param_device: cpu
8+
zero3_init_flag: false
9+
zero_stage: 2
10+
distributed_type: DEEPSPEED
11+
downcast_bf16: 'no'
12+
dynamo_backend: INDUCTOR
13+
fsdp_config: {}
14+
gpu_ids: null
15+
machine_rank: 0
16+
main_process_ip: null
17+
main_process_port: null
18+
main_training_function: main
19+
megatron_lm_config: {}
20+
mixed_precision: fp16
21+
num_machines: 1
22+
num_processes: 1
23+
rdzv_backend: static
24+
same_network: true
25+
tpu_name: null
26+
tpu_zone: null
27+
use_cpu: false
Lines changed: 27 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,27 @@
1+
command_file: null
2+
commands: null
3+
compute_environment: LOCAL_MACHINE
4+
deepspeed_config:
5+
gradient_accumulation_steps: 1
6+
offload_optimizer_device: cpu
7+
offload_param_device: cpu
8+
zero3_init_flag: false
9+
zero_stage: 2
10+
distributed_type: DEEPSPEED
11+
downcast_bf16: 'no'
12+
dynamo_backend: INDUCTOR
13+
fsdp_config: {}
14+
gpu_ids: null
15+
machine_rank: 0
16+
main_process_ip: null
17+
main_process_port: null
18+
main_training_function: main
19+
megatron_lm_config: {}
20+
mixed_precision: fp16
21+
num_machines: 1
22+
num_processes: 1
23+
rdzv_backend: static
24+
same_network: true
25+
tpu_name: null
26+
tpu_zone: null
27+
use_cpu: false

0 commit comments

Comments
 (0)