Skip to content

Commit 9b56037

Browse files
authored
Update gpu_memory_size in args.py
1 parent 4aaaf15 commit 9b56037

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

ktransformers/server/args.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -138,7 +138,7 @@ def parse_args(self):
138138
self.cfg.server_port = args.port
139139
self.cfg.user_force_think = args.force_think
140140

141-
args.gpu_memory_size = args.cache_lens * 8 * 128 * 48
141+
args.gpu_memory_size = args.cache_lens * 8 * 128 * 48 * 4
142142
# TODO: remove hard code
143143
self.cfg.gpu_memory_size = args.gpu_memory_size
144144

0 commit comments

Comments
 (0)