chatting with mistral generates answer with no spaces

[micrem73]

Bug description

steps to reproduce the issue:

1. litgpt chat checkpoints/mistralai/Mistral-7B-Instruct-v0.3 --max_new_tokens 2048
2. enter any prompt

I get answer with no space between words, i.e.: "Hello!I'mjustacomputerprogram,soIdon'thavefeelingslikeahumandoes.ButI'mheretohelpyouwithanyquestionsortasksyoumighthave!HowcanIassistyoutoday?"

Here is the full log:

⚡ ~ litgpt chat checkpoints/mistralai/Mistral-7B-Instruct-v0.3 --max_new_tokens 2048 
{'access_token': None,
 'checkpoint_dir': PosixPath('checkpoints/mistralai/Mistral-7B-Instruct-v0.3'),
 'compile': False,
 'max_new_tokens': 2048,
 'multiline': False,
 'precision': None,
 'quantize': None,
 'temperature': 0.8,
 'top_k': 50,
 'top_p': 1.0}
Now chatting with Mistral-7B-Instruct-v0.3.
To exit, press 'Enter' on an empty prompt.

Seed set to 1234
>> Prompt: hi, how are you?
>> Reply: Hello!I'mjustacomputerprogram,soIdon'thavefeelingslikeahumandoes.ButI'mheretohelpyouwithanyquestionsortasksyoumighthave!HowcanIassistyoutoday?
Time for inference: 3.55 sec total, 12.96 tokens/sec, 46 tokens

What operating system are you using?

Unknown

LitGPT Version

⚡ ~ pip show litgpt | grep Version                                                   
Version: 0.5.2

[rasbt]

Thanks for flagging this. I know Mistral is using their own tokenizer, but I could swear this worked before. Something to look into some time.

[Borda]

A simple guide on how to create such a studio can be found here.