Which local LLM can translate or rewrite text?

Hello, I would like to use the OpenAI API (GPT-3.5) with a local language model for translation. Could you rewrite the text below into the following languages: English, Deutsch, Español, Français, Italiano, Nederlands, Polski, Português, Русский, Svenska, Türkçe?

I have tried using https://libretranslate.com/ (I know it's not an LLN), but the quality is much worse than GPT-3.5. I attempted to use the Mixtral 8x7b model in the cloud, but it requires 100GB of GPU RAM. Is there another model available for translation and text rewriting that requires less hardware?

If you don't want to self-host a translation model, DeepL Translate: The world's most accurate translator supports all your required languages.

1 Like