← Back to the Main Changelog
June 4, 2025
Enabled LLM customization for BYOK premium tiers, also enabled access for users who subscribed to the highest tier to access lower tier perks including LLM customization. Minor bugs also resolved.
Here is how modifying your LLM settings work:
- Added an option to modify the Groq or OpenAI LLM settings in the dashboard.
- Tailor-Made Prompt Templates: Craft the perfect translation instruction! You can now define your own prompt templates for both Groq and OpenAI BYOK engines.
- Use placeholders like {text}, {target_language}, and {source_language} to guide the AI.
- Note for Auto-Translations: To ensure our bot can correctly parse translations for features like Auto-Translate Channels and Conversation Bridging, a small suffix (LANGUAGE_CODE | TRANSLATED_MESSAGE) will be automatically appended to your custom prompts when used in these automated contexts. This is clearly indicated on the settings page.
- While you enjoy the hassle-free, bot-managed Groq engine by default if you subscribe to the highest tier, you can now also choose to use your own API keys for Groq or OpenAI if you prefer.
- Simply select the desired BYOK engine in your User or Server settings and provide your key. The LLM customization options will then become available for that engine.
- The server and user page now displays information intelligently in order to show or hide LLM options.
- Added guidance for customization of your LLM choice.
- Clearer Premium Page.
- Significant updates to our backend translation service to seamlessly integrate user and guild-defined LLM parameters.
- Updated API routes and database schema to support these new customization features.
- The "Premium" page on our website has been updated to clarify this and make switching between plan types (if desired via Stripe) more intuitive.
- Resolved some typescript errors in the /translate command and context menu of "Translate" commands related to engine configuration.
← Back to the Main Changelog