Skip to content

Conversation

atapia27
Copy link

@atapia27 atapia27 commented Aug 25, 2025

Loom: https://www.loom.com/share/ff80c3ed9dc54461a88f56d6ff6fb0b0?sid=39e70276-be6c-43cc-a7f9-00b4ada18af4

GENERAL LAYOUT AND STYLE CHANGES
Grouped related and dependent settings to better convey purpose and functionality. Renamed a few for the same purpose.
Enhanced tooltips with more descriptive text (some also include links for confusing settings)
Removed text descriptions that appeared under fields since it was redundant given existing tooltips
Added disabled states for settings that shouldn't be editable until requirements are met

SPECIFIC CONCERNS ADRESSED BRIEFLY (Detailed explanation in ADD_MODELS_CHANGES.md)

What is 'public model'?

  • Renamed this section, added more thorough tooltip, and reorganized layout to properly guide user and help them understand better

How does load balancing work?

  • Added link within grouped "Model Mappings" description to redirect users that may be unaware of the concept

What is the difference between public model and litellm model?

  • Renamed table headers slightly, altered empty table to prompt users through setup, introduced properly styled placeholder text (with appropriate default behavior) to let users know intuitively that Public Model field is editable

What is ‘Team-BYOK model’?

  • Organized into descriptive group, Improved tooltip information, and linked to URL (placeholder) that provides a more ample description

Advanced Users
(Note: None of these solutions are functional, they are simply prototypes)

  • Solution A displayed in Advanced Options, under Add Models tab. However, this tab doesn't seem like the appropriate place to display this, which is why there are two options.
  • Solution B in All Models tab, simply added as an extra field

For extra context, I ran this locally using

cd ui/litellm-dashboard/ && npm run dev
litellm --model gpt-3.5-turbo --port 4000
Copy link

vercel bot commented Aug 25, 2025

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Preview Comments Updated (UTC)
litellm Ready Ready Preview Comment Aug 25, 2025 11:38pm

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

Copy link
Contributor

@ishaan-jaff ishaan-jaff left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please add a Loom and PR description

@krrishdholakia
Copy link
Contributor

hi @atapia27 can you add a loom of your change

@krrishdholakia
Copy link
Contributor

wildcard models is not adding all the models in the list, it's exposing a wildcard route - https://docs.litellm.ai/docs/wildcard_routing
Screenshot 2025-08-25 at 7 27 08 PM

@krrishdholakia
Copy link
Contributor

  1. when is the existing credential 'enabled'?
Screenshot 2025-08-25 at 7 28 50 PM

@krrishdholakia
Copy link
Contributor

  1. the separation of 'mode' vs. 'credentials' is unclear, shouldn't this be more distinct
Screenshot 2025-08-25 at 7 29 22 PM

@krrishdholakia
Copy link
Contributor

  1. When adding a model, what models would show up in the model weights table in advanced settings?
Screenshot 2025-08-25 at 7 30 37 PM

@krrishdholakia
Copy link
Contributor

krrishdholakia commented Aug 26, 2025

  1. Model weights are the weights for the deployments in the same model group
    model group = deployments with the same model_name:

these are all different model groups, so changing the weight in one, won't impact the rest

Screenshot 2025-08-25 at 7 31 53 PM

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants