Model management

Let users specify what model to use for their prompts

Overview:

There are any number of reasons why a user may want to switch the model they are using for generation

  • Newer models may be more prone to hallucinations and errors, since they have had less time to improve through feedback and QA
  • On the other hand, newer models are more likely to contain updated references, making them a good choice over older models for low-risk research
  • Commercially, they may not want to spend the money or tokens to use a newer model. Older models can be used to hone a prompt before it is applied to updated data
  • Image generators appreciate the different aesthetics they can tap into with different models, much like someone may choose to listen to a specific album on vinyl for its aesthetic vibe despite the higher audio quality of digital recordings
  • Some image generators enjoy remixing across models, capturing the aesthetics of one model, and then remixing it in a different model that might return more predictable results against their prompt
  • For security reasons, users may avoid using certain models with delicate or proprietary data due to how the model provider handles this type of information
  • Researchers, engineers, etc may want to move between models to compare results

Whatever the reason, we should assume that this emergent pattern will start to stabilize soon.

If you are working on an interface that allows for this setting to be changed, consider who should have that permission to change it. Companies may wish to restrict or enforce the use of certain models for compliance reasons.

Consider also that regulations related to AI are in flux. Be prepared for entire models to be restricted from use in certain geopolitlcal areas do to their policies.

Benefits:

Anti-patterns:

Access does not absolve accountability
Just because something is available doesn't mean its producer loses responsibility for the outcome. Think about how many beta products exist that lead to poor customer experiences and missed expectations because those limitations were not clear. If you do provide the ability for people to switch models, make it obvious to the user which model they are using, and if possible the differences between the two so they can expect how it will impact their experience.

ChatGPT allows users to switch between models. Newer models require a higher tier
Julius lets users switch between model providers
Midjourney gives you the option to change the model in your prompt, even when remixing on an image created in a different model
No items found.

What examples have you seen?

Share links or reach out with your thoughts?

Thanks for reaching out!
There was an error submitting your form. Please check that all required fields are complete.