Skip to content

Display AI model type requirements for each experiment #335

@raftaar1191

Description

@raftaar1191

What problem does this address?

Users enabling experiments don't know which AI model capabilities are required to use each feature effectively. Currently, experiment titles and descriptions don't clarify:

  • Whether an experiment requires a text model (e.g., content generation, summaries)
  • Whether an experiment requires an image model (e.g., alt text generation, image analysis)

This causes confusion when users enable experiments expecting them to work, only to find the AI provider they've configured doesn't support the required model type. It also prevents users from making informed decisions about which experiments to enable based on their AI provider's capabilities.

What is your proposed solution?

Display the required AI model type(s) for each experiment in the UI. Add a visual indicator (badge, label, or icon) next to each experiment title that shows which model type(s) it requires:

Example format:

☐ Excerpt Generation [Text Model]
  Generates excerpt suggestions from content

☐ Alt Text Generation [Image Model]
  Generates descriptive alt text for images using AI vision models.

☐ Image Generation [Image Model]
  Generate featured images and inline images using AI

☐ Review Notes [Text Model]
  Reviews post content block-by-block and adds Notes with suggestions for Accessibility, Readability, Grammar, and SEO.

☐ Content Summarization [Text Model]
  Summarizes long-form content into digestible overviews

☐ Title Generation [Text Model]
  Generates title suggestions from content

Implementation details:

  • Add a models_required property to each experiment definition
  • Display model type badges next to experiment titles (similar to WordPress plugin tags/labels)
  • Use semantic colors:
    • Text Model: one color
    • Image Model: different color
  • Include documentation so users understand what model types their AI provider must support

This helps users:

  • Choose experiments that match their AI provider's capabilities
  • Avoid enabling features that won't work with their current setup
  • Understand why certain experiments may fail or produce lower quality results
Image

Metadata

Metadata

Assignees

No one assigned

    Labels

    No fields configured for Enhancement.

    Projects

    Status

    In discussion / Needs decision

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions