OKD-278 Added AI Triage #2270
Open
OKD-278 Added AI Triage #2270
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add AI issue triage workflow using GitHub's AI Assessment Comment Labeler - Add prompt files for bug report and enhancement triage - Workflow automatically triages issues labeled with 'triage/needs-triage' - AI assesses issue quality and applies appropriate labels - Adapted for OKD/Kubernetes context
- Slack notifications now include BOTH AI triage assessment AND issue summary - Triage results are passed from ai-triage job to notify-slack job - Rich formatted Slack message with blocks layout - Shows: issue details, triage assessment, and AI summary - Gracefully handles cases when triage doesn't run
- Add 'edited' trigger to re-run triage when issues are updated - Add 'reopened' trigger for reopened issues - Ensures AI re-evaluates issues when reporters add more details - Allows maintainers to re-triage by re-adding labels
Added AI triage
Removed label trigger
Workflow will run even if needs-triage label is not applied
Updated workflow to run when kind/bug label is applied
Automated adding triage/needs-triage label
Fixed label format
Added delay such that label is added reliably
Testing fix
Applied document suggested label trigger
Testing fix
Trying consolidated prompts
Testing prompt
Testing diff model
Fixed header
Fixed substr issue in notify-slack
Added mirroring workflow to copy existing issues on upstream repo to …
This reverts commit f3843ed.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
AI Issue Triage Workflow
This workflow uses AI to assess and triage GitHub issues for the OKD project, improving triage efficiency and issue quality.
Overview
The AI Issue Triage workflow evaluates issues with the
triage/needs-triagelabel using OpenAI GPT-4o-mini. It checks completeness and clarity for bugs and feature requests, posts assessments, and optionally sends Slack notifications.How It Works
triage/needs-triagelabel.github/ai-assessment-comment-labeleraction analyzes the issue using prompts tailored to issue type.kind/bug→ Bug triage promptkind/feature→ Enhancement triage promptSLACK_WEBHOOK_URLis configured.Components
Workflow File
.github/workflows/issue-triage.ymlai-triage: Performs AI assessment and posts commentsnotify-slack: Sends Slack notifications (conditional)Prompt Files
.github/prompts/bug-triage.prompt.yml: Evaluates bug reports for completeness (problem description, reproduction steps, environment info, logs)enhancement-triage.prompt.yml: Evaluates feature requests for use case, proposed solution, value, and scopeAssessment Criteria
Bug Reports are evaluated for:
Feature Requests are evaluated for:
Configuration
Required Setup
triage/needs-triagelabel existskind/bugandkind/featurelabels exist (for prompt mapping)Optional Setup
SLACK_WEBHOOK_URLin repository secrets to enable notificationsModel Configuration
openai/gpt-4o-mini./.github/promptskind/bug,bug-triage.prompt.yml|kind/feature,enhancement-triage.prompt.ymlWorkflow Permissions
The workflow requires:
issues: write- To post comments and manage labelsmodels: read- To access GitHub's AI modelscontents: read- To read repository files and promptsOutputs
This workflow is designed to assist maintainers with initial triage. All AI assessments should be reviewed by human maintainers before taking action on issues.
Linked JIRA Issue OKD-278