Proof of Concept (PoC)

Summary

Scope:

• Closed issues only
• Predefined list of GitHub user handles
• One repository https://github.com/hackforla/website
• All summaries and labels are applied retroactively

Goals:

• Understand AI token usage and cost
• Validate prompt quality and labeling logic
• Identify pain points in automated summarization and labeling

Validation:

• Compare to the results we got by doing it manually on the dashboard and the Summary of Activity Document [PROVIDE LINKS TO BOTH]

List of GitHub handles for the sample/test runs

• JackRichman
• JasonUranta
• mgodoy2023
• Zak234
• anonymousanemone

Lables

• Spreadsheet Draft Labels List
• json version

Scripts

• https://github.com/hackforla/ai-skills-assessor/issues/14
• The script is here repo_fetcher.py
• The config file to choose repos is target_org.json
• Script: Fetch-GitHub-issue-comments-for-specified-GitHub-Handles