Skip to content

Latest commit

 

History

History

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
 
 
 
 
 
 
 
 

README.md

ResearchStudio - Idea

From a research problem to a reviewer-defensible idea card — Automating the First Mile of Research Ideation.

ResearchStudio - Idea streamlines the first steps of a research project — the thinking that has to happen before any writing. Drop in a research problem and IdeaSpark runs the full pipeline end-to-end — read the field → find the bottleneck → choose the ideation pattern → draft the idea → check prior art → audit & revise → render the card — and hands back one reviewer-defensible, implementable idea card. Every step is grounded in a 1,947-paper ICLR / ICML / NeurIPS corpus (2021–2025) and its induced taxonomy of 15 ideation patterns and 31 sub-patterns — and faithful by construction: every load-bearing claim either traces to a retrieved record or is flagged as model-supplied.

IdeaSpark idea generation — one research problem turned into one idea card end to end IdeaSpark data construction — 1,947 ICLR/ICML/NeurIPS papers flow through signature extraction and pattern discovery into operational pattern cards
Idea generation — one research problem → one idea card. Data construction — 1,947 ICLR / ICML / NeurIPS papers → operational pattern cards.

The skills

Three skills compose into one research-ideation loop — search → generate → review — with IdeaSpark the end-to-end flagship and the other two usable standalone:

Skill Input Output Built for
Idea-Spark A research problem / direction (optional constraints, seed papers, compute) one reviewer-defensible, implementable idea card — Title · Motivation · Method, as Markdown + PDF the full research-problem → idea-card pipeline, calibrated against Oral-accepted papers
Paper-Search A query + year range (optional venues) a deduped paper list across arXiv / DBLP / OpenAlex / OpenReview / Semantic Scholar / Crossref the literature-grounding building block, usable on its own
Scoop-Check A problem statement + a claimed novelty a prior-art collision verdict: an overlap level + the closest prior works, per axis a standalone "has this been done?" prior-art check on one novelty claim

Usage

Ask your agent in natural language — it picks up the matching skill and runs it end-to-end. Examples use Claude Code; other backends are in docs/USAGE.md.

💡 IdeaSpark

> /idea-spark I want a novel ML research idea about physical realism in text-to-video models.

One research direction → one reviewer-defensible idea card (Title · Motivation · Method), returned inline with PDF + LaTeX side artifacts.

Example output — three ideas IdeaSpark generated for ICLR-2026-Oral problem seeds, rendered as lean cards (Title · Motivation · Method). Click a card for the full PDF.

Latent Conserved Charges for Text-to-Video Water-Filling RoPE Knowing-Falsehood Diagnosis
Make the Generator Its Own Physicist — give a text-to-video model an internal conserved charge updated symplectically, so physics holds by construction with no external simulator or trained scorer.
PDF
Water-Filling RoPE — allocate rotary position-encoding frequencies by a rate–distortion (water-filling) rule instead of the fixed geometric schedule.
PDF
Knowing-Falsehood Diagnosis — a counterfactual knowledge-contradiction test giving per-prompt evidence that an LLM had the right answer but stated a falsehood on a benign prompt.
PDF

🔍 Paper-Search

> /paper-search KV cache compression for long-context LLMs, 2024–2026

Returns a deduped paper list across arXiv / DBLP / OpenAlex / OpenReview / Semantic Scholar / Crossref.

🛡️ Scoop-Check

> /scoop-check Problem: efficient LLM inference. Novelty: a calibrated per-token
  early-exit stop rule read from the model's own layer-wise prediction trajectory.

Returns a per-axis overlap verdict against the closest published work. Input: a research problem + the claimed novelty — or just paste an idea card (it reads them from Motivation + Method).


Evaluation

On 100 ICLR-2026-Oral problem seeds, each IdeaSpark idea card is scored on quality (the idea-quality skill) and novelty (scoop-check) against three baselines — Opus-4.8 (bare), Opus-4.8 (self-gen), and GPT-5.5 (bare). IdeaSpark lands top — the highest idea-quality while staying solidly novel — and scores highest in every research domain.

Quality vs novelty — IdeaSpark scores highest on idea-quality while remaining novel, above Opus-4.8 (bare), Opus-self-gen, and GPT-5.5 (bare) Idea-quality by research domain — IdeaSpark (blue) is outermost on every one of the 21 ICLR primary-area domains, above Opus-self-gen, Opus-4.8 (bare), and GPT-5.5 (bare)

Left: quality × novelty positioning.   Right: idea-quality across research domains.

Full protocol, IdeaSpark vs the baselines, and the scoring skill are in evaluation/README.md.


Acknowledgements

License

MIT

Citation

If ResearchStudio - Idea / IdeaSpark helps your research workflow, please cite:

@article{zhao2026researchstudioidea,
  title   = {ResearchStudio-Idea: An Evidence-Grounded Research-Ideation Skill Suite from ML Conference Outcomes},
  author  = {Qihao Zhao and Yangyu Huang and Yalun Dai and Lingao Xiao and Jianjun Gao and Xin Zhang and Wenshan Wu and Scarlett Li and Yang He and Yan Lu and Yap Kim Hui},
  journal = {arXiv preprint arXiv:2607.04439},
  year    = {2026},
  url     = {https://arxiv.org/abs/2607.04439}
}