Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Adding exp feedback #359

Merged
merged 30 commits into from
Jan 3, 2025
Merged

Adding exp feedback #359

merged 30 commits into from
Jan 3, 2025

Conversation

jessestorbeck
Copy link
Contributor

These changes are primarily updates to enable post-experiment feedback to participants. There are now two options users can specify for the resultsType parameter the in the experiment's config.yaml: 'percentileRank' and 'modelPrediction'. Percentile rank feedback displays the participant's percentile rank in the experiment based on the summary statistic specified in the experiment.js file. Model prediction feedback is currently a stub, but can be easily extended to utilize any Python model to make predictions based on the participant's data. See the related changesets and documentation updates for details.

Also included in this PR are:

  • new experiment template synchronization tests that help to assure that appropriate updates are made to all experiment templates
  • bug fixes for pushkin-cli
  • dependency bumps
  • general repo maintenance including babel/jest config updates and dependency specification for templates

Copy link

changeset-bot bot commented Jan 3, 2025

🦋 Changeset detected

Latest commit: 44d9667

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 9 packages
Name Type
pushkin-cli Patch
pushkin-client Minor
pushkin-worker Minor
pushkin-api Minor
@pushkin-templates/exp-grammaticality-judgment Minor
@pushkin-templates/exp-self-paced-reading Minor
@pushkin-templates/exp-lexical-decision Minor
@pushkin-templates/exp-basic Minor
@pushkin-templates/site-basic Minor

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

@jessestorbeck jessestorbeck merged commit fe58834 into main Jan 3, 2025
4 of 5 checks passed
@github-actions github-actions bot mentioned this pull request Jan 3, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants