All notable changes to this project will be documented in this file.
- Experiments improvements
- Can now create new prompmts in experiments that have auto inputs
- fixed scrolling on preview window for prompts
- Added ability to scroll when creating a new prompt
- Moved to old markdown editor but uses Monaco editor for large requests
- Removed all cyclical dependencies to improve build times on web
- Playgrounds can be opened in new tabs
- Large requests render a lot faster (Moved to Monaco editor)
- adding 0 in time no longer crashes
- Time filters now allow you to select a date manually (previously it was only the range selector)
- Fixing small experiment bug
- Experiment scores
- Small housekeeping updates on Helm chart
- Add the ability to change and update keys within the UI
- Add the ability to change and update keys within the UI
- Major UI updates
- New experiments page with table view
- Session page improvements
- Fixes issue with Dashboard showing threats
- Webhooks enabled
- Evaluators can now be created and edited
- See changelog: https://www.helicone.ai/changelog
- Fixed experiment page not showing any experiments
- Allows users to specify a requestId in the url params for a session
- improvements to screen flashing on sessions page
- New sidebar
- Asset IDs (images) not getting rendered properly in the frontend
- New tables should be a lot more performant for aggregate metrics
- Sessions now have metrics associated with them
- New Prompts view and ability to edit prompts in the UI
- o1 support in playground
- Bugs and improvements around the playground
- Slack Alerts and Notifications
- Sessions metrics fixes
- Sessions can now be clicked in span view
- Sessions Tree view also shows Span view
- Optimistically reloading requests on requests table, improve initial render speeds
- New playground beta with better tool support
- Fixed a bug where the session page would not load
- Helicone Prompts with Auto Inputs Index
- We can now support chat like interactions with promps
- We can support multiple images in prompts
- Force Content Header to be nothing
- Session UI Updates
- Added a new proxy endpoint to JAWN
- Formatting for prompt input variables is now in markdown.
- Easier configuration of columns, which are now saved in your local storage for persistence across refreshes.
- Added a dedicated sort button to allow sorting in different views.
- Deleting a prompt now allows reuse of the same prompt variable name (note: the metrics over time graph will still contain old data, which is a known bug we are addressing).
- Resolved the issue with the prompt version header not working in certain environments. This was due to the payload size being sent to Jawn, which has now been fixed and tested with your prompts.
- Adds the ability to hardcode the Helicone prompt version to reduce new versions being created when an unknown number of images are passed.
- Fixed web project build
- Fixed web project build
- Scores can now accept booleans
- Requests that are not scored can be fetched
- Admin panel to configure and test Azure deployments
- deduplicate clickhouse request_response_versioned to fix price calc
- Write to clickhouse for dashboard
- Scores support in frontend
- Writing directly to jawn. Should allow us to support higher throughput.
- Prompt usage metrics
- Major bug fixes around property searches in request page
- property filters in dashboard
- Auto select model based on previous model
- Datasets are associated to a prompt now, so dataset list is filtered
- gpt-4o support
- deleting prompts
- prompt-mode header for testing
- Added OpenAI for experiments
- Added the ability to run experiments with images as inputs
- Update Jawn HELICONE_WORKER_URL to reference OAI service name instead of publicUrl
- Remove experiment ID when running an experiment
- Images as inputs now work in the prompts and inputs view
- Responses are now shown in the prompts and inputs view
- Image template support when creating new experiment
- React Diff Viewer is hidden preventing browser from crashing
- Auto complete Model on experiment curation
- Fix ClickHouse migration error
- Add experiment debug logs
- Add oai publicUrl to values.yaml
- Image support for both playground + prompts
- Image support for inputs * (there is a small issue we are working on now)
- Database migration (cleaner inputs)
- We basically hacked it in with custom properties to get it out to you orginally and get feedback, but now actually designed it and built it the correct way
- Scores
- Markdown support input fields
- Feedback in the UI is now working and calling Jawn instead of worker
- Playground now supports images
- Images that are sent to Helicone will be stored in a bucket. (This is a huge improvement!)
- Images are now supported in experiments as inputs
- Experiments with OpenAI and Azure OpenAI Support
- API calls in worker
- Updates to web app (dashboard updates, filter persistence, etc)
- Fix worker health checks failing
- Reduce chart size by deleting old tgz versions
- Updated helicone docker image versions
- Added selectorLabels
- Fixed spacing around selector labels
- Launch initial helm version