Plots on rubrics
0.7.5
We added the ability to add configurable plots to rubrics and leaderboards.
Changelog
Stay up to date with the latest features and improvements of the Mabyduck subjective testing platform.
November 2025
Nov 29, 2025
Nov 21, 2025
Public launch 🚀
0.7.4
Today, we are opening up Mabyduck to everyone.
Nov 14, 2025
Design improvements
0.7.3
We made small tweaks to our design and changes to our backend to prepare for a public launch.
Nov 7, 2025
Improved session browser
0.7.2
This release contained several improvements:
- An updated session browser, which makes it easier to see demographic and other meta information at a glance.
- We added the option to filter leaderboards to include or exclude certain conditions.
- We now automatically fragment mp4 files uploaded to our platform. Our pairwise video experiments previously required you to upload already fragmented videos.
October 2025
Oct 31, 2025
Confidence regions in line graphs 📈
0.7.1
We added optional confidence regions to line graph visualizations of your results.
This release also adds support for references in ACR audio experiments.
Oct 24, 2025
Additional languages 🇵🇱
0.7.0
This release comes with a variety of improvements.
- We refactored the way our rater pools work, paving the way for us to offer you highly customized rater pools.
- We updated the UI of the pairwise video experiment to match the recently updated UI of pairwise image experiments.
- We added support for 4 more languages, namely Spanish, Polish, Chinese, and Vietnamese.
Oct 17, 2025
Improved upload for large datasets
0.6.3
We improved the handling of very large dataset uploads through the browser. If a dataset upload is interrupted for any reason, it is now possible to resume uploads.
This version also adds a new Markdown input field for writing introductions.
Oct 10, 2025
Rater feedback function 💬
0.6.2
We introduced the ability for raters to leave feedback on individual slates and alert us to any potential issues with an experiment.
This version also updated the leaderboards' design.
April 2025
Apr 5, 2025
Internationalization 🇫🇷
0.2.6
We internationalized our experiments. In addition to English, we now support French and German.
Additionally, different experiments can now use different config files. This allows you to upload a single dataset with multiple config files for different experiments.
March 2025
Mar 17, 2025
Added configuration options
0.2.5
Pairwise image experiments now support references. We also introduced new configuration options for the MUSHRA experiment.
Mar 7, 2025
Pairwise image experiments
0.2.2
We introduced a new pairwise image experiment. We also added a way to preview images in datasets.
February 2025
Feb 23, 2025
Pre-screening
0.2.0
We have implemented our own pre-screening protocols. This allows us to provide you with a higher quality of raters whose ability and hardware enable them to detect fine differences between stimuli.
Feb 13, 2025
Crowd-sourced raters
0.1.6
It is now possible to launch experiments to crowd-sourced raters through our platform.
Feb 5, 2025
MUSHRA
0.1.5
We added configuration options to change how waveforms are rendered in MUSHRA experiments. In particular, it is now possible to only render the waveform of the reference so that raters can not draw conclusions based on the waveform.
January 2025
Jan 29, 2025
Audio experiments and API
0.1.4
Release 0.1.4 is packed with new features:
- A new API for fetching results programmatically.
- A new absolute category rating (ACR) experiment for audio stimuli.
- Added configuration options for pairwise audio experiments, such as the option to vote "Tie" or checking if audio has been played for a given duration.
Jan 27, 2025
MUSHRA 🪲
0.1.3
We addressed some minor bugs in the MUSHRA experiment.
Jan 16, 2025
Added support for config files
0.1.2
Datasets now support config files. These can be used to change the interface for each slate. For example, to display text prompts next to stimuli.
Jan 6, 2025
Private beta 🐣
0.1.0
Today, we are excited to release a private beta version of Mabyduck to our design partners.