Stay up to date with the latest features and improvements of the Mabyduck subjective testing platform.
0.8.3
It is now possible to use self-hosted datasets by providing a list of URLs, instead of uploading media files directly to us.
We also improved our API, and it is now possible to launch jobs where previously it was only possible to configure drafts via the API.
0.8.1
Our embedded experiments are now widely available. This type of experiment uses JavaScript to include arbitrary content in experiments, and is ideal for running interactive studies.
0.7.9
We released new types of experiments that allow the configuration of arbitrary surveys below images, audio, or video.
0.7.8
We improved our support for datasets with very large numbers of conditions. This is useful, for example, when you want to collect labels for training and need to label a large number of audio, images, or videos that are not AI-generated.
0.7.7
Selection strategies have received more configuration options. For example, it is now possible to evaluate only a subset of a dataset. It is also possible to always include one method in pairwise comparisons against other methods.
This release also makes it possible to scale (instead of cropping) images in pairwise image experiments.
0.7.5
We added the ability to add configurable plots to rubrics and leaderboards.
It is now also possible to create draft experiments and jobs via our API.
0.7.4
Today, we are opening up Mabyduck to everyone.
0.7.3
We made small tweaks to our design and changes to our backend to prepare for a public launch.
0.7.2
This release contained several improvements:
0.7.1
We added optional confidence regions to line graph visualizations of your results.
This release also adds support for references in ACR audio experiments.
0.7.0
This release comes with a variety of improvements.
0.6.3
We improved the handling of very large dataset uploads through the browser. If a dataset upload is interrupted for any reason, it is now possible to resume uploads.
This version also adds a new Markdown input field for writing introductions.
0.6.2
We introduced the ability for raters to leave feedback on individual slates and alert us to any potential issues with an experiment.
This version also updated the leaderboards' design.
0.2.6
We internationalized our experiments. In addition to English, we now support French and German.
Additionally, different experiments can now use different config files. This allows you to upload a single dataset with multiple config files for different experiments.
0.2.5
Pairwise image experiments now support references. We also introduced new configuration options for the MUSHRA experiment.
0.2.2
We introduced a new pairwise image experiment. We also added a way to preview images in datasets.
0.2.0
We have implemented our own pre-screening protocols. This allows us to provide you with a higher quality of raters whose ability and hardware enable them to detect fine differences between stimuli.
0.1.6
It is now possible to launch experiments to crowd-sourced raters through our platform.
0.1.5
We added configuration options to change how waveforms are rendered in MUSHRA experiments. In particular, it is now possible to only render the waveform of the reference so that raters can not draw conclusions based on the waveform.
0.1.4
Release 0.1.4 is packed with new features:
0.1.3
We addressed some minor bugs in the MUSHRA experiment.
0.1.2
Datasets now support config files. These can be used to change the interface for each slate. For example, to display text prompts next to stimuli.
0.1.0
Today, we are excited to release a private beta version of Mabyduck to our design partners.