Skip to main content

Features

Explore some of the other features that our self-serve platform has to offer.

Rubrics & leaderboards

Create private leaderboards to track the performance of your internal models over time and to encourage healthy competition within your team.

When you're ready, share public rubrics with the world to demonstrate the performance of your models on metrics that truly matter.

Leaderboard showing Elo scores

Active selection strategies

Our active selection strategies automatically decide which methods to evaluate next. On the CLIC2024 image compression dataset, for example, we found that this saves 34% in rater time compared to uniform sampling while achieving the same signal.

These savings are in addition to savings achieved by using qualified raters. On the same dataset, we found that pre-screened raters performed the task 32% faster than raters who only passed basic filters as commonly available on crowd-sourcing platforms.

Bar plots illustrating efficiency gains due to active selection

Session replay

See exactly what the participants of your experiments saw, with our session replay functionality.

Screenshot of session replay of pairwise image session

Real-time analytics

Well-designed studies with human observers remain the gold standard for evaluating the quality of audio-visual content, but are difficult to get right. Mabyduck allows you to start collecting results within minutes of uploading your data, with well-tested experiments designed for online participation.

Our real-time analytics help you to quickly make sense of your results. You can compare results between different rater pools, such as crowd-sourced participants and expert raters, and choose the most cost-effective rater pool for your data.

Bar plots visualizing Elo scores

Data security

We understand the confidential nature of your data. That's why we support:

  • 🔑 Two-factor authentication (TOTP, FIDO2)
  • 🗑 Retention periods to ensure that datasets are automatically deleted once they are no longer needed.
  • 🔒 Signed URLs so that raters can only access the data they need.
YubiKey vector graphic