Find, filter, favourite: How to select participants for AI tasks

George Denison



July 2023

Find, filter, favourite: How to select participants for AI tasks

George Denison



July 2023

If you’ve read our blog post on finding trustworthy participants for your AI training tasks, you’ll know how important it is to recruit people who’ll give you honest, detailed input.

And you’ll be aware that a platform like Prolific does all that hard work in sourcing them for you.

But with so many eager, engaged participants available, how do you whittle them down to make sure they’re the perfect fit for your specific study?

Here are some of our top tips.

4 top tips to find participants for AI tasks

1. Use our free filters

We offer over 300 free filters that allow you to be picky about who you choose.

When building your study, simply scroll to the ‘Prescreen participants’ section and add criteria participants must meet before even applying to take part in your research.

For example, you might only want to hear from people living in the UK, those within a set age range, or those with a certain level of education.

2. Need native English speakers? Use the First Language filter

A favourite filter of our current users is ‘First Language’.

Most of our users are training English-speaking AI models, and need participants who have English as their native tongue. The ‘First Language’ filter makes findings these participants nice and easy.

3. Target by approval rate

A good indicator of how well a participant will perform is how they’ve done in the past.

So, you may want to target by 99% approval rate, which means the person hasn’t been rejected by other researchers.

Combine this with the number of previous submissions, which shows how many test submissions they’ve completed without being rejected, and you’re likely working with a high-quality participant. (We recommend setting this at a minimum of 200.)

4. Run a small test

Once you’ve filtered your participants down to a level you’re comfortable with, we suggest running an initial study to see who provides you with the richest data.

You can then consider these people your core group, and feel confident they’ll give you the output your AI model needs to learn and grow.

Find participants even faster with the Prolific API

With the Prolific API, you can access extra features that further streamline your search. Prolific tends to release new features on the API first, so by using our API you’ll get early access to the latest benefits.

Save filter sets

Find yourself using the same filters again and again? With filter sets, you can create and save specific sets of participant filters, then apply them easily each time you set up a new task.

Get grouping

Participant groups empower you to automatically ‘save’ a core group of people you want to work with. So you can easily find and reach out to them whenever you want. This is ideal if you’ve already trained a few participants in how to complete your tasks.

More submissions, more data

If you’re happy to let the same participants respond to your tasks repeatedly, you can also use our ‘multiple submissions allowed’ feature.

Once you’ve entered a maximum figure, each participant can complete your study that number of times before it shuts off for them.

That means you can extract as much data as possible from your highest-performing people.

To learn more about how we can help you conduct your AI research, take a look at our dedicated AI page. And when you’re ready, get in touch with our helpful team of humans.

Leave your details below and someone will get back to you