Sign up

First up, create an account with us here.

Create an experiment

After logging in, you should see your user profile. This is where you'll see a list of the experiments you've designed. Click Create a new experiment, and give your experiment a name that sets it apart from your and other people's projects. You should also give it a short description as an introduction for your participants later, or for other researchers if you decide to make your experiment public.

Add some stimuli

You should now see the design page for your experiment. It has several tabs for experiment-wide configuration. Two of them are for adding stimulus material; Media for image, audio and video files, and Text for character strings. Click on the Media tab, and use the interface to add a handful of pictures. After all images have finished uploading, remember to click Save at the bottom of the page to confirm your selection. If you'd like to use more than a hundred stimuli, or a pre-existing stimulus set, get in touch with us, and we can make this process easier for you.

Create a task

Click on the Tasks tab, where you can arrange the components of your experiment, by adding various paradigms, forms and pages for your participants to go through one at a time. Add the first task by clicking Add a new task. Give it a name that distinguishes it from the other tasks in this experiment; it could be as simple as task1. Then pick the task design from the list. Every task has a question mark icon , click this to see the documentation page for that task type.
Try for example the Dragrate task. After you click Submit, you'll be looking at the design parameters for this task.

Preview: for your eyes only

This is a good moment to inspect your current design. On the right side of the page you should see a button Preview Task. Click this and you'll see your Dragrate task, just as your participant would see it. In the Dragrate task you rate each stimulus on two dimensions at the same time, by dragging each one to a location in the white rectangular arena on the left. The images you selected earlier are on the right. After you've dragged each stimulus into the arena, a button in the bottom toolbar lights up, to Finish the task.
This takes you to a screen where you can navigate to the task results, but for now head back to the design by clicking on the name of your experiment.

Add some instructions

In order to add the necessary instructions, add a new task, and choose the General Information task type. Here you can enter instructions for the participant, potentially accompanied by a schematic or example screenshot. After entering the text and saving the parameters, head back to the experiment overview by clicking on the Tasks tab. You'd want the participant to see the instructions first, so click on an empty arena of the new task's panel, and drag it up until it's at the top of the list, and release it. You've now changed the order of the tasks. Note that there is a similar task called Consent Form where the participant is required to check boxes to confirm their acceptance of your ethics terms.

Store a version

With an eye on running your experiment on actual participants, when you don't want the design to change in the middle of it, you can lock the current design of your experiment into a Version. Once created, that version cannot be changed anymore. This means that even after several participants have completed your experiment, you can make changes, while still having access to the specific parameters of the version that those earlier participants saw.
Head to the Versions tab of your experiment. One version is currently listed, the special design version. It's the one you are currently browsing and the only one that can be changed. Note that the current version that you're inspecting is also specified in a panel next to the experiment's Preview button in the top-right.
Click Save the current version to create a new, static version based on the current design. It will automatically be named with a number, so the first one is called Version 1

Open up slots for participants

To limit the number of participants taking part in your experiment, you create slots for them. By default, an experiment does not have any open slots. Slots are created in Batches. We will now create a batch of slots, to enable some participants to take part in our new experiment. For this, we have to head to the Participants tab of the experiment version. The design version does not have this tab, so either make sure you are already browsing one of the saved versions, or go to the Versions tab and click the Recruit.. link on one of the versions. On the participants tab, you'll see a form to create a new batch of participant slots. You have to decide how this batch of participants will access your task:

Ad-hoc

Participants don't create a login with password. This makes them more anonymous, but also means they won't be able to come back after they log out.

Meadows

Participants have to create a Meadows account with a password, so they can log back in after taking a break.

Invite your participants

If you have created some open slots in the previous step, you should now see a button in the top-right corner to Take Part. This leads to the welcome screen for participants. Either right click this button, and select Copy link address.. or click the button, and copy the URL from your browser window. You can then send this URL to your participants. You can either send it to them through e-mail, or if you are using Amazon Mechanical Turk, or Prolific for recruitment, you can paste it into their respective forms.
I promise we are working hard to make this part more user friendly.

Keep track of participant progress and download results

At the bottom of the Participants tab you'll eventually also see a link to a page with a list of all participants. Each participant has a nickname of the form adjective-animal, for example purple-elephant. Click on the participant name to browse the results for this individual. You'll see a list of the tasks they participated in. Try clicking on a task, it will mention when the participant finished this task, and may include a visualization of their data. To download the results, click the download icon which will take you to a new page with several download options. You'll also find this icon on other levels, such as on the overview for all the participant's tasks, or the list of all participants. Read more on the downloads documentation page.

• Facebook
• Twitter
• Email