This walks you through some of the basic steps for collecting data on Meadows. If you get stuck have a look at the rest of the documentation, but if you feel like something is missing please contact us, we're always happy to help and develop new features.
First up, create an account with us here.
Create an experiment
After logging in, you should see your user profile. This is where you'll see a list of the experiments you've designed. Click Create a new experiment, and give your experiment a name that sets it apart from your and other people's projects. You should also give it a short description as an introduction for your participants later, or for other researchers if you decide to make your experiment public.
Add some stimuli
You should now see the design page for your experiment. It has several tabs for experiment-wide configuration. Two of them are for adding stimulus material; Media for image, audio and video files, and Text for character strings. Click on the Media tab, and use the interface to add a handful of pictures. After all images have finished uploading, remember to click Save at the bottom of the page to confirm your selection. If you'd like to use more than a hundred stimuli, or a pre-existing stimulus set, get in touch with us, and we can make this process easier for you.
Create a task
Click on the Tasks tab, where you can arrange the components of your experiment,
by adding various paradigms, forms and pages for your participants to go through one at a time.
Add the first task by clicking Add a new task. Give it a name that distinguishes it from the
other tasks in this experiment; it could be as simple as task1. Then pick the task design from
the list. Every task has a question mark icon , click this to see the
documentation page for that task type.
Try for example the Dragrate task. After you click Submit, you'll be looking at the design parameters for this task.
Preview: for your eyes only
This is a good moment to inspect your current design. On the right side of the page you should see
a button Preview Task. Click this and you'll see your Dragrate task, just as your participant
would see it. In the Dragrate task you rate each stimulus on two dimensions at the same time,
by dragging each one to a location in the white rectangular arena on the left. The images you selected earlier
are on the right. After you've dragged each stimulus into the arena, a button in the bottom toolbar lights up,
to Finish the task.
This takes you to a screen where you can navigate to the task results, but for now head back to the design by clicking on the name of your experiment.
Add some instructions
In order to add the necessary instructions, add a new task, and choose the General Information task type. Here you can enter instructions for the participant, potentially accompanied by a schematic or example screenshot. After entering the text and saving the parameters, head back to the experiment overview by clicking on the Tasks tab. You'd want the participant to see the instructions first, so click on an empty arena of the new task's panel, and drag it up until it's at the top of the list, and release it. You've now changed the order of the tasks. Note that there is a similar task called Consent Form where the participant is required to check boxes to confirm their acceptance of your ethics terms.
Store a version
With an eye on running your experiment on actual participants, when you don't want the design to change
in the middle of it, you can lock the current design of your experiment into a Version. Once
created, that version cannot be changed anymore. This means that even after several participants
have completed your experiment, you can make changes, while still having access to the specific parameters
of the version that those earlier participants saw.
Head to the Versions tab of your experiment. One version is currently listed, the special design version. It's the one you are currently browsing and the only one that can be changed. Note that the current version that you're inspecting is also specified in a panel next to the experiment's Preview button in the top-right.
Click Save the current version to create a new, static version based on the current design. It will automatically be named with a number, so the first one is called Version 1
Open up slots for participants
To limit the number of participants taking part in your experiment, you create slots for them. By default, an experiment does not have any open slots. Slots are created in Batches. We will now create a batch of slots, to enable some participants to take part in our new experiment. For this, we have to head to the Participants tab of the experiment version. The design version does not have this tab, so either make sure you are already browsing one of the saved versions, or go to the Versions tab and click the Recruit.. link on one of the versions. On the participants tab, you'll see a form to create a new batch of participant slots. You have to decide how this batch of participants will access your task:
- Participants don't create a login with password. This makes them more anonymous, but also means they won't be able to come back after they log out.
- Participants have to create a Meadows account with a password, so they can log back in after taking a break.
Please contact us to arrange payment. If you give us a heads-up when you start, we can invoice you after your experiment has finished.
Invite your participants
If you have created some open slots in the previous step, you should now see a button in the top-right corner
to Take Part. This leads to the welcome screen for participants. Either right click this button,
and select Copy link address.. or click the button, and copy the URL from your browser window.
You can then send this URL to your participants. You can either send it to them through e-mail,
or if you are using Amazon Mechanical Turk, or Prolific for recruitment, you can paste it into their
I promise we are working hard to make this part more user friendly.
Keep track of participant progress and download results
At the bottom of the Participants tab you'll eventually also see a link to a page with a list of all participants. Each participant has a nickname of the form adjective-animal, for example purple-elephant. Click on the participant name to browse the results for this individual. You'll see a list of the tasks they participated in. Try clicking on a task, it will mention when the participant finished this task, and may include a visualization of their data. To download the results, click the download icon which will take you to a new page with several download options. You'll also find this icon on other levels, such as on the overview for all the participant's tasks, or the list of all participants. Read more on the downloads documentation page.