Running Experiments Online

From Joint Lab Wiki
Jump to navigation Jump to search

This page includes information about various resources that allow for the online deployment of research projects.

About Online Experimental Software: There are two types of online experimental platforms that can be useful for online phonetics research: 1)participant recruitment platforms, 2) online study designing/hosting platforms. There are a number of these that can be used in phonetic research. Providing a comprehensive guide of all possible software packages would be difficult, as your own research questions/methods will dictate what tools you will want to use. Here are some things that lab members have used in the past:

Participant Recruitment Platforms[edit | edit source]

Amazon Mechanical Turk (AMT)[edit | edit source]

Amazon Mechanical Turk (AMT) can be used to deploy studies and recruit participants. One nice feature of AMT is that it manages participant payment for you. More can be found here.

Costs[edit | edit source]

Variable; you will need to select a reasonable amount to pay your participants. Amazon will then have some additional costs (which can be impacted by the qualifications you want to use to restrict your recruitment pool). More information can be found at this link: Requester Pricing

Supported File Types (Stimuli)[edit | edit source]

This is also highly variable; you can host files else (like in a LimeSurvey) and link through MTurk. You can also link files through Amazon's cloud services.

Advantages[edit | edit source]

Easy to recruit many participants for an experiment in English very quickly. Easy to pay and recruit participants for modular/short tasks.

Limitations[edit | edit source]

Difficult to filter participants for many criteria including native language background without further screening procedures.

Example Use-Cases[edit | edit source]

Testing semantic properties for stimuli for an experiment.

Prolific[edit | edit source]

Prolific can be used to recruit and pay participants for studies. There is a large sample of participants of various L1's and L2 including English. There are additional costs per participant for use of this platform [1]

Costs[edit | edit source]

Supported Experiment Types[edit | edit source]

Experiments are presented through a link so that any type of experiment can be advertised here. Note, that experiments requiring downloading of software need to receive explicit permission to be used on the platform.

Advantages[edit | edit source]

Have a lot of control over participant criteria including native language, country of residence, reported hearing loss, etc. Can balance M/F participants built into the experiment.

Limitations[edit | edit source]

There is an added cost for running participants on a platform like this.

Example Use Cases[edit | edit source]

PsiTurk[edit | edit source]

PsiTurk is an interface that allows researchers to crowdsource participants. PsiTurk assists in participant recruitment, and works with AMT. More information can be found here.

Costs[edit | edit source]

Similar to what you would/should expect for using Amazon Mechanical Turk.

Supported File Types (Stimuli)[edit | edit source]

Advantages[edit | edit source]

Limitations[edit | edit source]

Example Use-Cases[edit | edit source]

Online Experiment Hosting/Creating Platforms[edit | edit source]

DMDX[edit | edit source]

DMDX is a Windows-based program for capturing response times in psychology/psycholinguistic experiments. More information can be found here.

Costs=[edit | edit source]

Free

Supported File Types (Stimuli)[edit | edit source]

Advantages=[edit | edit source]

Limitations[edit | edit source]

Example Use-Cases=[edit | edit source]

Experigen[edit | edit source]

Experigen is designed for doing online experimental phonology research projects. The code is hosted on GitHub, and you can find more information here.

Costs[edit | edit source]

Free

Supported File Types (Stimuli)[edit | edit source]

Advantages[edit | edit source]

Limitations[edit | edit source]

Example Use-Cases[edit | edit source]

LimeSurvey[edit | edit source]

Lime Survey can be used with your UW web hosting space to create and customize your own online quizzes/questionnaires. More information about Lime Survey can be found here. You can download the lab's guide to using Lime Survey on your UW web space here.

Costs[edit | edit source]

As a UW student: Free. Recruitment may be an issue; this can also be used in conjunction with Amazon Mechanical Turk.

Supported File Types (Stimuli)[edit | edit source]

Advantages[edit | edit source]

Limitations[edit | edit source]

Example Use-Cases[edit | edit source]

Pavlovia[edit | edit source]

Pavlovia is an online interface for deploying PsychoPy experiments. More information can be found here. You can find Marina Oganyan's presentation on Pavlovia here.

Costs[edit | edit source]

£0.20 per participant.

Supported File Types (Stimuli)[edit | edit source]

Advantages[edit | edit source]

Limitations[edit | edit source]

Example Use-Cases[edit | edit source]