When I was collecting data for my last project, I printed off reams upon reams of paper for my questionnaires, information sheets etc. I did not particularly like it at the time but I could not see a different way of doing it. However, when it was completed and I had a pile of paper the size of a telephone book (see image), I realised it is just not feasible long term. For my current project I wanted to try and get rid of as much paper as possible. Fortunately, I found out I could use Bristol Online Survey through my institution. This is quite a powerful survey platform and all of the examples included here will directly apply to BOS, but you might not have access to it. However, you could easily utilise other survey tools such as Qualtrics or Survey Monkey (for a free option) that will provide you with similar capabilities.
Benefits
-
Firstly, that pile of paper is just one study and 35 people worth of data. Considering that pile of paper is probably the equivalent of a small tree, you can almost hear the forests screaming for mercy If you imagine the number of students and researchers across the universities that do a similar sort of thing.
-
Organising your data collection is much simpler and there is less room for mistakes. Going to start a session and realising you have not printed out your materials is both embarrassing and a huge inconvenience. Furthermore, there is no room for you to misplace pieces of paper. Losing one or two sheets can mean the data for a whole participant is useless. Considering the time and effort each project takes, reducing the risk of losing any of your data is a consideration worth making.
-
There is nothing more frustrating than spending half an hour inputting written survey responses to realise the participant has missed a question. Having your surveys online allows you to make the questions compulsory to answer and it will not let them progress or finish without filling in the missing data. On a related note, some people have terrible handwriting (myself included) and it may be difficulty to decipher their response. Allowing the responses to be typed ensures they will at least be legible.
-
Even when participants are not making your life difficult, manually inputting data takes a long period of time. You can become tired and start to make mistakes yourself which causes its own series of problems. BOS allows you to export all of your responses directly to a spreadsheet and what would normally take a couple of days, can take a matter of seconds. If you are on a tight schedule, this is definitely a bonus.
Important considerations
-
If you are running the survey yourself during a testing session, do you have internet access? It might seem a relatively silly thought but if all of your surveys are ready to go on your laptop and the room you have been allocated is analogous to a nuclear bunker, you are going to have some problems. Make sure you know where you are testing if you are running the surveys from your own laptop or it could turn into another headache.
-
Concerning the mandatory answer response, you need to think about the questions you are asking. There may be times when a question is not applicable to some participants so you need to think if all of your participants are able to provide an answer. Similarly, some of the questions may be sensitive. In terms of the ethical implications, you cannot force someone to answer certain question so it might not be appropriate to force a response depending on what you are asking.
-
Finally, if you want to make sure you are speeding up data entry as much as possible, think about the format of the answer. For example, likert scale questions (1-totally disagree to 5-totally agree) are common in psychology. If you format the question where the response is literally ‘1-totally agree’, when you export all your responses to a spreadsheet, it will read ‘1-totally agree’. If you are collating these together for statistical analyses, it is very difficult to calculate the mean of ‘totally agree’, so you have to go through all of your responses manually to read ‘1’. This example is from my own experience so you might laugh, but hopefully I have saved you some time if you have not thought about it.
Overall, moving to surveys online could be one of the best decisions you have made. Trees will rejoice and you can save yourself a huge amount of time when it comes to entering your data. However, if you are now thinking about making the change, do not rush into moving all of your surveys online. Think about whether internet access will be available and think about the sort of responses you are asking of people. Take the time to test your survey and see what responses it produces. If you are not happy with it, it is much easier to change after you have piloted it before you start rolling it out for participants to complete.