TESTING
The Future of Publishing MediaLAB Amsterdam Create-IT Applied Research University of Amsterdam Version 1 Test plan phase 2 Tuesday 22 nd May Project manager Margreet Riphagen Team Elin Wassenaar Arelina Merakou Lars Böhm thefutureofpublishing@gmail.com medialab.hva.nl/futureofpublishing 2
Table of Contents 1.0 Test targets... 4 2.0 Assignments/Scenarios... 4 3.0 Test location... 4 4.0 Time... 4 5.0 Required resources... 5 6.0 Distribution of tasks... 5 7.0 User testing: phase 1... 6 Front-End...6 Back-end...6 Questions after user testing...8 3
1.0 Test targets Find out if the visual navigational elements make sense to the user. Find out if the intuitive navigational elements are indeed intuitive to the user. Find out if the content lay-out is user friendly. Find out if back-end is user friendly. Find out what users expect from the search functionality. Find out what users expect from the back functionality. Remove bugs. 2.0 Assignments/Scenarios Finding and opening an article through the table of contents. Exploring extra information about articles. Returning to the table of contents and opening another article. 3.0 Test location Testing will take place in the usability lab on the fifth floor of the Benno Premselahuis. 4.0 Time The first tests will take place on Thursday the 24 th of May. On Thursday we will be testing on: Gijs Gootjes Serena Westra Frank Kloos Raoul Boers The second day of testing will take place on Friday the 25 th of May. On Tuesday we will be testing on: Marcha-Lie Moal 4
Joram Binsbergen 5.0 Required resources The following resources are required for testing: ipad Audio/video recording equipment. Tripod for recording. Test guide (instructing the test person and controlling the paper prototype.) Test observer (takes notes and operates recording equipment.) Pen and paper. Coffee/tea for test persons. Access to computer in usability lab. 6.0 Distribution of tasks Team member Lars Elin Arelina Task Explanation, guidance and operation of the paper prototype Observation, operation of the recording equipment Explanation, guidance and operation of the paper prototype 5
7.0 User testing: phase 1 Front-End 1. Get from cover to the first article. 2. Browse through/read the article. 3. If something was unclear or confusing what would you do? 4. Go back to the article. 5. Distinguish the different parts of the article (ex. title). 6. Find a video article page 7. Watch video 8. Turn in landscape 9. Proceed to the table of contents menu. 10. Find another article to read. 11. Turn to portrait again. 12. Find extra information about the author. 13. Enlarge an image. 14. Go back to article. 15. Find extra information about a topic in the article. Back-end 1. Edit your profile by adding your personal information (found in the assigned folder) 2. Compose article: Add title, subtitle and text found in the assigned folder. 3. Insert image from folder and/or URL a. Align to the right b. Add title, alternate text and caption c. Then edit image and align to the centre. Create an aside: 4. Add aside content from assigned folder by using the following instructions: 6
a. In the first line type the following with the aside s title in the brackets: [aside title="title"] b. Press enter and type the content c. Press enter and enter the following: [/aside] Below you can see an example: [aside title="rabo is de grootste"] De verhoudingen op de Nederlandse spaarmarkt liggen al jaren redelijk vast. Ondanks de opkomst, en soms ondergang, van nieuwkomers blijven de traditionele grootbanken de belangrijkste spelers op de spaarmarkt. Rabobank was en is veruit de grootste partij. De Utrechtse coöperatieve bank had eind 2009 een marktaandeel van 40 procent. Bank en verzekeraar ING (inclusief de Postbank, die vorig jaar als merk werd opgeheven) en de nieuwe bankencombinatie van de genationaliseerde ABN Amro en Fortis volgen op gepaste afstand met ieder 23 procent. Bankverzekeraar SNS Reaal sluit de rij van de meer traditionele banken met een marktaandeel van 8,7 procent. Na de vier grote partijen, die samen dus 94,7 procent van de markt in handen hebben, volgt een lange stoet aan kleine en heel kleine banken. Zo had de ASN Bank (eigendom van SNS Reaal) eind 2009 een marktaandeel van 2,2 procent, NIBC had rond 1 procent en de Friesland Bank tussen de 1 procent en 2 procent. De duurzame Triodos Bank had eind vorig jaar 0,4 procent en ook de Credit Europe Bank had minder dan 1 procent van de totale Nederlandse spaarmarkt in handen. [/aside] d. In order to save the changes you have made you need to press update. 5. Create a video article a. When creating a new article video page, select the video format b. Add title, subtitle and text found in the assigned folder. c. Add video URL in the first line in the text field d. In order to save the changes you have made you need to press update. 7
Questions after user testing 1. Were the symbols in the toolbar clear? 2. Did you understand what the -/+ buttons where there for? 3. What did you expect from the back button? (to go back to previous article you saw or to go back one step in the history) Do you think it is useful? 4. What do you expect from the search feature? What reason do you imagine using it for? 5. Was it useful to see the article number? 6. Did you already have experience with Wordpress? Did you find the content management system easy to use? Where the instructions clear enough? 7. What are you preferences between the different options of fonts and spacing you saw in the screenshots? 8
8. What do you like about this application? 9. What do you dislike about this application? 10. What was your general idea about the look and feel of the app? 11. Do you have any suggestions? 9