Skip to end of metadata
Go to start of metadata

You are viewing an old version of this content. View the current version.

Compare with Current View Version History

« Previous Version 5 Next »

The following procedure outlines the steps for coding the search process and outcomes for each participant in this study.

Tools:

  • Airtable

  • Loop11

NOTE:

There are 10 tasks for each participant to perform overall. Participants were split into two groups: Group A conducted the first five tasks in the regular search interface (called Encore or Single Search) and the final five tasks in the split tab interface (called dual tab or Google Scholar). Group B reversed that process, completing the first five tasks in the split tab interface and the final five tasks in the single search interface.

Process:

  1. Open both Loop 11 and the Airtable base for this project (Optimizing Library Search Research Project 2022)

  2. In Airtable, open the following view:

    1. Participants-Tasks Results tab

    2. Questions → [ select the question set being worked on]

      1. Note that question sets are split into two: Group A and Group B. Work on one group at a time.

  3. In Loop 11, select the Projects on the sidebar, then select “View Report” for one of the following two projects depending on the group selected in step 2. (Ignore projects with additional words, like “Demo” or “Staff”)

    1. Optimizing Library Website (Group A)

    2. Optimizing Library Website (Group B )

  4. Once the project is selected, go to the “Participants Tab” and select the participant that matches the first (or next, if continuing) Loop 11 participant ID in Airtable (not that this is not the same as the participant ID assigned by the project team)

  5. Select the “Tasks” tab

  6. Go the task that matches the question set being coded.

  7. Click on the video

  8. Watch the video of that task and code the following

    1. Coded by → select your name

    2. Search terms used

      1. Type up the search terms that were used by the participants

    3. Answer correct:

      1. Yes - answer is complete and correct

      2. In part - answer is mostly complete and/or correct

      3. No - answer is wrong

    4. Observations

      1. Record observations about the search process that match the considerations for that question (Click on the Task link to see more information about the task, list of potential correct answers and considerations to think about) as well as anything noteworthy or unusual about the search

    5. For Encore-based tasks record the following:

      1. E_Search Page Facets: Select any facets present on the search page that were used by the participant from the list provided. Facets are located in the left-hand shaded column of the search results

      2. E_AS Used: Check this if the participant used the Advanced Search at all

      3. E_AS Index Used: select which index was used to search from the list provided (i.e. keyword, author, title, subject)

      4. E_AS_Conditions Selected: select if additional search conditions were set (i.e. format, collection, language, year)

    6. For Dual-Tab based tasks, record the following:

      1. DT_Tabs Used: select the tabs that were used in this search process (i.e. Google Scholar, Books and Printed Material)

      2. DT_Books_Index Used: if the participant used the Books and Printed Material tab, select the indexes that were used (i.e. Keyword, author, title, subject)

      3. DT_Books_More Searches Selected: if the participant selected additional search indexes by using the drop down of the same name on the upper right hand side of the page, check this box.

      4. DT_Books_Sorting Selected: if participants chose any sorting besides the default “relevancy”, select which sort they chose

      5. DT_Books_Location: if participants chose a specific location, selected the location they chose from the list provided

Note that if the participants did not choose the options above, simply leave these fields blank

  • No labels