Interpretation Protocol (QSF files for import into Qualtrics)

Interpretation Protocol files also deposited in Zenodo: doi: 10.5281/zenodo.4940170

The WE1S Interpretation Protocol for topic models (currently in version 2.0) is implemented most functionally as a modular set of Qualtrics surveys with declared steps for observing and drawing conclusions from topic models, and then recording results through the survey. The survey modules are designed to be mixed-and-matched in sequence or in parallel depending on the needs of a particular research problem.

Because the live surveys for our project are accessible only to WE1S developers using the Qualtrics survey platform through a UC Santa Barbara institutional license, we also make available QSF file versions of the surveys exported from Qualtrics.  Download .zip archive of QSF files  Users at other institutions with their own access to the Qualtrics platform may import these into Qualtrics. (Our Interpretation Protocol is tailored with specific references to our project, but suggests how other users can extend and revise the paradigm for their own projects.)

The functional advantages of using the Interpretation Protocol in its Qualtrics version include the conditional, branching logic that some of the modules utilize and, most importantly, Qualtrics’s processes for analyzing and reporting on results. (We also make the modules of our Interpretation Protocol available as Word .docx files.)

Download .zip archive of QSF files for modules of the Interpretation Protocol

Getting an overview of a topic model:

  • v_2_Module_1_-_Take_an_overview_of_a_topic_model (QSF file)
  • v_2_Module_2_-_Examine_representative_topics_and_clusters (QSF file)

Specific research tasks:

  • v_2_Module_3a_-_Analyze_a_topic (QSF file)
  • v_2Module_3b_-_Analyze_a_topic_cluster (QSF file)
  • v_2_Module_3c_-_Analyze_a_keyword (QSF file)
  • v_2_Module_4a_-_Compare_sets_of_topics_multiple_topics (QSF file)
  • v_2_Module_4c_-_Compare_two_keywords (QSF file)
  • v_2_Module_6_-_Compare two_different_topic models (QSF file)
  • v_2 Module X – Make and document your own workflow (QSF file)
  • v_2_Module_Y – Document use of additional methods and tools in studying a collection (QSF file)

Final research steps:

Module 0
User Training
Module 0...
Module 1
Overview of model
Module 1...
Module 2
Representative topics
Module 2...
Module 3.a
Analyze a topic
Module 3.a...
Module 3.b
Analyze a cluster of topics
Module 3.b...
Module 3.c
Analyze a keyword
Module 3.c...
Module 4.a
Compare sets of topics (multiple topics)
Module 4.a...
Module 4.c
Compare two keywords
Module 4.c...
Module 5
Compare two parts of corpus
     * part to whole
     * 2 metadata sets
     * 2 time ranges
     * compare to "random" corpus
Module 5...
Module Z
Add-on steps for collaborative interpretation
Module Z...
Module 7
Analysis & synthesis of interpretation results
Module 7...
Report Module --
Instructions for writing report
Report Module --...
= Created
= Created
Module 6
Compare two different
topic models
Module 6...
Module X
Make & document your
own workflow
Module X...
(use Google Doc
research report template
Module Y
Document use of additional methods and tools
Module Y...
Viewer does not support full SVG 1.1
Flowchart of existing WE1S Interpretation Protocol modules. (Modules 0 and 5 are yet to created.) Click on diagram for a larger image.