Periodic Reporting for period 1 - SOS TIPS (Smart Online Searching To Increase Patient Safety)
Período documentado: 2021-08-01 hasta 2023-07-31
The spread of misinformation has been attributed to an increasingly digitalized and fractionalized information landscape, which, coupled with relevance-based algorithms has spawned distinct ways of consuming information. Digital health literacy (ability to seek, understand, and appraise online health information, as well as implement it in daily life) is a crucial competence in navigating health-related information online.
The Action “Smart Online Searching to Improve Patient Safety” (SOS-TIPS) examines experts and novices in information retrieval to develop guidelines for “Smart Searches”: how to conduct well-rounded searches, judge the reliability of online content, warning signs of questionable trustworthiness, and practical techniques aiding informed decision-making.
Our initiative aims to increase digital health literacy (DHL) via the development of a digital intervention that scaffolds critical thinking. This intervention will be based on an empirical study regarding how people search for information and how they judge its trustworthiness. The study involves simultaneously examining search activity and reflections about content, more specifically: human-computer interaction, online content, and participants’ narratives on their own behavior and impressions.
The Action “Smart Online Searching to Improve Patient Safety” (SOS-TIPS) examines experts and novices in information retrieval to develop guidelines for “Smart Searches”: how to conduct well-rounded searches, judge the reliability of online content, warning signs of questionable trustworthiness, and practical techniques aiding informed decision-making.
Our initiative aims to increase digital health literacy (DHL) via the development of a digital intervention that scaffolds critical thinking. This intervention will be based on an empirical study regarding how people search for information and how they judge its trustworthiness. The study involves simultaneously examining search activity and reflections about content, more specifically: human-computer interaction, online content, and participants’ narratives on their own behavior and impressions.
The project is being carried out in 7 work packages (WPs).
WP1 aimed to develop a methodological innovation, with which multimodal data from our empirical studies can be examined and modelled. We developed Qualitative/Unified Exploration of State Transitions (QUEST) as a novel piece of functionality within our R package {rock}, the Reproducible Open Coding Kit (ROCK). Apart from the open source code, WP1 has yielded a paper and conference presentation on a systematic review concerning unified methods (quantifying qualitative data), as well as 2 conference presentations on QUEST itself. We have also published an article on how to use the ROCK to quantify and model qualitative data. Lastly, we have held 3 workshops for employing the ROCK and QUEST, which were well-attended by participants from various countries.
WP2 encompassed deploying this novel tool in an empirical study aimed at understanding the online behavior of experts and novices in information retrieval and appraisal. Data collection took place in the US; we are now conducting analysis and applying QUEST for one of our research questions. Thus far, we have disseminated preliminary results in 2 conference presentations, a talk open to the general public, and a publication in Open Research Europe.
WP3 entails deploying our novel piece of software and creating outputs for a variety of stakeholders, such as for people with low DHL and physicians wanting to inform their patients about “smart online searching”. Work thus far has been centered around education regarding unified methods and QUEST actualized in 4 guest speaker appearances at universities and 2 workshops. Two analytically-oriented papers have been published and 2 conference presentations held, as well as a symposium. These have also been communicated to the public via a podcast conversation and a public talk. Additionally, WP3 involves working with individuals with low DHL to co-create an intervention aimed at increasing DHL and critical thinking. This work has begun with a Dutch Advisory Group (constituted by individuals with low health literacy); the foundations of this relationship are being laid at the moment.
WP4 encompasses the action: promoting Open Science (OS) and sustainability. Thus far, I have held 5 workshops and participated in 2 symposia on OS. Furthermore, I developed SQAFFOLD (Simple Qualitative Administration For File Organization and Licensing Development), infrastructure for conducting transparent qualitative and unified projects. I also created the material for a 1-hour SQAFFOLD workshop, which I have made public and reusable. I was co-founder of the Open Science Special Interest Group within the Quantitative Ethnography Society, and initiated a mentorship program called the QE Sandbox. Finally, ROCK co-developer and I won a YERUN Open Science Award. The MSCA action itself has been made fully open, and I have maintained a website, Git repository, and Open Science Framework project to increase transparency, accessibility, confirmability, and findability.
Several elements of WP5, dissemination and communication, have been disclosed above, namely conference presentations, publications, workshops, trainings, and public talks. Those not listed above are communications regarding the MSCA action: social media posts reaching 10-20 thousand people each, and 3 guest speaking opportunities at universities on the MSCA in general and its implementation. As a significant miscellanea, I co-edited a volume in Communications in Computer and Information Science (Springer) that contains papers from scholars using unified methods all around the world.
WP6, aimed at training, also encompasses the entire MSCA action. I have received hands-on training in project management (transparent planning and implementation, ethical standards, coordinating the activities of large multidisciplinary teams), advanced R programming, and data wrangling. In terms of more formal training, I took part in a FAIR qualitative data practices training, and learned about performing outreach to the general public. Lastly, I attended a summer course on Intervention Mapping, the systematic approach to develop, implement, and evaluate behavior change interventions, which will aid me in developing resources and outputs for WP3.
The last WP undergirds the MSCA action: project management. The basic management structure was established in the first week of the grant, and both supervisors (US, NL) had access to this infrastructure. I have also made a blog about completing the action, which is up-to-date on all project activities. I have met with both outgoing and incoming phase supervisors regularly. To cover material expenses that could not be financed by the MSCA action, I managed to gain additional funding from University Fund Limburg / SWOL (NL).
The details of all activities and outputs reported above can be accessed at the project website.
WP1 aimed to develop a methodological innovation, with which multimodal data from our empirical studies can be examined and modelled. We developed Qualitative/Unified Exploration of State Transitions (QUEST) as a novel piece of functionality within our R package {rock}, the Reproducible Open Coding Kit (ROCK). Apart from the open source code, WP1 has yielded a paper and conference presentation on a systematic review concerning unified methods (quantifying qualitative data), as well as 2 conference presentations on QUEST itself. We have also published an article on how to use the ROCK to quantify and model qualitative data. Lastly, we have held 3 workshops for employing the ROCK and QUEST, which were well-attended by participants from various countries.
WP2 encompassed deploying this novel tool in an empirical study aimed at understanding the online behavior of experts and novices in information retrieval and appraisal. Data collection took place in the US; we are now conducting analysis and applying QUEST for one of our research questions. Thus far, we have disseminated preliminary results in 2 conference presentations, a talk open to the general public, and a publication in Open Research Europe.
WP3 entails deploying our novel piece of software and creating outputs for a variety of stakeholders, such as for people with low DHL and physicians wanting to inform their patients about “smart online searching”. Work thus far has been centered around education regarding unified methods and QUEST actualized in 4 guest speaker appearances at universities and 2 workshops. Two analytically-oriented papers have been published and 2 conference presentations held, as well as a symposium. These have also been communicated to the public via a podcast conversation and a public talk. Additionally, WP3 involves working with individuals with low DHL to co-create an intervention aimed at increasing DHL and critical thinking. This work has begun with a Dutch Advisory Group (constituted by individuals with low health literacy); the foundations of this relationship are being laid at the moment.
WP4 encompasses the action: promoting Open Science (OS) and sustainability. Thus far, I have held 5 workshops and participated in 2 symposia on OS. Furthermore, I developed SQAFFOLD (Simple Qualitative Administration For File Organization and Licensing Development), infrastructure for conducting transparent qualitative and unified projects. I also created the material for a 1-hour SQAFFOLD workshop, which I have made public and reusable. I was co-founder of the Open Science Special Interest Group within the Quantitative Ethnography Society, and initiated a mentorship program called the QE Sandbox. Finally, ROCK co-developer and I won a YERUN Open Science Award. The MSCA action itself has been made fully open, and I have maintained a website, Git repository, and Open Science Framework project to increase transparency, accessibility, confirmability, and findability.
Several elements of WP5, dissemination and communication, have been disclosed above, namely conference presentations, publications, workshops, trainings, and public talks. Those not listed above are communications regarding the MSCA action: social media posts reaching 10-20 thousand people each, and 3 guest speaking opportunities at universities on the MSCA in general and its implementation. As a significant miscellanea, I co-edited a volume in Communications in Computer and Information Science (Springer) that contains papers from scholars using unified methods all around the world.
WP6, aimed at training, also encompasses the entire MSCA action. I have received hands-on training in project management (transparent planning and implementation, ethical standards, coordinating the activities of large multidisciplinary teams), advanced R programming, and data wrangling. In terms of more formal training, I took part in a FAIR qualitative data practices training, and learned about performing outreach to the general public. Lastly, I attended a summer course on Intervention Mapping, the systematic approach to develop, implement, and evaluate behavior change interventions, which will aid me in developing resources and outputs for WP3.
The last WP undergirds the MSCA action: project management. The basic management structure was established in the first week of the grant, and both supervisors (US, NL) had access to this infrastructure. I have also made a blog about completing the action, which is up-to-date on all project activities. I have met with both outgoing and incoming phase supervisors regularly. To cover material expenses that could not be financed by the MSCA action, I managed to gain additional funding from University Fund Limburg / SWOL (NL).
The details of all activities and outputs reported above can be accessed at the project website.
The open-source software we have developed is one of its kind, enabling the user to represent psychological (or other) states identified in qualitative data and model those in a quantified form.
Outputs from our ongoing analyses will cater to people with low DHL through various resources including a digital intervention that will be co-created with vulnerable individuals. Outputs will also serve physicians wanting to provide patients with a way to perform “smart searching” concerning their own health issues.
Gaining deeper insight into health-related information consumption is essential in ensuring health equity and patient safety in a digitalized world. Both the methodological and substantive aspects of our project aim to contribute to this overarching goal.
Outputs from our ongoing analyses will cater to people with low DHL through various resources including a digital intervention that will be co-created with vulnerable individuals. Outputs will also serve physicians wanting to provide patients with a way to perform “smart searching” concerning their own health issues.
Gaining deeper insight into health-related information consumption is essential in ensuring health equity and patient safety in a digitalized world. Both the methodological and substantive aspects of our project aim to contribute to this overarching goal.