Introduction

The wide adoption of electronic health records and general IT infrastructure in primary care facilitates both digital documentation and access to information. This digital infrastructure can be leveraged to guide evidence-based care and help monitor patient safety and quality of care at the individual or group level [].

Primary care providers must track a number of quality indicators specified by regulatory authorities. These quality indicators are used to monitor and compare the quality of care across local and regional organizational boundaries [,]. Thanks to the wide adoption of electronic health records, these indicators can be automatically computed and presented to primary care staff []. In Sweden, these indicators are part of a digital platform called “Quality of Primary Care” (swe. Primärvårdskvalitet), to which the vast majority of primary care providers have access []. This platform is an example of a digital information system (DIS).

The purpose of DIS in health care is to facilitate the visualization and analysis of the data contained in electronic health records and administrative data both on an individual and population level [,]. In addition to presenting information such as quality indicators, these systems may also provide clinical decision support tools. The use of DIS among administrators, doctors, and nurses includes a spectrum of diverse purposes, intricately intertwined with their distinct roles, specialized training, individual preferences, and intrinsic motivations. This multiplicity of factors influences the unique ways in which each group engages with these systems, shaping their interactions, decision-making processes, and overall contributions within the health care ecosystem [,]. They may also have distinct perspectives on the value of DIS, both within their daily duties and the clinic’s overall functioning. These viewpoints arise from factors like duties and tasks, desired outcomes, familiarity with technologies, and personal experiences. This variance of perspectives shapes the perception and integration of digital systems, influencing clinical operational efficiency [-]. Understanding these different roles and perceptions is essential to developing systems that work well in practice and fulfill users’ needs [,].

In general, the introduction or implementation of a new DIS is difficult [,]. Oftentimes, they do not add enough value, they are too generic and not aligned with local work processes, or they do not consider practical barriers to implementation [,]. It is also unknown how DIS are used in practice, by whom, how often, and to what purpose, as well as how they are perceived and what innovative features DIS users wish to see in the future []. The introduction of an innovation such as DIS can be understood and studied as part of a process toward adoption and diffusion. In relation to a specific innovation and the intended setting and context for its introduction, there are several factors that affect the adoption process and the diffusion within and across settings []. If such factors are understood they can be targeted to facilitate and improve both the success and rate of adoption and diffusion. In this context, 5 attributes of innovation are decisive—relative advantage, compatibility, complexity, trialability, and observability—and have been respectively defined as “the degree to which an innovation is perceived as being better than the idea it supersedes,” “the degree to which an innovation is perceived as consistent with the existing values, past experiences, and needs of potential adopters,” “the degree to which an innovation is perceived as relatively difficult to understand and use,” “the degree to which an innovation may be experimented with on a limited basis,” and “the degree to which the results of an innovation are visible to others” []. In the context of introducing DIS to improve health care, it is therefore of great importance to understand how DIS are perceived by the stakeholders affected by its introduction, with respect to its different attributes and in relation to different intended uses [].

This study adopts a pragmatic approach using a familiar DIS within primary care to prompt reflection regarding use and potential development and future applications. Consequently, the study aims to explore how DIS are used and perceived by health care professionals in primary care.

MethodsStudy Design

The study has an exploratory design and is based on quantitative assessment, using descriptive statistics, of survey data collected during April-May 2022 in accordance with the CHERRIES (Checklist for Reporting Results of Internet E-Surveys) [].

Participants

We wanted to reach a large number of primary care personnel in various roles. To make it feasible to reach users of DIS we used two approaches for the distribution of a closed web-based survey: (1) directly emailing publicly listed contact persons at primary care clinics when that information was available and (2) requesting an interest organization to distribute the link to the questionnaire to its members or networks. While using this pragmatic approach enabled the creation of a convenience sample comprising a larger respondent count, it constrained our outreach predominantly to administrators and physicians.

From publicly available information on the web, we curated a total of 44 contact emails from primary care health centers in a local region in southern Sweden and 64 contact emails from a private primary care provider across the country. We contacted the 25 regional chapters of The Swedish Association of General Practice as well as the Innovation Platform at Region Västra Götaland and the Digital Well Arena in Region Värmland and asked them to distribute our questionnaire to people working in the primary care sector.

Data Collection

The digital questionnaire was kept as short as possible so that it would take less than 5 minutes to answer. This was a pragmatic choice intended to maximize the number of respondents in a short period of time. The questionnaire was structured in 3 sections developed for the purpose of the study (). It included both self-developed questions of a descriptive nature (sections 1-2) and questions based on a previously validated instrument (section 3). The three sections covered were as follows:

Respondent characteristics, including role, whether they work at a private or public provider, and their geographical region (3 questions);Use of current platforms, including access to digital tools, frequency of use, and reason for use (18 questions);Perceptions of decision support tools, including unmet needs, perceptions, and beliefs about future DIS (12 questions).

Most questions were multiple choice on an ordinal scale. Sections 2 and 3 asked about the respondents’ level of agreement or disagreement with a number of statements on a 5-level ordinal scale: completely agree, partially agree, indifferent, partially disagree, or completely disagree. Section 3 was developed based on Roger 5 attributes of innovation []—relative advantage, compatibility, complexity, trialability, and observability of results—and used a previously developed survey as template for the development []. To assess each of these attributes, 2 statements were developed. In addition, 2 final statements were designed to assess the respondents’ intention to use DIS.

Statements were developed from previous interviews with primary care physicians, primary care administrators, medical experts in the Life Science industry, and technologists developing decision support tools. The full questionnaire is available in . The questionnaire was reviewed for face validity by technologists working with clinical decision support tools, life science professionals, and health innovation and implementation researchers. The answers from the first-week respondents (N=13) were used to check that the list of roles was representative and that they were not indifferent to all items. The questionnaire was updated with additional terms for roles in the first question to better reflect what the first respondents had written under the item “other.” No other adjustments were made.

Participants were, during data collection, presented with all questions regardless of their responses to preceding queries. All questions were obligatory, and participants were provided with the alternative to respond “Don’t know” or “Neither.” Participants were allowed to review their responses before submitting the survey. The data were checked for duplicated entries to ensure that participants had not answered the questionnaire twice by accident. The usability and technical functionality of the electronic questionnaire were tested internally before fielding the questionnaire.

Data Analysis

Questionnaire answers were analyzed with descriptive statistics. Each section was analyzed for differences in answers according to roles (administrators vs physicians). This was done using the Mann-Whitney Wilcoxon Test and a significance level of 0.05, to test the null hypothesis that answers from the 2 different groups follow the same distribution. The test chosen is a nonparametric rank-sum test that has been shown to perform robustly even for small sample sizes of 10 or fewer observations [,].

Section 3 of the questionnaire was analyzed for internal consistency, in this case, the level of agreement between items related to the same attribute. This was done using ordinal coefficient α based on a polychoric correlation matrix [,].

Confirmatory factor analysis with varimax rotation and 5 factors was also performed on section 3 of the questionnaire to ensure that Roger 5 attributes were indeed captured in the questions. The 2 items related to intention to use presented high internal consistency and were averaged into one factor. The resulting factors were then used to predict the respondent’s intention to use DIS. A linear regression model was trained using 50 randomly selected entries. Model performance was tested with the remaining 20 entries. The accuracy of the model was evaluated visually and with root-mean-square (RMS) errors. All statistical analysis was done using RStudio (version 2023.03.0+386, Posit PBC).

Ethical Considerations

The study adheres to the principles outlined in the Declaration of Helsinki and fulfilled the following research requirements: information, consent, confidentiality, and participant safety. Ethical approval for the research was not formally required under Swedish law, as no personal or sensitive information was handled. Each participant received written information encompassing the study’s objectives and inception, outlining their role in the study, clarifying the collection of exclusively anonymous data, and delineating the methods for data collection and storage. They were also informed about the voluntary nature of participation, confidentiality, and the option to withdraw their consent at any point, without the need for justification.

Results

We received a total of 70 responses across 10 of the 21 regions of Sweden (). Of the 69 respondents informing on their workplace and role, 31.9% (n=22) worked at private clinics and 68.1% (n=47) worked at public clinics and, 26.1% (n=18) worked as administrators or head of operations, 1.4% (n=1) had the role as a medical strategist, and the remaining 72.5% (n=50) were physicians. Of the respondents, 11.6% (n=8) used DIS on a weekly basis, 24.6% (n=17) used DIS on a monthly basis, 27.5% (n=19) used DIS a few times a year, 26.1% (n=18) used DIS very rarely, and 10.1% (n=7) said they did not have access to DIS. However, the frequency of use differed significantly by role. Administrators were more likely to use DIS more frequently than physicians (P=.005; ).

Table 1. Regional distribution of respondents (N=70).RegionRespondents, n (%)Kronoberg17 (24.3)Halland17 (24.3)Skåne12 (17.1)Västra Götaland8 (11.4)Uppsala6 (8.6)Blekinge5 (7.1)Gotland2 (2.9)Kalmar1 (1.4)Gävleborg1 (1.4)Dalarna1 (1.4)Table 2. Frequency of use depending on participants’ roles (N=68; 2 participants did not inform on both what their role was and frequency of use and were excluded from this table).
Administrators (N=18), n (%)Physicians (N=50), n (%)No access to digital information systems07 (14.0)Rarely2 (11.1)16 (32.0)Yearly5 (27.8)14 (28.0)Monthly9 (50.0)8 (16.0)Weekly2 (11.1)5 (10.0)

In general, a large portion of participants indicated that DIS are not used to follow individual patients’ care journeys. On the other hand, a large portion of participants indicated that DIS are used for guiding quality improvement activities and for identifying high-risk or high-cost patients. Differences in the use of DIS were aligned with specific roles. Administrators were significantly more likely than physicians to use DIS for reporting to authorities (P=.01), for developing activities to improve quality of care (P=.02), and for planning budget and staffing (P<.001). On the other hand, physicians were significantly more likely than administrators to use DIS out of curiosity (P=.01; ).

In general, participants indicated that they would like to have DIS to support the follow-up of patients, lifestyle changes for patients, suggestions for treatment options, and reminders for patients to follow treatment, as well as making shared decisions with patients. None of the suggested future developments were seen as negative by either of the roles. However, there were a few areas where administrators and physicians differed in their opinion (). For example, administrators were more positive toward predictive analysis of care needs to facilitate planning of budget and staffing (P<.001). Physicians on the other hand were more negative toward identifying high-risk or high-cost patients as soon as they visit the clinic (P=.03).

Section 3 of the questionnaire included 2 items for each of Roger 5 attributes of innovation: competitive advantage, complexity, compatibility, trialability, and observability. The answers to each attribute were evaluated for internal consistency using the ordinal reliability coefficient α. Starting from the assumption that several items measure the same latent variable, the reliability coefficient indicates how consistent those items are as a group. An α above .9 is considered excellent, whereas an α between .7 and .8 is considered acceptable. Items related to competitive advantage (α=.94), complexity (α=.96), and compatibility (α=.90) presented excellent internal consistency. Trialability (α=.73) and observability (α=.72) presented acceptable internal consistency, indicating a certain dissonance between the 2 items related to these 2 attributes. The additional 2 items referring to intention to use also presented excellent internal consistency (α=.93).

‎Figure 1. Participants’ responses to statements on their use of digital information systems in their everyday practice in response to the question “How well do the following statements agree with why you use the digital tool today?”. ‎Figure 2. Participants’ statements on their use of digital information systems in their everyday practice in response to the question “How well do the following statements agree with your needs?”.

The answers to section 3 of the questionnaire were decomposed into 5 factors to test the hypothesis that these questions capture the 5 innovation attributes. Indeed, results show that the resulting 5 factors explain 78.5% of the variance in the data. In addition, each resulting factor was highly linked to one of the five attributes: competitive advantage 1 and 2 (0.090 and 0.247), complexity 1 and 2 (0.005 and 0.218), compatibility 1 and 2 (0.094 and 0.318), trialability 1 and 2 (0.550 and 0.005), and observability 1 and 2 (0.618 and 0.005). We may therefore refer to factor 1 as mostly representing complexity, factor 2 as representing competitive advantage, factor 3 as representing compatibility, factor 4 as representing trialability, and factor 5 as representing observability. For trialability and observability, loadings were high for 1 item but relatively low for the other item. This is consistent with the slightly lower ordinal reliability coefficient for those items, and the high values of uniqueness of variables trialability 1 and observability 1 (). This indicates that these variables contain unique information that does not conform with the 5 resulting factors.

Administrators were significantly more positive than doctors about DIS being compatible with their work processes (P=.04). In addition, administrators were significantly more positive than physicians in their intention to use DIS (P=.01). Intention to use did not significantly differ between respondents who used DIS frequently (ie, weekly or monthly) and the remaining respondents (P=.30; ).

All factors are positively correlated with the intention to use. Pearson correlation coefficient was highest for factor 2 (r=0.85), followed in order by factor 3 (r=0.78), factor 5 (r=0.74), factor 4 (r=0.73), and factor 1 (r=0.64). Intention to use was predicted from the 5 factors, starting with factor 2, which had the highest correlation, and consecutively adding more factors in order of correlation. RMS error was used as a measure of accuracy for each model. The best accuracy was obtained using factor 2 only (RMS=0.513), followed by a model using all 5 factors (RMS=0.524). Accuracy results were slightly worse for a model using factors 2 and 3 (RMS=0.523), followed by a model including factors 2, 3, 4, and 5 (RMS=0.532). The worst-performing model included factors 2, 3, and 5 (RMS=0.533).

Table 3. Factor loadings of questions in relation to 5 innovation attributes (bold values indicate items with high faction loadings).LoadingsFactor 1Factor 2Factor 3Factor 4Factor 5Competitive advantage 10.1580.882a0.2590.1700.108Competitive advantage 20.2240.709a0.390—b0.213Complexity 10.956a—0.2460.133—Complexity 20.820a0.1600.2610.125—Compatibility 10.3590.3420.785a0.208—Compatibility 20.4250.2860.632a—0.124Trialability 10.2720.4040.1310.378a0.230Trialability 20.1840.1820.1400.929a0.213Observability 1–0.1390.450—0.2460.310Observability 2—0.259—0.2220.934a

aValues indicate items with high faction loadings.

bNot available.

‎Figure 3. Perceptions decision support of digital information systems by role, administrators (light gray) and physicians (dark gray).
DiscussionPrincipal Findings

In this study, we applied an approach to broadly reach out to users of DIS at a national level. A digital survey with questions about the participants’ characteristics and demographics, current use, and perceptions of DIS was distributed through emails directly to potential participants and through email lists and networks. A limited number of responses were received, but still sufficient to address the study’s research questions. One-third of the participants held roles as administrators and two-thirds as physicians. Almost two-thirds used DIS often or a few times a year, while approximately one tenth had no access to DIS at all, and thereby responded to the questionnaire based on perceptions rather than own experiences. The administrators used the DIS more often and both the administrators’ and the physicians’ use followed purposes based on their professional roles, that is, more administrative purposes and more clinical purposes respectively.

Both roles were very positive about using DIS to improve the quality of care and to identify patients and groups at high risk and high costs. In cases where there was a disinterest in the use of DIS, it was associated with the application not being linked to the professional role or work tasks. For example, administrators were less interested in using DIS out of pure curiosity, while physicians were less interested in applying DIS for budget work and staffing. The only application area that was seen as predominantly negative for both roles was to follow individual patients’ care pathways. Given the value for both administrators, regarding risk assessment and cost calculation; and doctors, regarding opportunities to improve quality in clinical decisions and care planning, one could expect more positive attitudes toward this purpose of use. Whether this lower interest was due to uncertainty about the meaning of applying DIS to follow individual patients’ care pathways, or that, for example, the application was deemed not to be consistent with work tasks or the professional roles of the participants, remains to be investigated. Overall, these findings align with previous research that the attitudes toward using DIS in health care are intricately shaped by a multitude of factors, such as the application area, the professional role, and work tasks. These factors include not only the specific application domains but also the distinct professional roles and inherent tasks of individuals within the health care context [,,]. The findings from this study and existing knowledge underscore the interplay between contextual variables and illustrate the essential role they play in shaping the attitudes and inclinations toward integrating DIS within health care settings [,]. To promote the use of DIS in health care, this study and other research in this field [,] suggest it may be important to consider these factors and tailor the application of DIS to the needs of different stakeholders.

In all contexts of the introduction of new innovations, stakeholders’ perceptions of the innovation have a decisive role in the innovation’s successful adoption and diffusion within the organization, and to other similar application areas in other organizations []. In order to succeed in introducing DIS in clinical organizations with the aim of improving health care, it is thus important to understand how DIS is perceived by the stakeholders affected by its introduction. To investigate this, we developed a self-assessment instrument for stakeholders’ perceptions of DIS based on Roger 5 innovation attributes []. The instrument items were constructed based on a previous study of attitudes toward the integration of social media in university education []. The construction of 2 items to represent each innovation attribute was validated through an assessment of their internal consistency and factor loadings in relation to the comprehensive spectrum of 5 attributes. The subsequent correlation analysis, linking participant responses with their intentions to use DIS, unveiled a noteworthy positive alignment between higher-rated perceptions of DIS’s innovation attributes and an elevated intention to engage with the system. This suggests that a swift preliminary evaluation of stakeholders’ favorable attitudes and use intentions can be achieved by evaluating the perceived relative advantage of DIS. However, to attain a deeper and more nuanced understanding, it is prudent to holistically examine all 5 of Roger’s proposed innovation adoption factors in conjunction. This approach ensures a comprehensive exploration of the different dynamics influencing stakeholders’ inclinations to adopt DIS based on their perceived attributes and attitudes and could facilitate a more informed and contextually sensitive evaluation of their intentions.

Limitations

The study faced a challenge in terms of reaching a sufficient number of participants, and the response rate was relatively low. The findings may thus not fully represent the views and experiences of the entire population of interest, and there could be some sampling bias. More than half of the respondents reported using DIS often. While this may reflect the growing trend of digitalization in health care, it could also mean that the sample was overrepresented with participants with positive experiences and attitudes toward DIS and not representative of the general population, which may include individuals who have limited access or skills in using digital technologies. The study measured the intention to use DIS among both users and nonusers. However, this approach could introduce some variability in the results, as those who have prior experience with such systems may have different motivations and expectations compared to those who have only a perception or awareness of these systems. Therefore, the findings should be interpreted with caution and may not apply to all potential users.

Conclusions

In conclusion, this study used a comprehensive approach to engage a diverse range of DIS users at a national level. The survey responses provided valuable insights despite the limited number received, addressing key research questions. Administrators and physicians demonstrated varying patterns of DIS use aligned with their professional roles, reflecting distinct attitudes toward different application areas. Notably, DIS was positively embraced for quality enhancement and identifying high-risk patients, with concerns arising mainly in relation to following individual care pathways. Stakeholders’ perceptions of DIS, influenced by attributes such as professional roles and application contexts, underscore the need for tailored approaches in promoting DIS adoption within health care. By drawing from Roger’s innovation attributes, this study developed an assessment instrument to gauge stakeholder perceptions, revealing a correlation between positive perceptions and intention to use DIS. Considering all innovation factors is essential for a comprehensive understanding of stakeholders’ attitudes toward DIS integration, offering valuable insights for successful adoption and diffusion in health care settings. Based on the results, there are several potential avenues for future studies. For example, the trialability and observability questions could be refined to improve their reliability and validity. Additionally, a larger sample with more defined target groups could be investigated to enhance the generalization of the findings. Finally, more clearly defined relevance of the groups with respect to decisions about and use of DIS could be explored to gain a deeper understanding of their perspectives and needs.

This study was partially funded by CSAM Carmona AB and Halmstad University. Generative artificial intelligence was not used for manuscript writing apart from translation purposes.

The data sets generated or analyzed during this study are available from the corresponding author upon reasonable request.

Study conception and design were formulated by AS and JN. AS was responsible for data collection. Analysis and interpretation of results were done by AS and JN. AS and JN collaborated in the preparation of draft paper. Both authors reviewed the results and approved the final version of the paper.

This study was partially sponsored by a private organization that provides digital decision-support tools and data management solutions to care providers and researchers. The work was, however, conducted independently. All analyses and results presented here were not subject to any influence by the sponsor.

Edited by T de Azevedo Cardoso; submitted 15.06.23; peer-reviewed by A Epizitone, S Nilsson; comments to author 29.07.23; revised version received 01.09.23; accepted 27.09.23; published 25.10.23

©Anita Sant’Anna, Jens Nygren. Originally published in the Interactive Journal of Medical Research (https://www.i-jmr.org/), 25.10.2023.

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Interactive Journal of Medical Research, is properly cited. The complete bibliographic information, a link to the original publication on https://www.i-jmr.org/, as well as this copyright and license information must be included.