a systematic literature review of the applications of q technique and its methodology

Pascal and Francis Bibliographic Databases

Selection :

• Selected items ( 1 )

A Systematic Literature Review of the Applications of Q-Technique and Its Methodology

Methodology (Göttingen. Print) . 2011, Vol 7, pp 39-55, 17 p ; ref : 1 p.1/4

Sauf mention contraire ci-dessus, le contenu de cette notice bibliographique peut être utilisé dans le cadre d’une licence CC BY 4.0 Inist-CNRS / Unless otherwise stated above, the content of this bibliographic record may be used under a CC BY 4.0 licence by Inist-CNRS / A menos que se haya señalado antes, el contenido de este registro bibliográfico puede ser utilizado al amparo de una licencia CC BY 4.0 Inist-CNRS

Access to the document

Searching the Web

• Dissertations
• Advanced Search
• 【Updated on July 2, 2024】 Integration of CiNii Dissertations and CiNii Books into CiNii Research
• Impact of the Release of the New "NDL Search" on CiNii Services
• CiNii Labs, CiNii's experimental service public site, has been released.

A Systematic Literature Review of the Applications of Q-Technique and Its Methodology

• Fiona Dziopa The University of Queensland, School of Nursing and Midwifery, St. Lucia, Queensland, Australia
• Kathy Ahern The University of Queensland, School of Nursing and Midwifery, St. Lucia, Queensland, Australia

Description

<jats:p>Q-methodology is a technique incorporating the benefits of both qualitative and quantitative research. Q-method involves Q-sorting, a method of data collection and factor analysis, to assess subjective (qualitative) information. The use of Q-sorting and factor analysis has often resulted in the misconception that Q-methodology involves psychometric or quantitative assessment, although Q as a methodology actually enables the systematic assessment of qualitative data. Misconceptions regarding Q have resulted in a heterogeneous collection of Q-applications in the extant literature, which has obscured the fundamental principles of Q-methodology. The purpose of this paper is to present a systematic review of Q-based research to investigate the criteria researchers have used to develop Q-studies. Published research studies between January 2008 and December 2008 that employed Q-techniques and methodology were assessed. Data were extracted and synthesized through the development and use of the Assessment and Review Instrument for Q-methodology (ARIQ). Fourteen research studies met the inclusion criteria for the review. The Q-methodological studies were disparate in their application of terminology, instrument development, and factor analysis, although data extraction and synthesis processes revealed two types of studies: those which aimed to apply conventional Q-methodology and those which applied variations of Q-techniques. It is concluded that variations of Q-technique and its methodology are unavoidable. However, this does not obviate the need for researchers to explicitly state their rationale for decisions to deviate from conventional Q-methodology if they are to produce demonstrably valid research. The review instrument (ARIQ) developed for this review will facilitate this end.</jats:p>

Methodology 7 (2), 39-55, 2011-01

Hogrefe Publishing Group

Citations (1) *help

Details 詳細情報について.

• CRID 1360861292815933440
• DOI 10.1027/1614-2241/a000021
• ISSN 16142241 16141881
• Web Site https://econtent.hogrefe.com/doi/pdf/10.1027/1614-2241/a000021
• Export to RefWorks
• Export to EndNote
• Export to Mendeley
• Export as RDF
• Show Refer/BibIX
• Show BibTeX
• Show JSON-LD

Report a problem

• Edit article detail

• DOI: 10.2139/ssrn.4017583
• Corpus ID: 246542225

Methodological Choices in Applications of Q Methodology: A Systematic Literature Review

• C. Dieteren , Nathalie J. S. Patty , +1 author J. van Exel
• Published in Social Science Research… 2022

21 Citations

Diversity of chemsex experiences among men who have sex with men: results from the french anrs paacx study using q-methodology., the multiple, unique perspectives of mechanical engineering undergraduates about their program of study and their persistence, exploring farmers attitudes towards genetically modified crops in northwest bangladesh on the ground of epistemic emotions and cognitions, using q‐methodology for policy research and stakeholder engagement to strengthen public health in large‐scale mining in mozambique, patients’ perspectives on ethical principles to fairly allocate scarce surgical resources during the covid-19 pandemic in the netherlands: a q-methodology study, challenges for community-owned forests between traditional and new uses of forests: a q-methodology study applied to an alpine case, identifying communication barriers between nurses and patients from the perspective of iranian nurses: a q-methodology-based study, integrated data collection in q methodology: using chatgpt from concourse to q-sample to q-sort, sowing q methodology in the rural global south: a review of challenges and good practices, investigating co-innovation strategies to prevent food loss in the fruits and vegetables sector, 15 references, a scoping review of q-methodology in healthcare research, when and how to use q methodology to understand perspectives in conservation research, qfactor: a command for q-methodology analysis, practical issues of conducting a q methodology study: lessons learned from a cross-cultural study, a systematic literature review of the applications of q-technique and its methodology, q methodology and its position in the mixed-methods continuum, q-methodology in nursing research, scopus database: a review, doing q methodology: theory, method and interpretation, q methodology and qualitative research, related papers.

Showing 1 through 3 of 0 Related Papers

Q methodology and the sociotechnical perspective

• Original Article
• Open access
• Published: 09 June 2024

Cite this article

You have full access to this open access article

• Muriel Frank   ORCID: orcid.org/0000-0003-2294-6465 1 , 2 ,
• Vanessa Kohn   ORCID: orcid.org/0000-0003-0574-3973 1 &
• Roland Holten 1  

914 Accesses

Explore all metrics

When studying information systems (IS) phenomena, scholars increasingly aim to take a socio-technical approach. This means that instead of focusing exclusively on the technical side, they also study them from a human perspective. An underrecognized yet powerful tool for examining the opinions and attitudes of individuals is the Q methodology because it makes subjective viewpoints on IS phenomena objectively measurable. Despite its benefits and wide application in other disciplines, the use of Q methodology in top IS journals is still rare. Based on a systematic literature review, this article explores the potential and fit of Q methodology within the sociotechnical systems framework. This analysis leads to two main insights. First, Q methodology enables the integration of the social and the technical component as well as instrumental and humanistic outcomes. Second, this qualiquantilogical technique enriches the understanding of IS phenomena by objectifying the approach to exploring subjective viewpoints. Thus, our work highlights the potential of the method for conducting IS research. And it also provides clear guidelines on how to use the method to uncover new patterns inherent in the data being studied.

Similar content being viewed by others

A Guide to Selecting Theory to Underpin Information Systems Studies

From Substantialist to Process Metaphysics – Exploring Shifts in IS Research

Q methodologist views on the future of Q: a study of a research community

Avoid common mistakes on your manuscript.

1 Introduction

The application of Q methodology has a long tradition in behavioral sciences, e.g., political psychology, marketing, and sociology (Brown 1980 ; McKeown 1984 ; Stephenson 1986 ). In the information systems (IS) domain, however, scholars are reluctant to use this tool (Thomas and Watson 2002 ; Wingreen and Blanton 2018 ); only a few researchers acknowledge its potential for information systems (IS) research (Nurhas et al. 2019 ). One of the main reasons for the rare application in the field of IS is confusion about its fundamental principles (Dziopa and Ahern 2011 ) because it is neither a quantitative nor a qualitative approach but a qualiquantilogical one (Stenner and Stainton Rogers 2004 ), that is, a hybrid of qualitative and quantitative methods. The insecurities with respect to the general concept is reflected in the studies researchers conducted (Dziopa and Ahern 2011 ); many applications are not aligned with the method’s basic principles (Stainton Rogers 1995 ). Moreover, with many researchers unfamiliar with the method itself (Wingreen and Blanton 2018 ), there remains uncertainty about whether the Q method can be a complementary element in IS research, for example, as previously suggested for design science research (Nurhas et al. 2019 ) that can integrate sociotechnical perspectives (Carlsson et al. 2011 ). This raises the question of whether the IS community is missing out on assumption-challenging research (Alvesson and Sandberg 2011 ) due to its skepticism towards Q methodology.

Academics criticize that information systems research has lost sight of its sociotechnical character, which is fundamental to how the discipline sees itself (Sarker et al. 2019 ). This lack of clear orientation puts researchers in an uncomfortable position (Schwartz 2014 ). This is aggravated by the fact that IS researchers have trouble integrating findings with respect to IS phenomena into theories that recognize the interdependencies of the social and technical subsystem (Lee 2001 ; Bostrom et al. 2009 ). This is where Q methodology comes in, because we argue that Q methodology is a tool that allows for critical reflection of sociotechnical assemblages, and thus IT applications (Williams and Pollock 2012 ). Moreover, it enables scholars to examine the interactions of the social and the technical, recognizing their potential for more meaningful IS research (Nurhas et al. 2019 ). With this in mind, the targeted outcome of our research is to assess whether Q methodology is able to uncover the sociotechnical perspective in IS research, and thus help IS research to return to the core of IS, as claimed by the researchers themselves (Sarker et al. 2019 ). Additionally, our article aims to clarify the purpose and techniques of Q methodology, raise awareness for its unique benefits to the IS community, especially regarding integrating research into the sociotechnical perspective, and exemplify its application for an IS phenomenon to guide future research. Taken together, our research question is as follows: What is the potential of the Q methodology for IS research—especially with regard to the integration of the socio-technical perspective?

To this end, this paper systematically analyzes the academic literature to examine the role and impact of the decision to use the Q methodology on the integration of the fundamental perspectives (social and technical) in IS research approaches. Our work addresses common misunderstandings about the premises of the Q methodology, thereby helping IS researchers understand how they could benefit from approaching IS phenomena using Q methodology. It becomes clear that this technique provides us with the means to objectively study people’s subjective perspectives, which then serve as the basis for further investigations, such as experimental or quasi-experimental research. In this way, it promotes the effectiveness and efficiency of sociotechnical systems (STS) research.

The paper proceeds as follows: First, we describe the background of the method and the steps required for its application in research studies. We will then review the background of STS research that forms the core of the IS discipline. Next, we provide new insights into the prevalence of the Q methodology through a literature review, particularly regarding the methodological procedure and the results. Subsequently, we present a passage covering the identified papers’ fit with the sociotechnical systems framework uncovering their position along the social-technical continuum. The next section discusses the identified potential for IS research and provides clear guidance on how to use Q methodology based on an example. We also discuss the implications and contributions of our study, before closing with concluding remarks.

2 Background on Q methodology

The concept of Q methodology traces back to William Stephenson, who introduced it in a letter to Nature in 1935 and elaborated on it in the following years (Stephenson 1935 , 1936 ). His idea was to develop a technique capable of studying the subjectivity of the human mind because until then it was extremely difficult to measure subjectivity using the quantitative methods available at that time (Amin 2000 ). Since then, Q methodology has found considerable attention in different fields of behavioral science (Thomas and Watson 2002 ). For instance, it has been used to examine personality traits (Stephenson 1936 ), to uncover political opinions (Brown 1980 ), concerns in national forest management (Steelman and Maguire 1999 ) and archetypes of process improvement (Ponsignon et al. 2014 ). Employment in information systems research, however, is still scarce (Thomas and Watson 2002 ; Wingreen and Blanton 2018 ). Over the span of more than three decades, only nine studies have been published in prestigious journals of the senior scholar basket (see literature review in the next section). For instance, Dos Santos and Hawk ( 1988 ) used Q methodology for studying differences in systems analyst’s attitudes towards information systems development. Q methodology has also been used to examine metaphors in the IS language that may help alleviate the systems development process (Kendall and Kendall 1993 ), user resistance with respect to mandatory enterprise system adoption (Klaus et al. 2010 ) and IT professional’s person-organization fit regarding IT development and training (Wingreen and Blanton 2018 ). More recently, Kratzer et al. ( 2023 ) applied Q methodology to investigate the success factors for fractional chief information officer (CIO) engagement in small and medium-sized enterprises.

In general, Q methodology seeks to study subjectivity by measuring an individual’s viewpoints and attitudes, also known as operants, without imposing the usual biases of scientific surveys (Brown 1993 ). Hence, it enables the systematic assessment of qualitative information. Statistically, Q methodology involves correlating individuals by their subjective measurement of a representative set of tests and thus can be seen as an inverted form of Spearman’s two-factor theorem (Stephenson 1935 ; Brown 1980 ). Typically, the method is not designed for large subject samples (Dziopa and Ahern 2011 ). Literature on Q methodology typically describes the process in three to seven steps. Those using fewer steps combine steps such as defining the concourse and deriving Q sample items from the concourse into one step (Chen and Chen 2018 ). While the number of steps differs, the generally accepted approach remains the same. As detailed below, we describe the process of conducting a Q methodology study using the five steps shown in Fig.  1 .

Steps of Q methodology

Step 1 Composing the Q sample: Q sample items are a collection of viewpoints on the subject matter drawn from the concourse. The concourse refers to a wide range of ideas on a topic collected from various sources (Amin 2000 ). Q samples can be fashioned in several ways, however, the most preferable one is to conduct interviews as they enlarge the scope of relevant features (McKeown and Thomas 2013 ). The subject matter will largely determine the exact number of Q sample items. The final Q set often comprises 30–60 statements (Donner 2001 ; Watts and Stenner 2005 ), but there are also studies that use smaller or larger numbers of Q sample items (Stainton Rogers 1995 ). Reusability of the Q set makes the research process reproducible (Gauzente 2013 ). Unlike item selection of conventional survey constructs in R methodology Footnote 1 , Q sample items neither measure a particular construct nor do they implicate other variables (Brown 1993 ).

Step 2 Selection of participants: Selected participants are referred to as person samples (P-sets). Since Q methodology has an intensive orientation (Brown 1974 ), the size of the person sample can be rather small and still allow for meaningful conclusions, as the goal is to make generalizations about the structure of a concourse rather than characteristics of a population of people (Watts and Stenner 2005 ). Accordingly, P-sets contain between 40 and 60 participants (Stainton Rogers 1995 ). Watts and Stenner ( 2005 ) suggest using a 1:1 ratio, i.e., the same number of participants as Q items. The selection of participants typically follows either theoretical or pragmatic considerations. Hence, samples are constructed based on theoretical adequacy or their mere availability (McKeown and Thomas 2013 ).

Step 3 Q sorting: Participants express their subjective viewpoints on the Q sample by comparing and ranking the Q sample items along a predefined pattern that resembles a quasi-normal flattened distribution (Brown 1980 ; McKeown and Thomas 2013 ). Figure  2 illustrates a typical response grid for Q sorting. Noteworthy is that participants performing Q sorting, as this procedure is also called, evaluate each statement in comparison to every other item (McKeown and Thomas 2013 ).

Q sort response grid

Step 4 Analysis: This step involves factoring the Q sorts which reveals the structures implicit in subjectivity. For this purpose, factor analysis is used to group individuals who show similarities in terms of shared views (Brown 1980 ; McKeown and Thomas 2013 ). The Q method uses similar statistical specificities, e.g., regarding the significance of the factors or their rotation, as the R method (McKeown and Thomas 2013 ).

Step 5 Interpretation: The final step is about interpreting the factors, thus distilling the core meanings while considering the broader context of their occurrence (McKeown and Thomas 2013 ). Unlike most research applications, factor interpretation in Q methodology is based on factor scores rather than factor loadings as this helps to understand the consensus and distinguishing items for a particular factor (McKeown and Thomas 1988 ; Stainton Rogers 1995 ; Donner 2001 ). A factor score is the normalized weighted average score of individuals that determines the factor. Typically, item statements at the extreme ends of the Q sort are used to emphasize the composite view of the factor (van Exel and de Graaf 2005 ).

3 Background on the foundations of the sociotechnical perspective

The sociotechnical perspective marks one of the fundamental viewpoints within the information systems (IS) discipline (Sarker et al. 2019 ). It has its origins in multiple post-World War II studies designed to examine improvements in working life and establish the new field of sociotechnical systems (Trist and Bamforth 1951 ). Broadly speaking, sociotechnical systems comprise two distinguishable but mutually influencing components: the technical and the social system (see Fig.  3 ).

Sociotechnical perspective adapted from Sarkar et al. ( 2019 )

The technical component consists of soft- and hardware tools and techniques needed to solve and fulfill organizational issues and tasks (Bostrom and Heinen 1977 ), while the social component is composed of individuals and collectives who bring certain attributes, such as skills, knowledge, or social capital to the work environment (Ryan et al. 2000 ; Bostrom et al. 2009 ). STS does not favor one of the two dimensions but contends that their joint interaction is necessary to realize instrumental and humanistic goals (Wallace et al. 2004 ; Bostrom et al. 2009 ). STS implies that employees use technology to perform work tasks to achieve predefined organizational and personal goals (Bostrom and Heinen 1977 ; Carayon et al. 2015 ). In other words, STS allow achieving both instrumental and humanistic objectives in a synergistic manner through the interplay of social and technical components.

In the subsequent section, we will first provide an overview of previous applications of the Q methodology in IS research, and then detail the extent to which the identified papers align with the STS framework. Our aim is to show if and how the tool enables the integration of social and technical aspects of IS phenomena. We also seek to determine whether the Q methodology has the potential to identify and answer research questions that arise in this context.

4 Application of Q methodology in information systems

To understand the current state-of-the-art with Q methodology in information systems research, we conducted a thorough literature review in well-ranked journals such as the senior scholar basket journals (Lowry et al. 2013 ), Administrative Science Quarterly, Management Science, and Organization Science. In general, literature reviews help to establish a solid basis for answering the research question (Levy & Ellis 2006) because they provide a synthesis of a comprehensive body of knowledge in a reflective manner (Rousseau et al. 2008 ) that can be used as a framework for future research endeavors (Petticrew and Roberts 2016 ). Inspired by calls from researchers, e.g., Sarker et al. ( 2019 ), for a return to the sociotechnical roots of the IS discipline, this systematic synthesis of the literature aims to assess whether the Q methodology is able to uncover the sociotechnical perspective in IS research. Based on this objective, we searched a total of 14 renowned peer-reviewed scientific journals, yielding a total of 134 articles. The detailed protocol of the literature review can be found in Table 3 in the Appendix.

In the first round, we used the keywords 'q sort', 'q method', 'q methodology', 'q factor analysis', and 'concourse theory' to cover existing work on Q methodology. To also investigate whether any of the articles addressed sociotechnical aspects, we conducted another round of keyword searches using 'q sort + sociotechnical', 'q method + sociotechnical', 'methodology + sociotechnical', 'q factor analysis + sociotechnical', and 'concourse theory + sociotechnical'. Table 1 displays the scholarly journals we queried with which keywords.

After removing duplicates, 100 articles remained for full-text screening. Inclusion criteria were articles written in English that either used or referred to the Q method or Q techniques; exclusion criteria, on the other hand, were articles in which the keyword was not mentioned in a relevant context, e.g., when reference was made to another paper, or which referred to methods other than the Q method (e.g., Q + method or QQ method). In addition, articles were excluded from the systematic literature review if the author(s) mentioned the key term only as one of several possible research approaches or as part of a summary of an article. After applying the inclusion and exclusion criteria, 81 articles remained for analysis. We then synthesized and analyzed the identified literature, as described in the following section. Lastly, we also performed a backward search of relevant articles. A backward search refers to the process of checking the references of relevant articles with the aim of potentially identifying more relevant articles to include in the review (vom Brocke et al. 2009 )—here: the nine articles using the Q method as proposed by Stephenson. However, it did not identify any new articles. Figure  4 illustrates the entire literature review process based on Shamseer et al. ( 2015 ).

Overview of the literature review process based on Shamseer et al. ( 2015 )

4.1 Results of the literature review

As a result, we identified 81 research articles that fit the inclusion criteria and classified them into three main categories: the first category encompasses studies that applied Q methodology in Stephenson’s sense (9 articles). The second category relates to articles using Q techniques out of Q methodology to evaluate and improve construct validity (70 articles). And the last category includes articles that deal with Q methodology and Q techniques only on a theoretical basis (2 articles). Figure  5 plots the publication outlets and their belonging to the three different categories. For a more detailed look at the publications, see Table 4 in the Appendix, where publications are listed with the assigned category and the purpose of the method.

Distribution of publications outlets in the three respective categories

The first category applies Q methodology in Stephenson’s mold, that is, combining quantitative techniques with psychometric and operational, or qualitative principles to study human subjectivity (Brown 1980 ; McKeown and Thomas 2013 ). Of the nine papers, seven explicitly follow steps of Q methodology as outlined above, including an initial collection of concourse statements, the development of an appropriate Q sample, followed by participants performing Q sorting, quantitative analysis to identify participants with similar thought patterns and finally development of coherent narratives for the identified set of factors. Two studies (Kendall and Kendall 1993 , 1994 ) supplement their Q methodology analysis with dramatism. To elicit self-referent opinions on the topic at hand, researchers mostly resort to individual interviews (e.g., Klaus et al. 2010 ; Mettler and Wulf 2019 ; Kratzer et al. 2023 ). In some cases, the collection of the initial Q sample is extended by other sources such as literature reviews (e.g., Wingreen and Blanton 2018 ) or focus group interviews (e.g., Kendall and Kendall 1993 ). One study relies solely on statements identified by reviewing the literature and evaluated by subject matter experts (Dos Santos and Hawk 1988 ). Q samples consisted of 25 items (Kratzer et al. 2023 ) to 33 items (Dos Santos and Hawk 1988 ; Tractinsky and Jarvenpaa 1995 ) which is in the middle of the range of 20 to 60 statements considered meaningful to Q samples (Donner 2001 ). It is particularly beneficial to keep Q samples smaller if participants are unfamiliar with the method (Ockwell 2008 ).

The ratio of participants to Q items varies; three studies (Tractinsky and Jarvenpaa 1995 ; Mettler et al. 2017 ; Mettler and Wulf 2019 ) have a lower P sample to Q sample ratio, while three have significantly more participants than Q sort items (Klaus et al. 2010 ; Wingreen and Blanton 2018 ; Kratzer et al. 2023 ). Only Dos Santos and Hawk ( 1988 ) have a P-sample-Q-sample ratio of nearly 1:1, as Watts and Stenner ( 2005 ) suggested. Participants were mainly living in the U.S. or Europe. With regard to analysis, the majority use principal component analysis and varimax rotation (e.g., Mettler et al. 2017 ; Kratzer et al. 2023 ). Two studies apply centroid factor analysis (Klaus et al. 2010 ; Wingreen and Blanton 2018 ). Some studies do not mention the extraction method (e.g., Kendall and Kendall 1993 ). Regarding the results (statistical characteristics) presentation, researchers focus primarily on statements with highest and lowest agreement (e.g., Mettler and Wulf 2019 ), distinguishing and consensus items (e.g., Kratzer et al. 2023 ), and z-scores (e.g., Klaus et al. 2010 ). Table 5 in the Appendix shows the results of the research articles analyzed.

Q techniques can also be applied as a stand-alone technique without applying Q methodology (Dziopa and Ahern 2011 ), which pertains to the papers of the second category. The majority of those papers use Q techniques to develop or refine measurement instruments (see e.g., Segars and Grover 1998 ; Jahng et al. 2007 ; Varella et al. 2012 ; Bapna et al. 2019 ) and quantitatively assess a measurement’s construct validity (Messerschmidt and Hinz 2013 ; Benlian et al. 2015 ). According to Stainton Rogers ( 1995 ), Q techniques incorporated into this kind of assessment are instrumentally R methodology. Nevertheless, as with Q methodology, participants are able to express their opinions in a Q sort, i.e., when sorting items back to the original constructs (e.g., Varella et al. 2012 ) or when assessing similarity of items and representativeness of statements for separate constructs (e.g., Segars and Grover 1998 ; Fan and Lederman 2017 ).

The final category eventually includes review papers that refer to Q techniques (Hardin et al. 2008 ) or Q methodology as propounded by Stephenson (Sheth 1967 ). However, they do not present an empirical application of the Q technique or methodology but rather a theoretical discourse.

4.2 Fit with the STS framework

In alignment with our research question, we assess how well the identified studies using Q methodology reflect the sociotechnical perspective, i.e., capture the dynamic interaction of social and technical systems. We focus on the nine studies of the first category. This is because the studies in the second and third category lack detailed information on Q methodology and/or ignore the primary premise of Q methodology, according to which communication of subjective viewpoints should come from a position of self-reference and not be compromised by a researcher’s analytical frame (McKeown 1988 ; Stainton Rogers 1995 ).

Dos Santos and Hawk ( 1988 ) surveyed systems analysts from eight private and public organizations to determine their attitudes toward developing information systems. Their 33-item Q sample, developed on the basis of a literature review, spans all dimensions of the STS framework, with a special emphasis on the social component and the humanistic goals. For example, the social component is covered by items such as “The use of structured techniques in analysis, design and programming is essential. They shorten development time and reduce both development and maintenance costs” or “Good communication between users and IS analysts is necessary so that analysts understand users needs and users understand what analysts are proposing”. The Q sample also contains instrumental (“Large projects should be avoided by splitting them up and working on a portion at a time. This way we work on a number of smaller projects that we can complete and turn over to the users in a short period of time. Large projects have a way of going on forever and always seem to run into problems”) and humanistic objectives (“Users should have realistic expectations of what the system is to deliver. That way they are not disappointed and are happier with the system.”). Finally, the technical component is addressed through statements such as “The user interface to a system is important. What the user sees is probably as important as anything else that the system does”. Overall, their work emphasizes the need to integrate the human component and humanistic perspectives into the development process, since the attitudes of those involved can make or break the success of a developed IT system.

Building on work on metaphors in organizational life, Kendall and Kendall ( 1993 ) examine the language of IS users to uncover the relationship between metaphors and methodologies in IT practice. Since the authors provide only limited insight into their used Q sample, no information can be given on the extent to which the technical or social dimensions have been taken into account. We only know that at least some of the items reflect the social component, such as “Our leader looks out for the welfare of all of us”. This also applies to the paper the authors published in 1994 since the data basis is the same (Kendall and Kendall 1994 ).

To investigate types of user resistance and management strategy expectations in a mandatory enterprise systems (ES) adoption environment, Klaus et al. ( 2010 ) implemented a study with representatives of ES user groups. Their Q sample recognizes the adoption process as consisting of social and technical considerations, arising from the understanding that both dimensions imbricate (Sarker et al. 2019 ). Items pertaining to the social component address, for instance, communication or management support, while items related to the technical component refer, for example, to technical problems. With nearly half of the items, the Q sample considers primarily humanistic viewpoints (e.g., turnover intention, demotivation, refusal), highlighting the influence of human concerns in the adoption environment.

Mettler et al. ( 2017 ) explored shared beliefs about autonomous service robots in healthcare work environments like hospitals and nursing homes. The used Q sample items can be attributed to both the technical (e.g., “Service robots will cause new types of integration problems with our IT.”) and the social component (e.g., “I am very much in favor of implementing service robots in hospitals.”). Additionally, the Q sample considers instrumental (e.g., “Service robots will reduce the operating costs of the entire hospital.”) and humanistic goals (e.g., “Service robots will reduce the workloads of low-skilled jobs.”). Thus, the identified five niches display social and technical relationships as conceived within the STS framework.

Two years later, Mettler and Wulf ( 2019 ) examined the responses of employees who were faced with the introduction of wearables that measure physiological parameters at the workplace. The selected Q sample items predominantly reflect humanistic (e.g., “I would like to use algorithmic decision‐making tools, which support me to become healthier in my free time.”) rather than instrumental outcomes. In doing so, the authors consider the sociotechnical perspective showing the dark side of IT (Sarker et al. 2019 ) or its dehumanizing effects, respectively (Moore and Piwek 2017 ).

Our literature review also reveals studies with uneven emphasis on either social or technical ends. Concentrating on fractional chief information officers (CIO) mainly from New Zealand and the United States, Kratzer et al. ( 2023 ), for instance, investigate potential success factors for Fractional CIO engagement success. The developed Q sample items essentially disregard the influence of technology as they focus mainly on social aspect of the problem under investigation (e.g., the communication with client’s top management team, trust, integrity and effective communication with non-executives). Accordingly, it is mainly the success factors attributed to the social component that distinguish the three identified fractional CIO groups. Orlikowsky ( 2010 ) speaks of technology’s “absent presence” in this context. Using a similarly one-sided approach, Tractinsky and Jarvenpaa ( 1995 ) study thoughts about managing information technology (IT) in a global respective local context. The items generated from interviews with 65 project managers mainly represent the technical (e.g., reliable and robust systems) and the instrumental outcome dimension of IT management (e.g., minimizing hardware costs and maximizing the return from the existing hardware and software base), while the social component is rather neglected.

With the help of 298 IT professionals, Wingreen and Blanton ( 2018 ) examine subjective beliefs and behaviors related to the alignment of individual and organizational priorities respective preferences, also known as person-organization (P–O) fit. The five identified types represent the relationship between the subjective P–O fit in IT training and development. However, their cohesion of sociotechnical dimensions differs tremendously; Type 1 employees, for instance, have deeper technical preferences with a fair organizational fit, while Type 5 employees show preferences for personal development, but the organization does not meet these preferences. Thus, we see a disconnect between instrumental and humanistic outcomes regarding the identified types. Sarker et al. ( 2019 ) take it as evidence that only linking humanistic and instrumental goals will lead to valuable synergies.

Table 2 summarizes our findings with regard to the fit with the STS framework. Overall, we see that the sociotechnical perspective is reflected in the majority of the papers reviewed (seven out of nine). Thus, we can conclude that using Q methodology in Stephenson’s sense can help grasp the essence of information systems (Sarker et al. 2019 ).

5 Potential of Q methodology for IS research

Scholars already have an extensive set of tools for studying information systems phenomena within the sociotechnical perspective: the technical system, including processes and technologies, is well researched and its performance measurable (see, for example, Abu-Nimeh et al. 2007 ). The same is true for instrumental outcomes, as researchers have various performance indicators that they can adduce as inputs for models (Hübner-Bloder and Ammenwerth 2009 ). And the social system, i.e., the individual and their values, seems investigable with psychometrics. But studying humanistic outcomes, i.e., people’s perceptions and attitudes, objectively is a difficult task to undertake. And this is where Q methodology can step in and reveal individuals’ subjectivity without confounding them with operational measurements (McKeown and Thomas 2013 ). It gives researchers a robust technique for measuring attitudes that has the power to surprise, as no prior assumptions are built in (Dziopa and Ahern 2011 ). The appeal of Q methodology lies in the innovative way it approaches IS phenomena and analyzes data (Dziopa and Ahern 2011 ). Q methodology provides a unique opportunity to empirically observe and systematically measure subjective viewpoints, which proves especially useful when investigating controversial and sociotechnical issues. Beyond deepening the understanding of attitudes and perceptions, it can also be utilized for fit evaluation and trend identification (Gauzente 2013 ).

Unlike the hypothetico-deductive methods used in R research, the interactive nature of Q methodology allows for the objective study of emergent phenomena based on the subjective interactions of individuals with a concourse (McKeown and Thomas 2013 ). This interactive worldview inherent to Q methodology differs from simply observing how objective forces affect a person. As discussed in the theoretical background section, the interplay of social and technical components is at the core of STS and enables the achievement of both economic and humanistic goals. When a concourse under study involves social and technical aspects, the Q methodology provides a unique opportunity to study this interplay, because the Q sort statements obtained from this discourse represent direct observations of this interaction. As shown in Table  2 , most of the current IS studies that apply Q methodology focus on single components of STS. We advise future research to aim at covering all components and especially their interplay in their Q items to take full advantage of the Q methodology.

Q methodology has been criticized for lacking reliability and replicability due to its small sample size. However, these concerns are unwarranted (Thomas and Baas 1993 ; Gauzente 2013 ). This is because the status of reliability and validity differs between Q methodology and R methodology (Wingreen and Blanton 2018 ). In R research, objective measurements are crucial for achieving the research objectives. Therefore, measures must be internally consistent, i.e., reproducible, and accurately capture the intended concept (i.e., be valid). In contrast, Q methodology aims to study the views of individuals. Therefore, reliability and validity pertain to the individual rather than the measurements, and subjective viewpoints can be considered valid by definition (Lincoln and Guba 1985 ; Wingreen and Blanton 2018 ). As any self-reported measure, it relies on participant’s honesty and might be subject to social desirability bias. Consulting qualitative comments or conducting follow-up interviews is an effective approach to minimizing researcher’s bias and verifying researcher’s initial interpretations (Watts and Stenner 2005 ).

Finally, as Q methodology follows an exploratory approach, it is not suitable to confirm or reject a null hypothesis with regard to significance levels. However, the results of the Q methodology can be used as an input for further research efforts and, more generally, to help make STS research more effective. As our systematic literature review revealed, we see two different types of Q research. The first one applies Q methodology as originally proposed by Stephenson ( 1936 ); the second uses Q techniques to measure a theorized process without enabling participants to express their subjective thoughts on the subject under study. However, according to Stainton Rogers ( 1995 ), these applications ignore the primary premise of Q methodology, in which self-reference should be preserved to advance the understanding of subjectivity.

In summary, this state-of-the-art article shows that the social and technical relation varies considerably within the research studies reviewed. At the same time, it highlights that by using Q methodology, IS researchers can approach their work and research questions from a sociotechnical perspective. To illustrate how this technique can be used, we will outline the introduced steps for a study on sociotechnical system realignment during the COVID-19 pandemic (Kohn et al. 2023 ). In this way, we demonstrate the feasibility of gaining insight into STS through the use of Q methodology and exemplifies the implementation of its five steps:

Step 1 In this research project, remote work and the alignment of sociotechnical systems were studied from the perspective of workers affected by the transition to remote work during the COVID-19 pandemic. We used interviews to ensure a representative collection of ideas and viewpoints on the study’s topic (Amin 2000 ; McKeown and Thomas 2013 ). We also reviewed the relevant literature to identify other factors that influence employees’ attitudes toward remote work. Finally, we selected 40 items which is in the range of 20–60 statements considered meaningful for Q method (Donner 2001 ). They covered organizational and individual drivers of employees’ attitudes toward remote work.

Step 2 Following Watts and Stenner ( 2005 ), we aimed for a 1:1 ratio of statements to participants. The selection of participants followed both theoretical as well as pragmatic considerations (McKeown and Thomas 2013 ), i.e., participants had to have experience with remote work but also be available to participate in the study.

Step 3 Next, participants were asked to compare the Q sample items on remote work and rate the extent to which they agreed, disagreed, or felt neutral about them. We used a web-based response grid (Aproxima 2015 ) and instructed them to place the items along a predefined pattern resembling a quasi-normal distribution (Dziopa and Ahern 2011 ).

Step 4 Since many software packages such as “qmethod” (Zabala 2014 ) are available to perform the data analysis of Q sorts, we will only give a brief overview of the next steps. Analysis began with the calculation of the correlation matrix, which represented the similarity or dissimilarity in terms of remote work between workers. The correlation matrix was then used for the process of factoring. We used PCA and varimax rotation. The objective was to identify groups with similar viewpoints on the topic (Brown 1980 , 1993 ), consequently, workers with similar attitudes toward remote work shared the same factor. Finally, the analysis included calculating both the factor scores and the scores for the distinguishing and consensus statements (van Exel and de Graaf 2005 ) as these are required for interpretation (Stainton Rogers 1995 ).

Step 5 The final step was about distilling the meaning of the identified factors while taking into account the context in which they occurred (McKeown and Thomas 2013 ). For this purpose, we focused on the statements ranked at the extreme ends of the sort of a factor as they serve as characterizing statements for the factor (van Exel and de Graaf 2005 ). We identified two distinct groups of workers: one working remotely in highly aligned sociotechnical systems (“high STS alignment group”) and the other working remotely in sociotechnical systems with a low degree of alignment (“low STS alignment group”). We relied on distinguishing and consensus statements to emphasize the differences and similarities between the two groups of workers (McKeown and Thomas 1988 ; Donner 2001 ; van Exel and de Graaf 2005 ).

6 Contributions and implications

Based on our findings, several implications and contributions arise, which we will explain in the following. Firstly, our literature review provides an overview of the state-of-the art of Q methodology research in leading IS journals and gives an insight into the research areas that have benefited from integrating Q methodology so far. Secondly, it provides guidance for future IS research in the decision for or against the application of Q methodology as well as its implementation to ensure rigor and practicability. This is prerequisite for future research that want to build on results from Q methodology. Thirdly, our review confirms that Q methodology has received little attention in the IS community so far—especially when compared to other techniques that are used for similar ends, such as focus groups or interviews (Zabala et al. 2018 ). However, it is hoped to encourage other researchers to consider Q methodology as a beneficial research method in the IS domain. Fourthly, and most importantly, we build on this review to provide an understanding of how Q methodology can enable IS researchers to approach their work and research questions from a sociotechnical perspective. Our analysis concludes that Q methodology can reveal the dynamics of objectified subjective viewpoints in sociotechnical systems, which can serve as a basis for further experimental and quasi-experimental research projects.

As shown in our literature review, existing Q methodology research in IS has generated knowledge in several areas, including the identification of unique user types and their language, niches, attitudes, subcultures and design choices (e.g., Mettler et al. 2017 ; Kratzer et al. 2023 ). However, despite the fact that the method is perfectly suited for integrating all sociotechnical dimensions, none of the articles in our literature review makes explicit reference to STS. To investigate and outline the potential of this methodology to re-enforce the STS perspective in IS research, our study reviews the existing literature from a sociotechnical perspective and determines the extent to which existing Q research reflects the STS framework. In doing so, our work echoes the call for a return to the sociotechnical roots of the IS discipline (Sarker et al. 2019 ).

Previous studies have applied Q methodology in different ways, ranging from superficial and theoretical mentions or use of single Q techniques to thorough implementations of all Q methodology steps. We classify existing research according to the extent of their Q methodology usage and clarify the purpose of Q methodology in each category. We find that most studies that use Q methodology in Stephenson’s sense also reflect some dimensions of the STS framework. In doing so, they do not only serve their individual self-stated purposes, but also the higher goal of strengthening the sociotechnical character of IS research. However, as they typically reflect only one or two dimensions of the STS framework, we recommend that future research focus on including Q sort items that reflect all dimensions of the STS framework.

From the analysis of the results of our literature review, we can draw various practical conclusions for maximizing the utility of the Q methodology in future IS studies. These include using Q methodology in Stephenson’s sense, being transparent and striving for a holistic view of all STS components. By providing an example of the application of Q methodology to advance the understanding of STS, we provide researchers with practical insights into its process and potential. We also show how the Q methodology can pave the way for further research by providing methodologically robust results on which to build. This reduces the risk of wasted research resources and makes STS research efforts more efficient.

In short, our paper bridges the gap between Q methodology and the STS framework to assess the status quo and determine whether it provides a means to strengthen the sociotechnical character of future IS research. We acknowledge that other methodologies may be equally suitable for strengthening the sociotechnical perspective in IS research, which can be explored in future research. Nevertheless, we can conclude that Q methodology is an appropriate tool to address sociotechnical relations and to shed light on the humanistic and technical aspects of issues in the information systems domain (e.g., Mettler et al. 2017 ; Wingreen and Blanton 2018 ; Mettler and Wulf 2019 ; Kratzer et al. 2023 ). Both are necessary to fully understand the interlocking contexts in which IS phenomena emerge (Williams and Pollock 2012 ). Moreover, using Q methodology to better understand STS may yield unexpected results because it focuses on the individual’s perspective and does not make assumptions about participants’ views that could be influenced by potential biases of the researchers (Bashatah 2016; Dziopa and Ahern 2011 ). For instance, a surprising consensus, previously overlooked deviations from the status quo, or the interplay of certain phenomena might be revealed. The exploratory and interactive nature of Q methodology can bring coherence to research questions that may have numerous intricate and socially controversial answers (Stainton Rogers 1995 ; Watts and Stenner 2005 ). Such research, which challenges assumptions and goes beyond simply filling in gaps, is in high demand (Alvesson and Sandberg 2011 ). At a societal level, Q method even promotes stakeholder engagement because it inherently incorporates a diversity of views and ideas. This creates a natural confrontation of different perspectives, which can then be used to facilitate dialogue between those involved (Cuppen 2012 ).

7 Conclusion

Since the late 1980’s, only a few research studies published in the leading IS journals have used the Q methodology, although scholars advocate a more extensive use of this tool. This article explores the potential and fit of Q methodology within the sociotechnical systems framework. Our literature review indicates that Q methodology is suitable for a deeper understanding of perceptions and attitudes towards the IS phenomena under study for several reasons. First, it allows researchers to tackle research questions that may not be readily approachable within the prevailing behavioral science paradigm. Second, Q sort statements extracted from the discourse represent direct and detailed observations of the interaction between social and technical elements. This makes it possible to operationalize behavioral interactions and understand where views on human interactions with the technological world coincide or diverge. Third, the tool provides researchers with the opportunity to examine sociotechnical relationships of IS and assess the interdependencies of both the social and the technical component. However, it is recommended that future studies applying the Q methodology to IS research questions not focus on individual dimensions of STS, but rather take a holistic approach. The rationale behind this is that studies that use Q methodology in Stephenson's sense benefit most from the unique advantages of Q methodology and can best capture the essence of IS. Besides, being transparent about the applied steps increases confidence in the results.

R methodology describes non-Q methodologies, such as test theory, surveys and questionnaires, and is characterized by a-priori assumptions and results that are seldom operant (McKeown and Thomas 2013 ).

Abu-Nimeh S, Nappa D, Wang X, Nair S (2007) A Comparison of Machine Learning Techniques for Phishing Detection. In: APWG eCrime Researchers Summit. pp 60–69

Akter S, D’Ambra J, Ray P (2013) Development and validation of an instrument to measure user perceived service quality of mHealth. Inf Manag 50:181–195. https://doi.org/10.1016/j.im.2013.03.001

Article   Google Scholar  

Alvesson M, Sandberg J (2011) Generating research questions through problematization. Acad Manag Rev 36:247–271. https://doi.org/10.5465/amr.2009.0188

Amin Z (2000) Q methodology—a journey into the subjectivity of human mind. Singapore Med J 41:410–414

Google Scholar  

Aproxima (2015) HtmlQ. https://github.com/aproxima/htmlq

Banerjee S, Chua AYK (2021) Calling out fake online reviews through robust epistemic belief. Inf Manag 58:103445. https://doi.org/10.1016/j.im.2021.103445

Bapna S, Benner MJ, Qiu L (2019) Nurturing online communities: an empirical investigation1. MIS Q 43:425–452. https://doi.org/10.25300/MISQ/2019/14530

Beemer BA, Gregg DG (2010) Dynamic interaction in knowledge based systems: an exploratory investigation and empirical evaluation. Decis Support Syst 49:386–395. https://doi.org/10.1016/j.dss.2010.04.007

Benitez J, Llorens J, Braojos J (2018) How information technology influences opportunity exploration and exploitation firm’s capabilities. Inf Manag 55:508–523. https://doi.org/10.1016/j.im.2018.03.001

Benlian A, Hilkert D, Hess T (2015) How open is this platform? The meaning and measurement of platform openness from the complementors’ perspective. J Inf Technol. https://doi.org/10.1057/jit.2015.6

Bhattacherjee A (2002) Individual trust in online firms: scale development and initial test. J Manag Inf Syst 19:211–241. https://doi.org/10.1080/07421222.2002.11045715

Bostrom RP, Gupta S, Thomas D (2009) A meta-theory for understanding information systems within sociotechnical systems. J Manag Inf Syst 26:17–48. https://doi.org/10.2753/MIS0742-1222260102

Bostrom RP, Heinen JS (1977) MIS problems and failures: a socio-technical perspective. Part I: the Causes MIS Q 1:17–32. https://doi.org/10.2307/248710

Brown SR (1974) Intensive analysis in political research. Polit Methodol 1:1–25

Brown SR (1980) Political subjectivity: applications of Q methodology in political science. Yale University Press, New Haven

Brown SR (1993) A primer on Q methodology. Operant Subj 16:91–138

Burton-Jones A, Straub DW (2006) Reconceptualizing system usage: an approach and empirical test. Inf Syst Res 17:228–246. https://doi.org/10.1287/isre.1060.0096

Carayon P, Hancock P, Leveson N et al (2015) Advancing a sociotechnical systems approach to workplace safety – developing the conceptual framework. Ergonomics 58:548–564. https://doi.org/10.1080/00140139.2015.1015623

Carlsson SA, Henningsson S, Hrastinski S, Keller C (2011) Socio-technical IS design science research: developing design theory for IS integration management. Inf Syst E-Bus Manag 9:109–131. https://doi.org/10.1007/s10257-010-0140-6

Chang JC, King WR (2005) Measuring the performance of information systems: a functional scorecard. J Manag Inf Syst 22:85–115. https://doi.org/10.1080/07421222.2003.11045833

Chen TL, Chen L (2018) Utilizing wikis and a LINE messaging app in flipped classrooms. Eurasia J Math Sci Technol Educ 14:1063–1074. https://doi.org/10.12973/ejmste/81548

Cui T, Ye JH, Tan CH (2022) Information technology in open innovation: a resource orchestration perspective. Inf Manag 59:103699. https://doi.org/10.1016/j.im.2022.103699

Cui T, Ye H, Teo HH, Li J (2015) Information technology and open innovation: a strategic alignment perspective. Inf Manag 52:348–358. https://doi.org/10.1016/j.im.2014.12.005

Cuppen E (2012) Diversity and constructive conflict in stakeholder dialogue: considerations for design and methods. Policy Sci 45:1. https://doi.org/10.1007/s11077-011-9141-7

De LMS, Washburn NT, Waldman DA, House RJ (2008) Unrequited profit: how stakeholder and economic values relate to subordinates’ perceptions of leadership and firm performance. Adm Sci Q 53:626–654. https://doi.org/10.2189/asqu.53.4.626

Donner JC (2001) Using Q-sorts in participatory processes: an introduction to the methodology. Soc Dev Papers 36:24–49

Dos Santos BL, Hawk SR (1988) Differences in analyst’s attitudes towards information systems development: evidence and implications. Inf Manag 14:31–41. https://doi.org/10.1016/0378-7206(88)90065-1

Dziopa F, Ahern K (2011) A systematic literature review of the applications of Q-technique and its methodology. Methodology 7:39–55. https://doi.org/10.1027/1614-2241/a000021

Fan H, Lederman R (2017) Online health communities: how do community members build the trust required to adopt information and form close relationships? Eur J Inf Syst 9344:1–28. https://doi.org/10.1080/0960085X.2017.1390187

Fu PP, Tsui AS, Liu J, Li L (2010) Pursuit of whose happiness? executive leaders’ transformational behaviors and personal values. Adm Sci Q 55:222–254. https://doi.org/10.2189/asqu.2010.55.2.222

Gable GG, Sedera D, Chan T (2008) Re-conceptualizing information system success: the IS-impact measurement model. J Assoc Inf Syst 9:377–408. https://doi.org/10.17705/1jais.00164

Gauzente C (2013) Une invitation illustrée à utiliser la Q-method dans les recherches en systèmes d’Information. Systèmes D’information Manag 18:69–109. https://doi.org/10.3917/sim.132.0069

Gefen D, Larsen K (2017) Controlling for lexical closeness in survey research: a demonstration on the technology acceptance model. J Assoc Inf Syst 18:727–757. https://doi.org/10.17705/1jais.00469

Gerlach J, Widjaja T, Buxmann P (2015) Handle with care: how online social network providers ’ privacy policies impact users ’ information sharing behavior. J Strateg Inf Syst 24:33–43. https://doi.org/10.1016/j.jsis.2014.09.001

Ghasemi E, Sheikh-Zadeh A, Song J (2023) Effort as investment in healthcare dialogue-based agents: on the role of means-goal configurations. Decis Support Syst 169:113943. https://doi.org/10.1016/j.dss.2023.113943

Gold AH, Malhotra A, Segars AH (2001) Knowledge management: an organizational capabilities perspective. J Manag Inf Syst 18:185–214. https://doi.org/10.1080/07421222.2001.11045669

Goyal S, Venkatesh V, Shi X (2022) Role of users’ status quo on continuance intentions. Inf Manag. https://doi.org/10.1016/j.im.2022.103686

Grgecic D, Holten R, Rosenkranz C (2015) The impact of functional affordances and symbolic expressions on the formation of beliefs. J Assoc Inf Syst 16:580–607. https://doi.org/10.17705/1jais.00402

Grover V, Jeong SR, Kettinger WJ, Teng JTC (1995) The implementation of business process reengineering. J Manag Inf Syst 12:109–144. https://doi.org/10.1080/07421222.1995.11518072

Grover V, Segars AH (2005) An empirical evaluation of stages of strategic information systems planning: patterns of process design and effectiveness. Inf Manag 42:761–779. https://doi.org/10.1016/j.im.2004.08.002

Guillemette MG, Laroche M, Cadieux J (2014) Defining decision making process performance: conceptualization and validation of an index. Inf Manag 51:618–626. https://doi.org/10.1016/j.im.2014.05.012

Hardin A, Chang JC, Fuller MA (2008) Formative vs. reflective measurement: comment on marakas, Johnson, and Clay (2007). J Assoc Inf Syst 9:519–534. https://doi.org/10.17705/1jais.00170

Hübner-Bloder G, Ammenwerth E (2009) key performance indicators to benchmark hospital information systems - a delphi study. Methods Inf Med 48:508–518. https://doi.org/10.3414/ME09-01-0044

Jahng J, Jain H, Ramamurthy K (2007) Effects of interaction richness on consumer attitudes and behavioral intentions in e-commerce: some experimental results. Eur J Inf Syst 16:254–269. https://doi.org/10.1057/palgrave.ejis.3000665

Kaplan B, Duchon D (1988) Combining qualitative and quantitative methods in information systems research: a case study. MIS Q. https://doi.org/10.2307/249133

Karhade PP, Dong JQ (2021) Innovation outcomes of digitally enabled collaborative problemistic search capability. MIS Q 45:693–718. https://doi.org/10.25300/MISQ/2021/12202

Kayhan VO (2015) The nature, dimensionality, and effects of perceptions of community governance. Inf Manag 52:18–29. https://doi.org/10.1016/j.im.2014.10.004

Kendall JE, Kendall KE (1993) Metaphors and methodologies: living beyond the systems machine. MIS Q 17:149–168. https://doi.org/10.2307/249799

Kendall JE, Kendall KE (1994) Metaphors and their meaning for information systems development. Eur J Inf Syst 3:37–47. https://doi.org/10.1057/ejis.1994.5

Kettinger WJ, Teng JTC, Guha S (1997) Business process change: a study of methodologies, techniques, and tools. MIS Q. https://doi.org/10.2307/249742

Klaus T, Wingreen SC, Blanton JE (2010) Resistant groups in enterprise system implementations: a Q-methodology examination. J Inf Technol 25:91–106. https://doi.org/10.1057/jit.2009.7

Kohn V, Frank M, Holten R (2023) How sociotechnical realignment and sentiments concerning remote work are related – insights from the COVID-19 pandemic. Bus Inf Syst Eng 65:259–276. https://doi.org/10.1007/s12599-023-00798-8

Kratzer S, Westner M, Strahringer S (2023) Factors for fractional CIO engagement success. Inf Manag 60:103793. https://doi.org/10.1016/j.im.2023.103793

Lee AS (2001) Research in Information Systems: What We Haven’t Learned. MIS Q 25:Xii–Xiii

Li S, Lin B (2006) Accessing information sharing and information quality in supply chain management. Decis Support Syst 42:1641–1656. https://doi.org/10.1016/j.dss.2006.02.011

Liang H, Xue Y, Pinsonneault A, Wu Y (2019) What users do besides problem-focused coping when facing it security threats: an emotion-focused coping perspective. MIS Q 43:373–394. https://doi.org/10.25300/MISQ/2019/14360

Lincoln YS, Guba EG (1985) Naturalistic inquiry. Sage Publications, Beverly Hills

Book   Google Scholar  

Liu Y, Tang X, Bush A (2021) Intra-platform competition: the role of innovative and refinement evolution in app success. Inf Manag 58:103521. https://doi.org/10.1016/j.im.2021.103521

Lokuge S, Sedera D, Grover V, Dongming X (2019) Organizational readiness for digital innovation: development and empirical calibration of a construct. Inf Manag 56:445–461. https://doi.org/10.1016/j.im.2018.09.001

Lowry PB, Moody GD, Gaskin JE et al (2013) Evaluating journal quality and the association for information systems senior scholars’ journal basket via bibliometric measures: do expert journal assessments add value ? MIS Q 37:993–1012. https://doi.org/10.25300/MISQ/2013/37.4.01

Lu R, Chatman JA, Goldberg A, Srivastava SB (2023) Two-sided cultural fit: the differing behavioral consequences of cultural congruence based on values versus perceptions. Organ Sci. https://doi.org/10.1287/orsc.2023.1659

Lu Y, Ramamurthy (Ram) K (2011) Understanding the link between information technology capability and organizational agility: an empirical examination. MIS Q 35:931–954. https://doi.org/10.2307/41409967

Luo J, Ba S, Zhang H (2012) The effectiveness of online shopping characteristics and well-designed websites on satisfaction. MIS Q 36:1131–1144. https://doi.org/10.2307/41703501

McKeown B (1984) Q methodology in political psychology: theory and technique in psychoanalytic applications. Polit Psychol 5:415–436. https://doi.org/10.2307/3790885

McKeown M, Thomas D (1988) Q-methodology. Sage, Newbury Park, CA

McKeown B, Thomas DB (2013) Q Methodology. Sage Publications, Second Edi

McMurtrey ME, Grover V, James TC (2002) Job satisfaction of information technology workers: the impact of career orientation and task automation in a CASE environment. J Manag Inf Syst 19:273–302. https://doi.org/10.1080/07421222.2002.11045719

Messerschmidt CM, Hinz O (2013) Explaining the adoption of grid computing: an integrated institutional theory and organizational capability approach. J Strateg Inf Syst 22:137–156. https://doi.org/10.1016/j.jsis.2012.10.005

Mettler T, Sprenger M, Winter R (2017) Service robots in hospitals: new perspectives on niche evolution and technology affordances. Eur J Inf Syst 26:451–468. https://doi.org/10.1057/s41303-017-0046-1

Mettler T, Wulf J (2019) Physiolytics at the workplace: affordances and constraints of wearables use from an employee’s perspective. Inf Syst J 29:245–273. https://doi.org/10.1111/isj.12205

Mikalef P, Pateli A, Van De WR (2020) IT architecture flexibility and IT governance decentralisation as drivers of IT-enabled dynamic capabilities and competitive performance: the moderating effect of the external environment. Eur J Inf Syst. https://doi.org/10.1080/0960085X.2020.1808541

Moody JW, Blanton JE, Cheney PH (1998) A Theoretically grounded approach to assist memory recall during information requirements determination. J Manag Inf Syst 15:79–98. https://doi.org/10.1080/07421222.1998.11518197

Moore P, Piwek L (2017) Regulating wellbeing in the brave new quantified workplace. Empl Relations 39:308–316. https://doi.org/10.1108/ER-06-2016-0126

Nadkarni S, Gupta R (2007) A task-based model of perceived website complexity. MIS Q 31:501–524. https://doi.org/10.2307/25148805

Nehme A, George JF (2022) Approaching IT security & avoiding threats in the smart home context. J Manag Inf Syst 39:1184–1214. https://doi.org/10.1080/07421222.2022.2127449

Nurhas I, Geisler S, Pawlowski JM (2019) Why Should the Q-Method be Intergrated into the Design Science Research? A systematic Mapping Study. In: Tenth Scandinavian Conference on Information Systems. pp 1–18

Oberländer AM, Röglinger M, Rosemann M et al (2017) Conceptualizing business-to-thing interactions – a sociomaterial perspective on the internet of things. Eur J Inf Syst 9344:1–17. https://doi.org/10.1080/0960085X.2017.1387714

Oberländer AM, Röglinger M, Rosemann M (2021) Digital opportunities for incumbents – a resource-centric perspective. J Strateg Inf Syst. https://doi.org/10.1016/j.jsis.2021.101670

Ockwell DG (2008) “Opening up” policy to reflexive appraisal: a role for q methodology? A case study of fire management in Cape York, Australia. Policy Sci 41:263–292. https://doi.org/10.1007/sll077-008-9066-y

Orlikowski WJ (2010) The sociomateriality of organisational life: considering technology in management research. Cambridge J Econ 34:125–141. https://doi.org/10.1093/cje/bep058

Ou CX, Pavlou PA, Davison RM (2014) Swift guanxi in onlie marketplaces: the role of computer-mediated communication technologies. MIS Q 38:209–230. https://doi.org/10.25300/MISQ/2014/38.1.10

Petticrew M, Roberts H (2016) Systematic reviews in the social sciences: a practical guide. Blackwell Pub

Ponsignon F, Maull RS, Smart A (2014) Four archetypes of process improvement: a Q-methodological study. Int J Prod Res 52:4507–4525. https://doi.org/10.1080/00207543.2013.867086

Rousseau DM, Manning J, Denyer D (2008) Evidence in management and organizational science: assembling the field’s full weight of scientific knowledge through syntheses. Acad Manag Ann. https://doi.org/10.2139/ssrn.1309606

Ryan SD, Harrison DA, Schkade LL (2000) Considering social subsystem costs and benefits in information technology investment decisions: a view from the field on anticipated payoffs. J Manag Inf Syst 16:11–40. https://doi.org/10.1080/07421222.2002.11045725

STEPHENSON W (1935) Technique of factor analysis. Nature 136(3434):297–297. https://doi.org/10.1038/136297b0

Saeed KA, Abdinnour-Helm S (2008) Examining the effects of information system characteristics and perceived usefulness on post adoption usage of information systems. Inf Manag 45:376–386. https://doi.org/10.1016/j.im.2008.06.002

Saeed KA, Grover V, Hwang Y (2005) The relationship of E-commerce competence to customer value and firm performance: An empirical investigation. J Manag Inf Syst 22:223–256. https://doi.org/10.1080/07421222.2003.11045835

Sarker S, Chatterjee S, Xiao X, Elbanna A (2019) The sociotechnical axis of cohesion for the is discipline: its historical legacy and its continued relevance. MIS Q 43:695–719. https://doi.org/10.25300/MISQ/2019/13747

Schwartz DG (2014) Research commentary: the disciplines of information: lessons from the history of the discipline of medicine. Inf Syst Res 25:205–221. https://doi.org/10.1287/isre.2014.0516

Sedera D, Dey S (2013) User expertise in contemporary information systems: conceptualization, measurement and application. Inf Manag 50:621–637. https://doi.org/10.1016/j.im.2013.07.004

Sedera D, Lokuge S, Atapattu M, Gretzel U (2017) Likes—the key to my happiness: The moderating effect of social influence on travel experience. Inf Manag 54:825–836. https://doi.org/10.1016/j.im.2017.04.003

Sedera D, Lokuge S, Grover V et al (2016) Innovating with enterprise systems and digital platforms: a contingent resource-based theory view. Inf Manag 53:366–379. https://doi.org/10.1016/j.im.2016.01.001

Sedera D, Lokuge S, Grover V (2022) Modern-day hoarding: a model for understanding and measuring digital hoarding. Inf Manag 59:103700. https://doi.org/10.1016/j.im.2022.103700

Segars AH, Grover V (1998) Strategic information systems planning success: an investigation of the construct and its measurement. MIS Q 22:139–163. https://doi.org/10.2307/249393

Segars AH, Grover V (1999) Profiles of strategic information systems planning. Inf Syst Res 10:199–232. https://doi.org/10.1287/isre.10.3.199

Shamseer L, Moher D, Clarke M et al (2015) Preferred reporting items for systematic review and meta-analysis protocols (prisma-p) 2015: elaboration and explanation. BMJ 349:1–25. https://doi.org/10.1136/bmj.g7647

Sharma PN, Daniel SL, Chung (Rachel) T, Grover V (2022) A motivation-hygiene model of open source software code contribution and growth. J Assoc Inf Syst 23:165–195. https://doi.org/10.17705/1jais.00712

Sheth JN (1967) A review of buyer behavior. Manage Sci 18:718–756. https://doi.org/10.1287/mnsc.13.12.B718

Shi Y, Cui T, Kurnia S (2023) Value co-creation for digital innovation: an interorganizational boundary-spanning perspective. Inf Manag 60:103817. https://doi.org/10.1016/j.im.2023.103817

Shi Y, Cui T, Liu F (2022) Disciplined autonomy: how business analytics complements customer involvement for digital innovation. J Strateg Inf Syst 31:101706. https://doi.org/10.1016/j.jsis.2022.101706

Simon SJ (2000) The reorganization of the information systems of the US naval construction forces: an action research project. Eur J Inf Syst. https://doi.org/10.1057/palgrave/ejis/3000363

Smith SP, Johnston RB, Howard S et al (2011) Putting yourself in the picture : an evaluation of virtual model technology as an online shopping tool. Inf Syst Res 22:640–659. https://doi.org/10.1287/isre.1090.0279

Stainton Rogers R (1995) Q methodology. In: Smith J, Harre R, Van Langenhove L (eds) Rethinking methods in psychology. Sage, New York, NY, pp 178–207

Chapter   Google Scholar  

Steelman TA, Maguire LA (1999) Understanding participant perspectives: Q-methodology in national forest management. J Policy Anal Manag 18:361–388

Stenner P, Stainton Rogers R (2004) Q methodology and qualiquantology: the example of discriminating between emotions. In: Todd Z, Nerlich B, McKeown S, Clarke DD (eds) Mixing methods in psychology: the integration of qualitative and quantitative methods in theory and practice. Psychology Press, Hove, UK, pp 101–120

Stephenson W (1936) The inverted factor technique. Br J Psychol 26:344–361

Stephenson W (1986) Protoconcursus: the concourse theory of communication. Operant Subj 9:73–96

Sun H (2012) Understanding user revisions when using information systems features: adaptive system use and triggers. MIS Q 36:453–478

Sutton SG, Hampton C, Khazanchi D, Arnold V (2008) Risk analysis in extended enterprise environments: identification of critical risk factors in B2B E-commerce relationships. J Assoc Inf Syst 9:151–174

Söllner M, Bitzer P, Janson A, Leimeister JM (2018) Process is king: evaluating the performance of technology-mediated learning in vocational software training. J Inf Technol 33:233–253. https://doi.org/10.1057/s41265-017-0046-6

Tarafdar M, Weitzel T, Maier C, Laumer S (2019) Explaining the link between technostress and technology addiction for social networking sites : a study of distraction as a coping behavior. Inf Syst. https://doi.org/10.1111/isj.12253st

Thomas DB, Baas LR (1993) The issue of generalization in q methodology: “reliable schematics” revisited. Operant Subj 16:18–36. https://doi.org/10.22488/okstate.92.100599

Thomas DM, Watson RT (2002) Q-sorting and MIS research: a primer. Commun ACM 8:141–156. https://doi.org/10.17705/1CAIS.00809

Torres R, Sidorova A, Jones MC (2018) Enabling firm performance through business intelligence and analytics: a dynamic capabilities perspective. Inf Manag 55:822–839. https://doi.org/10.1016/j.im.2018.03.010

Tractinsky N, Jarvenpaa SL (1995) Information systems design decisions in a global versus domestic context. MIS Q 19:507–529. https://doi.org/10.2307/249631

Trist EL, Bamforth KW (1951) Some social and psychological consequences of the longwall method of coal getting. Hum Relations 4:3–38. https://doi.org/10.1177/001872675100400101

Tsai JCA, Hung SY (2019) Examination of community identification and interpersonal trust on continuous use intention: evidence from experienced online community members. Inf Manag 56:552–569. https://doi.org/10.1016/j.im.2018.09.014

van Exel J, de Graaf G (2005) Q methodology: a sneak preview

Varella P, Javidan M, Waldman DA, Varella P (2012) A model of instrumental networks: the roles of socialized charismatic leadership and group behavior. Organ Sci 23:582–595. https://doi.org/10.1287/orsc.1100.0604

vom Brocke J, Simons A, Niehaves B, et al (2009) Reconstructing the giant: on the importance of rigour in documenting the literature search process. In: ECIS 2009 Proceedings

Wallace L, Keil M, Rai A (2004) How software project risk affects project performance: an investigation of the dimensions of risk and an exploratory model. Decis Sci 35:289–321. https://doi.org/10.1111/j.00117315.2004.02059.x

Watts S, Stenner P (2005) Doing Q methodology: theory, method and interpretation. Qual Res Psychol 2:67–91. https://doi.org/10.1191/1478088705qp022oa

Wiesböck F, Hess T, Spanjol J (2020) The dual role of IT capabilities in the development of digital products and services. Inf Manag. https://doi.org/10.1016/j.im.2020.103389

Williams R, Pollock N (2012) Research commentary: moving beyond the single site implementation study: how (and why) we should study the biography of packaged enterprise solutions. Inf Syst Res 23:1–22. https://doi.org/10.1287/isre.1110.0352

Wingreen SC, Blanton JE (2018) IT professionals’ person–organization fit with IT training and development priorities. Inf Syst J 28:294–317. https://doi.org/10.1111/isj.12135

Wolf M, Beck R, Pahlke I (2012) Mindfully resisting the bandwagon: reconceptualising IT innovation assimilation in highly turbulent environments. J Inf Technol 27:213–235. https://doi.org/10.1057/jit.2012.13

Wu Y, “Andy”, Saunders CS, (2016) Governing the fiduciary relationship in information security services. Decis Support Syst 92:57–67. https://doi.org/10.1016/j.dss.2016.09.008

Zabala A (2014) qmethod: a package to explore human perspectives using Q methodology. R J 6:163–173. https://doi.org/10.32614/rj-2014-032

Zabala A, Sandbrook C, Mukherjee N (2018) When and how to use Q methodology to understand perspectives in conservation research. Con Bio 32:5. https://doi.org/10.1111/cobi.13123

Zhang X, Stafford TF, Dhaliwal JS et al (2014) Sources of conflict between developers and testers in software development. Inf Manag 51:13–26. https://doi.org/10.1016/j.im.2013.09.006

Zhu Z, Zhao J, Tang X, Zhang Y (2015) Leveraging e-business process for business value: A layered structure perspective. Inf Manag 52:679–691. https://doi.org/10.1016/j.im.2015.05.004

Download references

Acknowledgements

This research was funded in part by the Luxembourg National Research Fund (FNR) and PayPal, PEARL grant reference 13342933/Gilbert Fridgen. For the purpose of open access, the authors have applied a Creative Commons Attribution 4.0 International (CC BY 4.0) license to any Author Accepted Manuscript version arising from this submission.

Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and affiliations.

Chair of Information Systems Engineering, Goethe University Frankfurt, Theodor-W.-Adorno-Platz 4, 60323, Frankfurt am Main, Germany

Muriel Frank, Vanessa Kohn & Roland Holten

SnT - Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg, Luxembourg, Luxembourg

Muriel Frank

You can also search for this author in PubMed   Google Scholar

Corresponding author

Correspondence to Vanessa Kohn .

Additional information

Publisher's note.

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

See Tables 3 , 4 and 5 .

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .

Reprints and permissions

About this article

Frank, M., Kohn, V. & Holten, R. Q methodology and the sociotechnical perspective. Inf Syst E-Bus Manage (2024). https://doi.org/10.1007/s10257-024-00679-x

Download citation

Received : 13 October 2022

Revised : 15 December 2023

Accepted : 13 February 2024

Published : 09 June 2024

DOI : https://doi.org/10.1007/s10257-024-00679-x

Share this article

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

• Q methodology
• Systematic literature review
• Sociotechnical perspective
• STS framework
• Find a journal
• Publish with us
• Track your research