This continues my response to Christina Silver’s tweet and blog post. While my initial response to one aspect of that argument was pretty simple this is the much more substantive consideration.
From my perspective qualitative research reached a crossroads a while ago, though actually I think crossroads is the wrong term here. A crossroads requires a decision, it is a place steeped in mystery and mythology (see https://en.wikipedia.org/wiki/Crossroads_(mythology) ), I sometimes feel as though qualitative research did a very british thing: turned a crossroads into a roundabout thus enabling driving round and round rather than moving forwards or making a decision.
The crossroads was the explosion in the availability of qualitative data. Previously access to accounts of experience were rather limited – you had to go into the field and write about it, find people to interview, or use the letters pages of newspapers as a site of public discourse. These paper-based records were slow and time consuming to assemble, construct and analyse. For the sake of the metaphor that follows I shall refer to these as “the cavalry era” of qualitative research. Much romanticised and with doctrines that still dominate from the (often ageing, pre-digital) professoriat.
Then the digital didn’t so much happen as explode and social life expanded or shifted online:
For researchers used to gathering data in the offline world, one of the striking characteristics of online research is the sheer volume of data. (Blank, 2008, P539)
BUT…
Qualitative analysts have mostly reacted to their new-found wealth of data by ignoring it. They have used their new computerized analysis possibilities to do more detailed analysis of the same (small) amount of data. Qualitative analysis has not really come to terms with the fact that enormous amounts of qualitative data are now available in electronic form. Analysis techniques have not been developed that would allow researchers to take advantage of this fact. (Blank, 2008, P.548)
Furthermore the same methods continue to dominate – the much vaunted reflexivity that lies at the heart of claims for authenticity and trustworthiness does not seem to have been extended to tools, methods:
Over the past 50 years the habitual nature of our research practice has obscured serious attention to the precise nature of the devices used by social scientists (Platt 2002, Lee 2004). For qualitative researchers the tape-recorder became the prime professional instrument intrinsically connected to capturing human voices on tape in the context of interviews. David Silverman argues that the reliance on these techniques has limited the sociological imagination: “Qualitative researchers’ almost Pavlovian tendency to identify research design with interviews has blinkered them to the possible gains of other kinds of data” (Silverman 2007: 42). The strength of this impulse is widely evident from the methodological design of undergraduate dissertations to multimillion pound research grant applications. The result is a kind of inertia, as Roger Stack argues: “It would appear that after the invention of the tape-recorder, much of sociology took a deep sigh, sank back into the chair and decided to think very little about the potential of technology for the practical work of doing sociology” (Slack 1998: 1.10).
My concern with the approach presented and advocated by Silver and Woolf is that it holds the potential to reinforce and prolong this inertia. There are solid arguments FOR that position – especially given the conservatism of academia, mistrust of software and the apparently un-slayable discourses (Paulus, lester & Britt, 2013), entrenched critical views and misconceptions of QDAS software that “by its very nature decontextualizes data or primarily supports coding [which] have caused concerned researchers” (Paulus, Woods, Atkins and Macklin, 2017)
BUT… BUT… BUT…
New technologies enable new things – when they first arrive they are usually perhaps inevitably and restrictively fitted in to pre-existing approaches and methods, made subservient to old ways of doing things.
A metaphor – planes, tanks and tactics
I’ve been trying to think of a metaphor for this. The one I’ve ended up with is particularly militaristic and I’m not entirely comfortable with it – especially as metaphors sometimes invite over-extension which I fear may happen here. It also feels rather jingoistically “Boys Own” and British and may be alienating to key developers and methodologists in Germany. So comments on alternative metaphors would be MOST welcome, however given the rather martial themes around strategies and tactics used in Silver and Woolf’s (2015) paper and models for 5level QDA I’ll stick with it and explore tactics, strategies and technologies and how they historically related to two new technologies: the tank and the plane.
WW1 saw the rapid development of new and terrifying technologies in collision with old tactics and strategies for their use. The overarching strategies were the same (defeat the enemy) however the tactics used failed to take account of the potential of these new tools thus restricting their potential.
Cavalry were still deployed at the start of WW1. Even with the invention of tanks the tactics used in their early deployments were for mounted cavalry to follow up the breakthroughs achieved by tanks – with predictably disastrous failure at the battle of cambrai see https://en.wikipedia.org/wiki/Tanks_in_World_War_I#Battle_of_Cambrai ).
Planes were deployed from early in WW1 but in very limited capacities – as artillery spotters and as reconnaissance. Their potential to change warfare tactics were barely recognised nor exploited.
These strategies were developed by generals from an earlier era – still wedded to the cavalry charge as the ultimate glory. (See https://en.wikipedia.org/wiki/Cavalry#First_World_War ). Which seems to be a rather appropriate metaphor for professorial supervision today with regard to junior academics and PhD students.
The point I’m seeking to make is to suggest that new technologies vary in their complexity, but they also vary in their potential. Old methods of working are used with new technologies and the transformative potential of those new technologies on methods or tactics to achieve strategic aims is often far slower, and can be slowed further when there is little immediate incentive to change (unlike say a destructive war) in the face of an established doctrine.
My view is therefore that those who do work with and seek to innovate with CAQDAS tools need to seek to do more than just fit in with the professorial field-marshall Haig’s of our day and talk in terms of CAQDAS being “fine for breaching the front old chap you know use CAQDAS to open up the data but you send in the printouts and transcripts to really do the work of harrying the data, what what old boy”.
Meanwhile Big Data is the BIG THING – and this entire sphere of large datasets and access to public discourse and digital social life threatens to be ceded entirely to quantitative methods. Yet we have tools, methods and tactics to engage in that area meaningfully by drawing on existing approaches which have always been both qual and quant (with corpus linguistics and content analysis springing to mind).
Currently the scope of any transformation seems to be pitched to taking strategies from a “cavalry era” of qualitative research. My suggestion is that to realise the full potential of some of the tools now available in order to generate new, and extend existing, qualitative analysis practices into the diverse new areas of digital social life and digital social data we need to be bolder in proposing what these tools can achieve and what new questions and datasets can be worked with. And that means developing new strategies to enter new territories – which need to understand the potential of these tools and explore ways that they can transform and extend what is possible.
If, however, we were to place the potential of these tools as subservient to existing strategies and to attempt to locate all of the agency for their use with the user and the way that we “configure the user” (Grint and Woolgar, 1997) in relation to these tools through our pedagogies and demonstrations we could limit those potentials. Using NVivo Plus or QDA Miner/WordSTAT to reproduce what could be done with a tape recorder, paper, pen and envelopes seems akin to sending horses chasing after tanks. What I am advocating for (as well, not instead) is to also try to work out what a revolutionary engagement with the potential of the new tools we have would look like for qualitative analysis with big unstructured qualitative data and big unstructured qualitatitve data-ready tools.
To continue the parallel here – the realisation of what could be accomplish by combining the new technologies of tanks and planes together created an entirely new form of attacking warfare – named Blitzkrieg by the journalists who witnessed its lightning speed. This was developed to achieve the same overarching strategies as deployed in WW1 (conquering the enemy) but by considering the potential and integration of new tools it developed a whole new mid-level strategy and associated tactics that utilised and realised the potential of those relatively new technologies. Thus it avoided becoming bogged down in the nightmare of using the strategies and tactics from a bygone era of pre-industrial warfare with new technologies that prevented their effectiveness which dominated in WW1. My suggestion is that there is a new territory now – big data – and it is one that is being rapidly and extensively ceded to a very quantitative paradigm and methods. To make the kind of rapid advances into that territory in order to re-establish qualitative analysis as having relevance we need to be bolder in developing new strategies that utilise the tools rather than making these subservient to strategies from an earlier era in deference to a frequently luddite professoriat.
My argument thus simplifies to the idea that the potential of tools can and should productively shape not only the planning and consideration the territories now amenable to exertion and engagement but also the strategies and tactics to do that. Doing that involves engagement with the conceptualisation, design and thinking about what qualitative or mixed-methods studies are and what they can do in order that this potential is realised. From this viewpoint Blitzkrieg was performed into being by the new technologies of the tank and the plane and their combination with new strategies and tactics. These contrast with the earlier subsuming of the plane’s potential to merely being tools to achieve strategies that were conceptualised before its existence. A plane was there equivalent to a tree or a balloon for spotting cannon fire. Much of CAQDAS use today seems to be just like this – sending horses chasing after tanks – rather than seeking to achieve things that couldn’t be done without it and celebration that.
This is all rather abstract I know so I’ve tried to extend and apply this into a consideration of implementation in practice working with large unstructured datasets in a new post.
References
Back L. (2010) Broken Devices and New Opportunities: Re-imagining the tools of Qualitative Research. ESRC National Centre for Research Methods
Available from: http://eprints.ncrm.ac.uk/1579/1/0810_broken_devices_Back.pdf
Citing:
Lee, R. M. (2004) ‘Recording Technologies and the Interview in Sociology, 1920-2000’, Sociology, 38(5): 869-899
E-Print available at: https://repository.royalholloway.ac.uk/file/046b0d22-f470-9890-79ad-b9ca08241251/7/Lee_(2004).pdf
Platt, J. (2002) ‘The History of the Interview,’ in J. F. Gubrium and J. A. Holstein (eds) Handbook of the Interview Research: Context and Method, Thousand Oaks, CA: Sage pp. 35-54.
Limited Book Preview available at https://books.google.co.uk/books?id=uQMUMQJZU4gC&lpg=PA27&dq=Handbook%20of%20the%20Interview%20Research%3A%20Context%20and%20Method&pg=PA27#v=onepage&q=Handbook%20of%20the%20Interview%20Research:%20Context%20and%20Method&f=false
Silverman D. (2007) A very short, fairly interesting and reasonably cheap book about qualitative research, Los Angeles, Calif.: SAGE.
Limited Book Preview at: https://books.google.co.uk/books?id=5Nr2XKtqY8wC&lpg=PP1&pg=PP1#v=onepage&q&f=false
Slack R. (1998) On the Potentialities and Problems of a www based naturalistic Sociology. Sociological Research Online 3.
Available from: http://socresonline.org.uk/3/2/3.html
Blank G. (2008) Online Research Methods and Social Theory. In: Fielding N, Lee RM and Blank G (eds) The SAGE handbook of online research methods [electronic resource]. Los Angeles, Calif. ; London : SAGE.
Grint K and Woolgar S. (1997) Configuring the user: inventing new technologies. The machine at work: technology, work, and organization. Cambridge, Mass.: Polity Press, 65-94.
Paulus TM, Lester JN and Britt VG. (2013) Constructing Hopes and Fears Around Technology. Qualitative Inquiry 19: 639-651.
Paulus T, Woods M, Atkins DP, et al. (2017) The discourse of QDAS: reporting practices of ATLAS.ti and NVivo users with implications for best practices. International Journal of Social Research Methodology 20: 35-47.
Silver C and Woolf NH. (2015) From guided-instruction to facilitation of learning: the development of Five-level QDA as a CAQDAS pedagogy that explicates the practices of expert users. International Journal of Social Research Methodology 18: 527-543.
ATLAS.ti and NVivo training, consultancy, research and support 