Introduction and Overview

Earlier lessons gave you the upstream apparatus of a qualitative project: an operational definition of QDA, a research question, a sampling logic, and a data-collection procedure. You now arrive at the central act of the analysis. You have transcripts. You have read them. You sense that something is going on across them. You suspect there are patterns. The question of this lesson is: how do you find those patterns systematically, and how do you record what you find in a form another analyst could follow?

Two activities sit at the heart of analytic work on text: finding themes and building a codebook. These twin moves are the connective tissue of every major qualitative analytic tradition, from thematic analysis (Braun & Clarke, 2006; Braun & Clarke, 2019) through qualitative content analysis (Hsieh & Shannon, 2005) to the systematic coding manuals used in applied health research (Saldaña, 2021). They are tightly coupled but not the same. Finding themes is the discovery phase: the search for what recurs, what surprises, what is missing, what coheres. Building a codebook is the codification phase: turning what you found into operational rules that you (and other analysts) can apply consistently across the rest of the corpus. This lesson works through both, drawing on Chapters 5 and 6 of Bernard, Wutich, and Ryan (2017).

1.1 Themes, Codes, Categories, Concepts: A Precise Vocabulary

The terms theme, code, category, and concept get used interchangeably in much of the published qualitative literature, including in papers that are otherwise methodologically careful. Bernard, Wutich, and Ryan (2017, Ch. 5) are precise where most writers are not. Adopting their vocabulary will save you grief when you write your methods section and will save the reader confusion about what you actually did.

A theme is a recurring abstract idea you identify in the data. It is the analyst's product. “Loneliness as the cost of love” is a theme. “Spatial metaphor for absence” is a theme. Themes are typically expressed as short phrases rather than single words. They sit at a higher level of abstraction than the individual statements that supply evidence for them.

A code is the operational label you attach to a segment of text to mark what that passage is about. Codes are the working units of analysis: they are what you actually mark up in Taguette or NVivo. A single theme may be supported by several codes; a single passage may receive multiple codes. The code is the marker; the theme is what the markers, when assembled, are about.

A category is a grouping of related codes. In a hierarchical codebook, categories are the parent nodes and codes are the children. “Coping strategies” is a category that might contain codes for “phoning a confidant,” “watching comfort television,” “going to a coffee shop to be around people,” and “cooking food from home.” The category organizes; the codes do the marking.

A concept is the most abstract of the four. A concept is a theoretically meaningful idea that may organize many themes. Liminality is a concept. Embodiment is a concept. Structural exclusion is a concept. Concepts are typically borrowed from theoretical literatures and used to organize themes into something a discipline can argue about.

The hierarchy also describes an order of work. Saldaña (2021) divides coding into two cycles. First-cycle coding is the initial labelling of data segments: you read a transcript and attach codes to passages, usually staying close to what was said. Second-cycle coding works on those codes rather than on the raw text: you group, compare, and reorganize them into categories and then into themes. Codes therefore come first, and themes are built from them. A code such as chair-absent-spouse is applied in the first cycle; the theme about objects standing in for absent people is assembled in the second, once several codes and many passages point the same way. Section 1.4 shows how thematic analysis organizes the two cycles into phases, and Section 3.3 returns to them when it introduces axial coding.

1.2 Ryan and Bernard's Twelve Techniques for Finding Themes

In a now-classic 2003 paper, Gery Ryan and H. Russell Bernard (2003) catalogued twelve techniques qualitative researchers use to find themes. The paper became foundational because it disaggregated what had previously been described as “immersion” or “reading deeply” into a set of specifiable operations. Bernard, Wutich, and Ryan (Ch. 5) reproduce and update the list. Each technique answers a slightly different question about the data, and most projects use several in combination. Below we work through all twelve, with examples drawn from the loneliness dataset.

Technique 1: Repetitions

The most obvious technique. What words, phrases, ideas recur across transcripts? If multiple participants reach for the same word to describe something, that word is doing analytic work. In the loneliness corpus, the word chair appears in at least eight transcripts as a stand-in for an absent person: Linda's “Bill's chair,” Frank's chair, Helen's mention of the chair her brother used to sit in when he visited, and others. The word tired recurs across caregiver and bereaved participants in a way that goes beyond ordinary fatigue: it appears to mark a specific exhaustion of grieving-as-work. Repetition is what nearly all theme-finding starts with, and what every other technique builds on.

Technique 2: Indigenous Typologies and Categories (Emic Terms)

What categories do participants themselves use? When a participant reaches for a non-English word, a slang term, or a phrase that operates as a category in their world, the analyst should pay attention. In the loneliness corpus, Amira uses the Arabic word wahda to name something that the English category of “loneliness” cannot fully hold, a loneliness specific to having been the sole survivor of a particular life. Aarav uses ekantam and ekakitatvam as paired Sanskrit-Hindi terms that distinguish chosen solitude from involuntary aloneness. Marcus speaks of “code-switching” loneliness, an experience he names that has no neat one-word English equivalent. These emic categories are gifts; they often become themes that organize an entire section of your eventual paper.

Technique 3: Metaphors and Analogies

People describe abstract experiences (especially feelings) by reaching for concrete images that map onto them. Cataloguing the metaphors a corpus uses is a powerful theme-finding move. The loneliness corpus is dense with spatial metaphors of absence and erosion: Maya feels “hollow” in her chest; Sarah describes loneliness as her “witness-less hours”; Helen describes it as “fading at the edges”; Frank uses imagery of a slow disappearance; Maya again talks about feeling she could “disappear and nobody would notice”; Linda talks about “walking around with that absence.” Read together, these metaphors converge: loneliness is repeatedly figured as a thinning or vanishing of the self. That convergence is a theme that you would never have seen if you had read the metaphors one at a time.

Technique 4: Transitions

What does the participant move to right after they say what they say? Transitions are turn-taking shifts and topic changes. They tell you what feels related in the participant's mind. In Linda's transcript, every passage about Bill's chair is followed by a passage about Rufus the dog: “I haven't moved it... the dog is what keeps me up in the morning.” The transition from the empty chair to the dog suggests an analytic linkage you might otherwise have missed: the dog is functioning as the affective replacement for the chair's absence. In Maya's transcript, the loneliness topic transitions repeatedly to her phone, then food, then TV, signalling that her coping repertoire is digitally mediated.

Technique 5: Similarities and Differences (Constant Comparison)

Read two passages side by side. What is the same? What is different? This is the constant-comparative move that Glaser and Strauss made foundational to grounded theory and that you will meet again in a later lesson. As a theme-finding technique, it is most useful when you have already identified candidate themes and want to test whether they hold up across subgroups. In the loneliness corpus, the bereaved-spouse loneliness of Linda (age 67, widow of three years) and Frank (age 81, widower of one year) share most features but differ on duration of mourning and the role of children: Linda's adult sons are present (David in Toronto, Michael in Calgary), while Frank's are estranged. The comparison sharpens the theme rather than dissolving it.

Technique 6: Linguistic Connectors

Words like because, since, as a result, therefore, that's why, and so are causal connectives. They mark places where the participant is explaining a relationship between events or states. Searching for them is a fast way to find passages where causal accounts of loneliness appear. Maya's transcript contains: “I just, I felt like everyone's life is still happening and I'm just here. Like I left and life closed up where I used to be.” The connective like here is not strictly causal but it is doing relational work. Linda's transcript: “If you love deeply for a long time, you will, eventually, be lonely deeply for a long time. The two are connected.” That explicit linkage of love and loneliness is a participant's own causal model, surfaced by attention to a connective.

Technique 7: Missing Data, What People Don't Say

What the corpus does not contain is as analytically informative as what it does. If you asked every participant about coping and three avoided answering, that pattern of avoidance is itself data. In the loneliness corpus, several participants conspicuously do not use the word “lonely” about themselves until very late in the interview, even though the interview is explicitly about loneliness. Marcus repeatedly substitutes “disconnected” or “invisible.” Older men in the corpus avoid the word in a way younger women do not. That gendered pattern of avoidance is a finding. Missing data is also useful at the level of what the interview guide asked but participants deflected: questions about professional help, in particular, are routinely deflected.

Technique 8: Theory-Related Material

Bernard, Wutich, and Ryan call this “looking through a theoretical lens.” If you bring a specific theory to the data, such as Cacioppo and Patrick's loneliness-versus-aloneness distinction, Weiss's social-emotional loneliness typology, structural/situational/existential models, you can deliberately scan the corpus for passages that confirm, complicate, or contradict the theory. This is more deductive than the previous seven techniques (which start from the data) and we will return to it when we distinguish inductive from deductive coding in a later section. As an example: Cacioppo and Patrick (2008) argue that loneliness and being alone are dissociable states. The loneliness corpus is full of explicit articulations of that distinction (Maya: “loneliness is different than being alone”; Helen: “I have lived alone all my adult life… the loneliness I have now is different from the solitude I had at 50”). The theoretical lens both helps you see the pattern and gives you a way to write about it.

Technique 9: Cutting and Sorting (The Pile-Sort)

A physical, tactile method. Print out striking quotes from your corpus, one per index card. Spread them out on a table. Group cards that feel related. Move cards around as your sense of groupings evolves. Give each group a name. This technique externalizes the analytic work and uses spatial cognition to find patterns that screen-based reading misses. It is especially useful when you have 20+ candidate themes and need to consolidate them into a manageable set. Bernard, Wutich, and Ryan recommend actual cutting-and-sorting (literal scissors) at least once per project; the tactile experience is what makes it work. We will do a digital version of this in a later section workflow.

Technique 10: Word Lists and KWIC (Keyword-in-Context)

Generate a frequency list of all words in the corpus and inspect the high-frequency content words (after removing stopwords like “the” and “and”). For words that catch your eye, generate a KWIC concordance: every occurrence of the word with a few words of context on either side. KWIC concordances are how you check whether participants are using a word the same way. If “chair” appears 23 times across the corpus, are all 23 instances chairs-as-stand-ins-for-people, or are some just literal pieces of furniture? The KWIC concordance answers that quickly. This is also the natural bridge to computational text analysis (a later module); a later section of this lesson works through a small word-list and KWIC exploration of the loneliness transcripts.

Technique 11: Co-occurrence

Which codes (or words) appear together more often than chance would predict? Co-occurrence is the first move toward axial coding (covered in a later section) and toward concept-mapping. If your code chair-absent-spouse co-occurs in nearly every transcript with codes for pet-as-companion or volunteer-coping, that co-occurrence is a finding. Co-occurrence is also how you build the network displays you will meet later in the course. Co-occurrence is straightforward to tabulate once your coded extracts are in a long-format table, with one row per passage and code.

Technique 12: Metacoding (Codes About Codes)

Once you have a working set of codes, you can step up a level and label the codes themselves. Are some of your codes affective (about feelings) and others behavioural (about coping actions)? Are some emic (using participants' own words) and others etic (using your analyst-imposed terminology)? Sorting your codes by type is metacoding, and it often reveals structural patterns in your codebook that you would not have seen by staring at the codes one at a time. In the loneliness corpus, a useful metacoding move is to sort all codes into four buckets: experiential (what loneliness feels like), causal (what triggers it), responsive (what people do about it), and interpretive (what people think it means). The four-bucket frame becomes a candidate structure for the findings section of your eventual paper.

1.3 Working an Example Through Four Techniques

Take three passages from the loneliness corpus and run them through four of the techniques to see how theme-finding actually works.

Technique 1 (Repetitions): All three passages reach for embodied descriptions of loneliness. The words physical, chest, weight, body, voice, real recur. Loneliness is a bodily experience for these participants, as much as a cognitive one.

Technique 3 (Metaphors): Three different metaphors, all converging on the same image. Maya: hunger, hollow, ache (interior absence). Linda: weight, half a life not there, walking around with absence (carrying something missing). Helen: fading, less real, voice strange (thinning of the self). The metaphors are not the same, but the analytic abstraction over them is: loneliness as the somatic register of an absence.

Technique 5 (Similarities and Differences): The three passages share embodiment but differ on what is absent. For Maya it is a future not yet built; for Linda it is a specific deceased person; for Helen it is the simple act of social contact. A theme that holds across the differences: the body registers absence as presence (you feel something missing as something there).

Technique 7 (Missing Data): Notice what none of the three say. None invokes psychiatric vocabulary. None mentions a therapist or a medication. None reaches for the word “depression” even though the descriptions are compatible with depressive symptomatology. The absence of clinical framing is itself a finding: these participants are describing loneliness as a normal embodied condition, not as a disorder. That has implications for how an intervention should be framed.

Four techniques applied to three passages have already moved from codes on single passages toward a candidate theme: loneliness as embodied absence, narrated outside clinical vocabularies. The codes that carry it, such as somatic-absence, go into the codebook, and the candidate theme is tested as more transcripts are coded. Section 1.4 sets out the procedure for that testing.

1.4 Thematic Analysis: From Codes to Themes

The vocabulary of Section 1.1 and the techniques of Sections 1.2 and 1.3 come together in thematic analysis, the most widely used procedure for moving from coded passages to reported themes. Braun and Clarke (2006) set out the procedure as six phases, and their later writing renamed several of them to stress that the analyst generates themes from codes (Braun & Clarke, 2019, 2021). The phases are recursive. You move back and forth between them, and a theme reviewed in Phase 4 can send you back to the coded data of Phase 2.

Three variants of thematic analysis

Braun and Clarke (2019, 2021) argue that thematic analysis is a family of methods rather than a single method. They distinguish three variants that differ in how codes and themes are produced and in what counts as quality.

• Coding-reliability thematic analysis uses a structured codebook, often developed early, which several coders apply independently, and it measures their agreement with statistics such as Cohen's kappa (Section 3.7). Themes are often summaries of what participants said about a topic and may be identified before coding begins. Boyatzis (1998) is a classic example. The approach treats coding as something that can be more or less accurate, an assumption close to postpositivism.
• Codebook thematic analysis also uses a structured codebook to organize and chart the data, but it does not measure agreement between coders. Framework analysis (Ritchie & Spencer, 1994) and template analysis (King, 2012) belong to this group. Themes are often partly developed in advance, and the approach suits applied team projects with fixed information needs.
• Reflexive thematic analysis treats coding as an open and organic process carried out by a researcher whose subjectivity is a resource for the analysis. It uses no fixed codebook and no measure of coder agreement. Themes are developed late, from codes, as patterns of shared meaning united by a central organizing concept, and quality rests on reflexivity, depth of engagement, and the coherence of the account.

The hybrid, codebook-based workflow taught in Sections 2 to 4 of this lesson belongs to the coding-reliability family, because it ends with an intercoder agreement statistic. Section 3.9 explains when that statistic is the wrong measure, and reflexive thematic analysis is one of those cases. A qualitative paper that reports themes and sub-themes should name the procedure that produced them, whether one of these variants or a named alternative such as framework analysis or grounded theory, and its quality claims should match that choice.

Worked example: two loneliness transcripts

Introduction and Overview

Section 1 ended with candidate themes, and the order in which they arose matters. Codes come first: first-cycle coding labels segments of text, and themes are built later, in second-cycle work, by grouping and comparing those codes (Sections 1.1 and 1.4). Ryan and Bernard's twelve techniques serve both moments. Repetitions, metaphors, and linguistic connectors guide first-cycle reading, while similarities and differences, co-occurrence, cutting and sorting, and metacoding guide the grouping of codes into themes. This section turns to the codes themselves and to the codebook that writes them down as operational rules applied consistently across the corpus, the bridge between recognition and analysis that Boyatzis (1998) and Braun and Clarke (2006) describe as central to rigorous thematic analysis. The two big design questions for coding are: where do the codes come from (inductive, deductive, or hybrid), and what does a defensible codebook look like (the architecture). This section addresses both.

2.1 Inductive Coding (Data-Up)

Inductive coding in practice follows a recognizable arc. After three or four transcripts, you have a working set of perhaps 30–50 provisional codes; you consolidate, merge, and rename until you have a coherent codebook of 8–15 codes you can apply across the remaining transcripts.

Inductive coding suits exploratory studies, under-described phenomena, and projects in the grounded-theory tradition (Lesson 7). Its risk is that, without theoretical anchoring, it can produce codebooks that are descriptive but not analytically interesting, what Charmaz (2014) warns against as “coding too close to the data.”

For the loneliness dataset, an inductive start is appropriate. The dataset is rich, the phenomenon is contested, and the participants speak in distinct vocabularies. Starting from their language is the right move.

2.2 Deductive Coding (Theory-Down)

Frameworks used for deductive coding in health research include the WHO determinants of health, the CFIR implementation framework, and the Cacioppo and Patrick loneliness model, and an interest holder may bring a framework of its own. When you code against one of them, codes that are not present in the data are recorded as absent, which is itself a result.

Deductive coding is the right move when you are testing or extending an existing framework, when you are working in a confirmatory mode, or when your study is part of a multi-site collaboration that needs a shared coding scheme. Its virtue is that it produces results comparable across studies. Its risk is that you may miss things the data are saying that the framework was not designed to see.

An applied example: if you were coding the loneliness transcripts deductively using Weiss's (1973) social-emotional loneliness typology, you would have two pre-specified codes, namely social loneliness (deficits in a social network) and emotional loneliness (absence of a close attachment figure), and you would tag each passage as one, the other, both, or neither. You would learn the distribution of the two types across the corpus and would have framework-comparable results. You would also miss the embodiment theme we developed in an earlier section, because Weiss's framework does not contain it.

2.3 Hybrid Coding (the Practical Default)

Most contemporary qualitative health research uses a hybrid approach. The deductive starting list is called a provisional codebook, and the codebook then grows from the bottom up while keeping its theoretical anchor.

The Fereday and Muir-Cochrane (2006) hybrid framework is a widely cited operationalization of this approach, and Hsieh and Shannon's (2005) "directed" qualitative content analysis is a closely related variant. Bernard, Wutich, and Ryan (Ch. 6) endorse hybrid coding as the practical default for applied health research because it preserves the inductive openness that makes qualitative work valuable while keeping the deductive anchoring that makes it interpretable by quantitatively trained reviewers.

The worked examples in this lesson use a hybrid strategy: you start with two or three theoretically motivated codes (perhaps experiential loneliness, causal accounts, and coping strategies, derived from the interview guide structure) and let the rest develop inductively from the first three to five transcripts you code.

2.4 The Anatomy of a Codebook Entry

A codebook is a structured document. Each entry describes one code with enough specificity that another analyst could apply it consistently (MacQueen, McLellan, Kay, & Milstein, 1998; DeCuir-Gunby, Marshall, & McCulloch, 2011). Bernard, Wutich, and Ryan (Ch. 6) recommend seven elements per entry. All seven matter; cutting any of them is the most common reason why intercoder reliability later turns out to be low.

1. Code name. Short, mnemonic, unique. Use hyphens or underscores, not spaces. Example: chair-absent-spouse.
2. Brief definition. One sentence. Example: “A physical object (chair, side of bed, photograph) that the participant marks as standing in for the absence of a deceased or departed partner.”
3. Full definition. A paragraph. When to apply the code; what range of cases it covers; how it relates to neighbouring codes. The full definition is what an analyst reads when in doubt.
4. Inclusion criteria. Bullet-pointed. What features must be present for the code to apply. Example: the participant explicitly names a physical object; the object is associated with an absent person; the participant gives the object affective weight.
5. Exclusion criteria. Bullet-pointed. What looks similar but does not count. Example: mention of a physical object without affective weight (“the chair in the corner”) does not count; mention of an absent person without an associated object does not count.
6. Positive example. A direct quote from the corpus that clearly fits. Example: Linda P05: “Bill sat in that chair every evening for thirty-some years. And it's still there. I haven't moved it. I haven't sat in it. I haven't given it away. It's just there. And every evening I look at it and it's empty.”
7. Negative example. A near-miss quote that does not fit. Example: Helen P11: “I have this walker because my hip gave out.” A physical object is named, but it is not associated with an absent person.

Crosswalk: two layouts for the same codebook

If you took HSCI 207, you met a six-column codebook in Lesson 11, Section 3.3 (First Steps in Analysis), also based on MacQueen and colleagues (1998). The two layouts describe the same artefact with different labels.

The seven-element entry adds no new kind of information. It splits the example into a passage that clearly fits and a near miss, because the near miss shows a second coder where the boundary of the code lies.

2.5 A Worked Codebook Entry

Here is a complete codebook entry for a code drawn from the loneliness corpus. We will return to this entry in a later section when we walk through the Taguette workflow.

2.6 The Codebook as a Living Document

Bernard, Wutich, and Ryan are clear that a codebook is not built once and frozen. You will revise it. The standard expectation is that revisions are documented in an audit trail that records: (a) the date of revision, (b) which codes changed, (c) what they changed to, and (d) the justification. When a codebook is revised midway through a project, the earlier transcripts must be re-coded under the new scheme, not the old one, or the codebook becomes inconsistent across the corpus.

The practical implication is that you should not commit to a final codebook until you have read most of the transcripts you intend to code. A preliminary codebook developed on three to five transcripts is a first draft, and the codebook reported at the end of a study is that draft revised at least twice on the basis of what the rest of the corpus reveals.

Introduction and Overview

Earlier sections covered the conceptual side of coding: what themes are, where codes come from, what a codebook looks like. This section addresses two operational matters that determine whether your coding is methodologically defensible. The first is coding mechanics: how passages get marked up, how codes relate to each other, how the analyst handles complications. The second is intercoder reliability: when a second analyst applies your codebook to the same passages, how much agreement should you expect, how do you measure it, and what does the resulting number mean?

3.1 Hierarchical Codes (Parent and Child)

A codebook is rarely flat. Codes nest under broader codes, which nest under categories, which sit under the codebook root. The hierarchy is what makes a large codebook navigable and what allows you to aggregate findings at different levels. In the loneliness corpus, a plausible partial hierarchy looks like this:

LONELINESS_EXPERIENCE/
   somatic-absence
   affective-loneliness
   social-invisibility
   temporal-fading
CAUSAL_ACCOUNTS/
   bereavement-onset
   migration-onset
   life-stage-transition
   structural-isolation
COPING_STRATEGIES/
   coping-pet
   coping-volunteer
   coping-phone-confidant
   coping-comfort-media
   coping-cooking-home-food
INTERPRETIVE_FRAMES/
   loneliness-as-cost-of-love
   loneliness-as-failure
   loneliness-as-rebuilding
   loneliness-as-invisible-to-society

The four parent categories at the top are the metacoding bins from an earlier section (Technique 12). Each child code can be applied independently to passages. When you report your findings, you can report at the category level (“coping strategies appeared in all 20 transcripts”) or at the code level (“coping-pet appeared in 3 of 20 transcripts”), depending on what your argument needs.

3.2 Multiple Codes Per Passage

A single passage may instantiate more than one code. This is normal and expected. Linda's chair passage simultaneously instantiates chair-absent-spouse (a specific code), somatic-absence (the absence as carried), and loneliness-as-cost-of-love (the interpretive frame she later articulates). All three codes are applied to overlapping or identical text spans. Taguette and the major QDA packages handle multi-coding natively.

The implication for analysis is that when you later count code occurrences, you are counting passage-code pairs, not unique passages. A transcript with 80 unique coded passages might have 130 code applications because many passages got two or three codes. Both numbers are meaningful; report whichever supports your argument and be clear about which you are reporting.

3.3 Axial Coding (Relationships Between Codes)

The term axial coding comes from Strauss and Corbin's (1990) grounded-theory tradition; for an exhaustive catalog of coding methods including in vivo and axial styles, see Saldaña (2021). It refers to a second pass over the data, after initial coding, in which the analyst attends to the relationships between codes rather than to the codes themselves. Axial-coding questions include: which codes co-occur? Which codes appear in sequence (and in which order)? Which codes seem to be causes of which others, in participants' own accounts? Which codes are mutually exclusive in practice? In Saldaña's terms (Section 1.1), axial coding is a second-cycle method, because it works on codes already applied in the first cycle rather than on the raw text.

Axial coding is what turns a flat codebook into a model. In the loneliness corpus, axial coding might reveal that bereavement-onset codes are nearly always followed in the same transcript by coping-pet codes; that migration-onset codes co-occur with cooking-home-food codes; that loneliness-as-cost-of-love appears only in transcripts that also contain somatic-absence. These relationships are not in the codes themselves; they are in the pattern of co-occurrence. A later section shows how to tabulate co-occurrence from your coded extracts.

3.4 In Vivo Codes (Using Participants' Exact Words)

An in vivo code is a code whose name is taken verbatim from a participant's speech. The convention is to set in vivo codes in quotation marks in the codebook to mark their origin. In the loneliness corpus, defensible in vivo codes include: “wahda” (Amira's word for a refugee-specific loneliness), “witness-less hours” (Sarah's phrase for the loneliness of being unobserved), “the cost of love” (Linda's interpretation), “code-switching loneliness” (Marcus's articulation of the loneliness of moving between cultural registers), and “fading at the edges” (Helen's metaphor).

In vivo codes do two analytic things at once. First, they keep the participant's voice in the codebook, which protects against analyst over-abstraction. Second, they give the eventual paper memorable language: reviewers and readers remember “wahda” in a way they do not remember refugee-specific-loneliness. Most well-written qualitative findings sections have at least three or four section headers built from in vivo codes. We will use Amira's “wahda” as a section header in the worked findings exercise of a later lesson.

3.5 Intercoder Reliability: Why It Matters

Once you have a codebook, the central question is: can someone else apply it the way you intended? Intercoder reliability is the operational answer to that question. Two (or more) analysts independently code the same passages using the same codebook; you compute the agreement; you decide whether the agreement is good enough.

Bernard, Wutich, and Ryan (Ch. 6) frame intercoder reliability as the most common operational standard for the third of the three methodological commitments (replicability, from an earlier lesson). It is not the only test of replicability, but it is the one most often expected by quantitatively trained reviewers in public-health journals. Methodologically, it serves three purposes: it forces the codebook to be specific enough to be applied consistently; it reveals which codes are unclear and need refinement; and it gives you a defensible number to report in your methods section.

3.6 Percent Agreement (Simple but Flawed)

The most intuitive measure of agreement: count the passages on which two coders agree, divide by the total number of passages coded, multiply by 100. If coders agree on 85 of 100 passages, percent agreement is 85%.

The problem with percent agreement is that it does not adjust for the agreement you would expect by chance. If two coders are using a codebook with only two codes (apply / do not apply), and one of the codes is used 90% of the time, two random coders would agree about 82% of the time by accident. An 85% percent-agreement score in that setting reflects only a few percentage points of real agreement above chance. The chance-adjusted measures below are designed to fix this problem.

3.7 Cohen's Kappa (Two Coders, Nominal Categories)

Cohen's kappa (Cohen, 1960) is the chance-corrected agreement measure used most often in qualitative health research. The formula is:

κ = (p_o − p_e) / (1 − p_e)

Where p_o is the observed proportion of agreement (the percent agreement, expressed as a decimal) and p_e is the proportion of agreement expected by chance, given the marginal distributions of each coder's codings (that is, how often each coder used each code overall). Kappa ranges from −1 (perfect disagreement) through 0 (chance-level agreement) to +1 (perfect agreement). In plain terms, kappa asks how much of the coders' agreement is real rather than lucky: it takes the agreement they actually reached, subtracts the agreement two people would fall into by chance, and rescales what remains so that flawless agreement scores 1 and chance-level agreement scores 0.

Landis and Koch (1977) proposed interpretive thresholds for kappa that have become the field standard. They are guidance, not law; Bernard, Wutich, and Ryan are clear that the appropriate threshold depends on the stakes of the coding and the nature of the categories.

The convention in applied health research is that kappa ≥ 0.60 (substantial) is a defensible threshold for publication, and kappa ≥ 0.80 (almost perfect) is excellent. If your kappa is below 0.60 on a given code, the standard response is to refine the codebook entry for that code (usually by tightening the inclusion or exclusion criteria) and re-code the disputed passages.

3.8 Krippendorff's Alpha (the Preferred Measure)

Cohen's kappa has three limitations: it handles only two coders, it does not gracefully handle missing data, and it assumes the codes are nominal categories (mutually exclusive and unordered). For projects with more than two coders, with intermittent missingness, or with codes that are ordered (e.g., severity levels), Cohen's kappa is the wrong tool.

Krippendorff's alpha (Krippendorff, 2018) generalizes the kappa idea to handle all three limitations. It accommodates any number of coders, any pattern of missing codings, and any level of measurement: nominal (unordered labels), ordinal (ranked levels such as low, medium, high), or interval and ratio (numeric scales). It is the measure most contemporary methodologists recommend, including Bernard, Wutich, and Ryan.

The formula is more complex than kappa's, since alpha is built on the difference between observed and expected disagreement computed from a coincidence matrix. For a small two-coder table it can still be worked through by hand, and any intercoder reliability calculator will compute it for larger tables. A later section works through a two-coder example. Interpretively, Krippendorff's own guidance is that α ≥ 0.80 is the usual standard for drawing firm conclusions, while 0.667 ≤ α < 0.80 supports only tentative conclusions. Below 0.667, the codebook is not yet reliable and needs revision.

3.9 When Intercoder Reliability Is the Wrong Measure

Not all qualitative work asks for intercoder reliability. Bernard, Wutich, and Ryan are explicit about this and so are many methodologists writing in the interpretivist tradition. In two situations, the reliability framing is actually misleading.

The first is interpretivist or constructivist work. In Charmaz-style constructivist grounded theory (Charmaz, 2014), the analyst's interpretation is understood to be partly constitutive of what the data mean. Two competent analysts may legitimately reach different but defensible interpretations of the same passages. The standard of evaluation is not identity (the kappa standard) but coherence, that is, whether each interpretation is internally consistent, evidence-based, and methodologically transparent. For this kind of work, the equivalent quality check is investigator triangulation (multiple analysts compare interpretations and document where they differ and why) rather than a kappa score.

The second is narrative and discourse-analytic work (later lessons). Narrative analysis attends to the structure of a single telling; discourse analysis attends to the rhetorical work an utterance performs. Neither tradition typically treats codings as nominal categories applied independently to passages, so a kappa is not the right object. The methods sections of credible papers in these traditions usually report on member checking (Lesson 6, Section 2.8), on theoretical sensitivity, and on the writing trail rather than on kappa.

Reflexive thematic analysis (Section 1.4) belongs with these traditions, because it treats the researcher's interpretation as a resource and uses no fixed codebook to agree on. For a study that follows Bernard, Wutich, and Ryan's systematic approach and uses inductive-deductive hybrid coding, as the worked examples in this lesson do, intercoder reliability is the right measure, and Section 4 computes it. You should still know the defensible qualitative methodologies for which it is the wrong measure, so that you read the absence of a kappa in an interpretivist paper as a methodological choice.

3.10 The QDA Software Landscape

Before we move into the workflow in a later section, a quick orientation to the software landscape. There are four commercial options and a growing free-and-open-source ecosystem. None of them does anything you cannot do by hand on a small corpus; what they buy you is speed, consistency, and the ability to scale.

We chose Taguette for this course because it is free (every student in the world can use it), it is open-source (your coded data are not held hostage by a licence), and its export format is standard (CSV and HTML, which any analysis tool can read). The features it lacks, namely advanced visualizations and sophisticated network views, can be produced from its CSV exports with a spreadsheet or a free diagramming tool, or drawn by hand. The combination is a complete, transferable workflow.

Introduction and Overview

The first three sections of this lesson laid out the conceptual apparatus: themes versus codes, the twelve theme-finding techniques, inductive versus deductive coding, codebook architecture, coding mechanics, intercoder reliability. This section turns operational. You will see, end to end, how to find candidate themes in the loneliness corpus with word lists and keyword searches, how to build a codebook for them, how to apply the codebook in Taguette, how to summarize the exported coded extracts, and how to compute Krippendorff's alpha on a small two-coder reliability check. The section ends with what a first coding pass produces.

4.1 Step 1: Gather the Transcripts

The loneliness transcripts are in HSCI_841_loneliness_data.zip (the 20 interview transcripts, participant tables and codebooks). After you unzip it, the transcripts folder holds the 20 plain-text files (P01_Maya.txt through P20_Frank.txt). Each transcript opens with a metadata header (participant ID, age, gender, occupation, etc.) followed by the interview proper. Together the 20 files are the corpus you will work with in the steps below.

4.2 Step 2: Repetitions and KWIC as Theme-Finding Aids

Theme-finding technique 1 (Repetitions) and technique 10 (Word lists and KWIC) are easy to support with simple tools. A free word-frequency or concordance tool will count recurring words across the corpus and pull keyword-in-context concordances, and the search function of any text editor will find each occurrence of a word that catches your eye. The result is not the end of theme-finding; it is the front edge of it. The patterns the computer surfaces are then read closely by you, in their original transcripts, to decide whether they support a theme.

4.3 Step 3: Set Up the Taguette Project

Word lists and concordances surface patterns; Taguette is where you mark passages with codes. The two work together: the searches in Step 2 suggest what to look for, and Taguette records where you found it. The workflow below assumes you set up Taguette in Lesson 1 (Section 4.5); if not, return to those setup steps first.

4.4 Step 4: Summarize the Coded Extracts

Taguette's CSV export gives you a long-format table: one row per (passage, code) pair. Multi-coded passages appear in multiple rows. This is the format you want for almost any quantitative analysis of your qualitative coding: code frequencies, co-occurrence, code-by-participant matrices, comparison across subgroups.

4.5 Step 5: Compute Krippendorff's Alpha for a Two-Coder Reliability Check

For a two-coder reliability check, you and a second coder independently code one shared transcript using the same provisional codebook. You then compute Krippendorff's alpha (or Cohen's kappa) on the resulting codings, by hand for a small table or with any intercoder reliability calculator. The worked example below uses a wide-format table where rows are passages and columns are coders, with the cell value being the code each coder assigned.

4.6 The Iterative Cycle

The five steps above describe one pass through the workflow. In practice you will iterate. After computing reliability on a first transcript, you will revise the codebook for codes that scored poorly, re-code the disputed passages, and only then move on to the remaining transcripts. The audit trail (Section 2.6) records each iteration. A full analysis of the twenty transcripts usually goes through three or four iterations of this cycle, each documented, each producing a better codebook than the one before.

4.7 What a First Coding Pass Produces

A first pass through this workflow on three to five transcripts produces three working documents: a preliminary codebook of eight to twelve codes, each with all seven required elements; a Taguette project with those transcripts coded; and a one-page methods memo recording what the coding revealed, how the codebook changed, and what to revise next. In the terms of Section 1.4, these documents belong to the coding phase. Candidate themes are generated from them once more of the dataset has been coded, and the earlier design work on the research question, the sampling rationale, and the data-collection procedure now becomes analysis of transcripts.

Bringing It All Together

This lesson is the heaviest analytic lesson in the first half of this course. It is the lesson that converts the conceptual apparatus of the first four lessons (definitions, design, sampling, collection) into operational coding moves. The twelve theme-finding techniques (an earlier section), the six phases of thematic analysis (an earlier section), the inductive/deductive/hybrid distinction (an earlier section), the seven-element codebook entry (an earlier section), the four coding mechanics (an earlier section), and the intercoder reliability statistics (an earlier section) are tools you will use, in some combination, in every qualitative project for the rest of your career.

A first coding pass is the first piece of real analytic work on the loneliness dataset. The preliminary codebook it produces is revised in Lesson 6 when a conceptual model is added, expanded in Lesson 7 when constant-comparative analysis runs across subgroups, and stress-tested in Lessons 8 to 11, which run content, narrative, discourse, and analytic-induction passes on the same coded extracts. The codebook is the spine of any coding-based qualitative analysis, and this lesson is where it is built.

The final reflection below asks you to take stock of one specific decision you would make in your own coding work. Concrete, specific, and defensible: that is the standard any coding plan should meet.

Final Knowledge Assessment

This glossary collects the key concepts, people, and methodological terms introduced in this lesson. Use it as a reference while you work through the material, or as a review before the final assessment. Type in the search box to filter entries.