Introduction and Overview

Most students arrive at a qualitative methods course assuming that “qualitative data collection” means interviews. It does, eventually, dominate the chapter. But Bernard, Wutich, and Ryan (2017, pp. 63–100) open Chapter 4 with a deliberately broader frame. The data-collection landscape, they argue, is organised around three families: indirect observation (where the researcher never interacts with the people whose behavior is being studied), direct observation (where the researcher is present and looks at what is happening), and elicitation (where the researcher actively asks people to produce data, through interviews, focus groups, free lists, or written responses). The three families are not a hierarchy. They are tools that answer different kinds of questions, that cost different amounts of money and time, and that come with different ethical obligations.

This section concerns the first family, indirect observation, because it is the one most often overlooked and the one with the most counterintuitive payoff. Indirect data are data that already exist in the world, left by past behavior, stored in institutional archives, or generated by other researchers for other purposes, and that the analyst harvests without ever asking a participant a question. Eugene Webb and colleagues coined the term unobtrusive measures for this family in their 1966 classic of the same name, and it remains one of the most fertile underused regions of qualitative methodology in public health.

1.1 The Logic of Indirect Observation

Indirect observation begins with a simple insight: people leave traces. They wear paths into grass between buildings, they leave fingerprints on museum glass, they fill landfills with packaging, they post on social media, they generate medical records, they file tax returns, they get arrested, they buy products, they vote. Each of those traces is data, and the discipline of harvesting them is, in principle, a qualitative discipline: the analyst is reading the world the way an interviewer reads a transcript. Eugene Webb, Donald Campbell, Richard Schwartz, and Lee Sechrest's Unobtrusive Measures: Nonreactive Research in the Social Sciences (1966; second edition 2000) is the canonical methodological statement. Bernard, Wutich, and Ryan treat the Webb tradition as foundational and devote the opening pages of Chapter 4 to it for two reasons.

First, indirect data are nonreactive. When you interview someone about their loneliness, they know they are being studied; what they say is shaped by the relationship, by the setting, by the desire to appear coherent, by the willingness to disclose. When you analyse a transit log showing how often someone uses public transit alone versus in company, the data have no such reactivity, since the person was not performing for you. Reactivity is the qualitative-research equivalent of measurement bias, and indirect data are, in this respect, methodologically cleaner than elicited data on the same phenomenon.

Second, indirect data are typically longitudinal in ways that elicitation cannot match. An interview captures one moment, perhaps two if you do a follow-up. An archival record can stretch back decades. A behavior trace can accumulate over the entire life of the trace-generating activity. If you want to know how loneliness in a community has changed across thirty years, no interview design can give you that, but a content analysis of obituaries, of personal ads, of community-newspaper letters to the editor, of city-council minutes mentioning “isolation” can.

The cost of these advantages is a cost we will return to throughout the section: with indirect data you cannot ask why. You can see the pattern. You cannot ask the person who produced it what it meant to them. Combining indirect observation with elicitation, the two-source design, is often the strongest move.

1.2 Behavior Traces

Behavior traces are physical or digital records left by past action. Webb and colleagues divided them into two sub-types: accretion measures (things that have built up, such as graffiti, worn paths, garbage, and fingerprints) and erosion measures (things that have worn down through use, such as the worn linoleum in front of a museum exhibit indicating how popular it was, the most-thumbed page of a Bible in a hotel room, the fading paint on a heavily-used playground). The distinction is more conceptual than practical; the analytic logic in both cases is the same.

In public-health research, behavior traces are useful for the questions that respondents cannot or will not answer accurately. Two examples make the point. A study of harm-reduction service utilisation in the Downtown Eastside used the contents of needle-exchange returns, the actual physical objects rather than the user-reported counts, to estimate injection-event volumes. The traces were more reliable than self-report. A 2020 study of children's playground use during the early COVID-19 lockdowns used aerial photographs of trampled grass and ball-sport patterns to characterize informal play in periods when interviews and surveys were impossible.

The qualitative move with behavior traces is interpretive: what does this trace mean? The answer requires the same disciplined work as coding a transcript: specify what you are looking for, code consistently across cases, and be transparent about your interpretive leaps. A worn path between two buildings means someone walked there many times. It does not, by itself, tell you who they were, why they preferred that route, or whether they enjoyed it. The trace is the starting point of analysis, not its conclusion.

1.3 Archival Data

Archival data are the institutional records people, organisations, and governments generate as a by-product of operating. The category is large. It includes:

• Institutional records: clinic charts, school-attendance registers, court transcripts, council minutes, child-welfare case files, ambulance dispatch logs, organ-donation registries.
• Historical documents: diaries, letters, newspapers, pamphlets, public-health reports from earlier eras, autopsy reports, missionary records, parish death books.
• Media corpora: television news transcripts, podcast episodes, social-media posts, advertising, government information campaigns.
• Personal documents: in the hands of researchers via consent or via the public domain: published memoirs, blogs, online support-group threads, GoFundMe campaign descriptions.

Bernard, Wutich, and Ryan are explicit that archival work has historically been treated as a sub-discipline of history rather than as qualitative methodology, and that the artificial boundary has cost the social sciences. The methods of qualitative analysis you will learn in later modules, including theme identification, content analysis, narrative analysis, and grounded theory, all apply to archival data. A clinic chart can be coded; a newspaper editorial can be theme-analysed; a corpus of council minutes can be content-analysed for keyness (which words become distinctively frequent) over time. The analytic discipline is exactly the same as for interview transcripts; the data just arrived without an interviewer in the picture.

The selection-bias problem

The big methodological concern with archival data is that they were not produced for your study. They were produced for someone else's purpose, by someone else, with someone else's selection criteria, in someone else's institutional context. A coroner's report describes the deaths the coroner saw, written in the way the coroner was trained to write them. Newspaper personal ads were written by people who could afford to place them and read by people who read that newspaper. Online forum posts were written by people who used that forum, in English, with the literacy to compose a post, and who chose to post rather than to lurk. Each of these selection mechanisms is a population-defining filter, and your analytic claims have to be calibrated to what the data can actually support.

Bernard, Wutich, and Ryan's recommendation is conservative: treat archival data as one source among others, identify what the source can and cannot represent, write the limitations into your methods section explicitly, and resist the temptation to generalise beyond the population whose traces actually entered the archive.

1.4 Secondary Analysis of Existing Qualitative Datasets

Secondary qualitative analysis, using interview or focus-group data collected by other researchers for other studies, is the youngest of the three indirect-observation sub-types and the one growing fastest. The Qualitative Data Repository at Syracuse, the UK Data Service's Qualitative Bank, the SAGE Research Methods Cases collection, and a growing number of journal data-sharing requirements are making qualitative datasets available the way quantitative datasets have been available for decades.

The methodological promise is real. A graduate student who could never afford to do twenty new interviews on, say, vaccine hesitancy in rural Manitoba can re-analyse a deposited 2018 dataset on the same topic, asking new questions of the existing transcripts. A researcher building a meta-ethnography (a synthesis of multiple qualitative studies, the qualitative analogue of a meta-analysis) can use the deposited transcripts rather than only the published papers about them.

The methodological hazards are also real. Bernard, Wutich, and Ryan flag four. First, the original interview guide constrained what got asked; if your research question requires a probe the original interviewer never offered, the data are silent on it. Second, the analyst was not in the room and cannot recover the relational and embodied context the original researcher had. Third, the participants consented to one study; using their words for a different study requires either explicit re-consent (often impossible) or a defensible ethics argument that the secondary use is sufficiently consonant with the original consent. Fourth, the analytic frame you bring may be inappropriate for the kind of relationship the original interviewer built.

Bernard, Wutich, and Ryan's stance is permissive but cautious: secondary qualitative analysis is legitimate and increasingly necessary, but it should be done with explicit acknowledgement of what was lost and what was not collected, and with humility about interpretations that go beyond what the original interviews can support.

1.5 When to Use Indirect Methods

Indirect observation is the right first choice when one or more of the following is true: (a) the population is hard to reach by elicitation (e.g., the deceased, people in conflict zones, people who would not consent to interview); (b) the time horizon is long (decades or centuries); (c) reactivity is a serious concern (the topic is socially sensitive or self-presentation will distort responses); (d) the budget is small; (e) the research question is about an institutional or population-level pattern rather than about lived experience.

It is the wrong choice when you need to know what something felt like from the inside, when you need to probe a participant's understanding, or when the trace itself is missing the most interesting part of the phenomenon. For most loneliness research, indirect observation is a complement to elicitation, not a replacement. The chair Helen sits in (an accretion measure of where she spends her time) tells you something. What she says about the chair tells you something else. The disciplined qualitative researcher uses both.

Introduction and Overview

Direct observation is the family of methods in which the researcher is physically (or virtually) present and watches behavior happen. It is the oldest qualitative methodology in cultural anthropology, since ethnographers have been doing it for more than a century (Hammersley & Atkinson, 2019), and it remains a workhorse of contemporary public-health research, especially in implementation science, clinical-encounter research, organisational ethnography, and Indigenous health. Bernard, Wutich, and Ryan dedicate pp. 71–79 of Chapter 4 to it, organising the discipline around three sub-types: participant observation (immersive engagement over time), continuous monitoring (structured watching of specific behavior streams), and spot observation / time-allocation studies (sampled snapshots of who is doing what, when).

The defining intellectual move in all three sub-types is what Spradley (1980) called “the discipline of seeing.” Ordinary perception is selective and habitual; it filters out the familiar and concentrates on what is novel or salient. Disciplined observation reverses the filter. The observer trains themselves to attend to what is so ordinary it has become invisible: the layout of chairs, the rhythm of who speaks and who waits, the timing of who arrives and who leaves, what is on the walls, what people wear, what they eat, when they touch and when they don't. The discipline is not natural. It is trained.

2.1 Participant Observation: The Spradley Spectrum

Participant observation (DeWalt & DeWalt, 2011) is the ethnographic core of qualitative methodology: prolonged engagement in a setting, during which the researcher both watches and (to varying degrees) participates. The classic anthropological model is Bronislaw Malinowski's Trobriand Islands fieldwork, with years of residence, daily participation, and slow accumulation of insight. The same logic applies to a public-health researcher who spends six months attending the weekly meetings of a peer-support group, eating in the staff lounge of a community clinic, or volunteering at a needle exchange. The method's power comes from time: prolonged engagement reveals patterns invisible to a one-time interview.

James Spradley's Participant Observation (1980) is the canonical methodological treatment. Spradley organised participant-observation along a five-point spectrum (building on Gold, 1958) that names the trade-offs at each position:

The position you choose for a given study is a design decision with consequences. Bernard, Wutich, and Ryan recommend, for most contemporary public-health work, the middle two positions, observer as participant or participant as observer, because they balance access against ethical clarity (Madden, 2017). The complete-participant position has a long history in mid-twentieth-century sociology (Festinger's When Prophecy Fails, Humphreys' Tearoom Trade) but is now restricted by institutional research-ethics boards in most jurisdictions.

2.2 Building Explicit Awareness

Spradley argued that the central skill of participant observation is what he called explicit awareness: the trained capacity to notice things that ordinary perception filters out. The skill is the qualitative equivalent of learning to read an ECG: the lines on the paper are the same, but the trained eye sees what the untrained eye misses. Spradley described several specific techniques.

The everyday-object exercise. Spend ten minutes describing in writing the contents of a clinic waiting room you have been in dozens of times. Most students struggle for the first three minutes, then find a rhythm. The exercise reveals how little of the familiar setting was ever consciously registered. The training value is that subsequent visits to the setting will register more.

The naive-observer exercise. Pretend you have just arrived from a culture that has never seen a Canadian hospital before. Describe what is happening as if you do not know what a stethoscope is, what a hospital gown is for, why people are wearing masks. The discipline is to make the familiar strange. This is the canonical anthropological move and it is the engine of ethnographic insight.

The widening-attention exercise. Pick a single feature of a setting, say who speaks first at the start of each meeting, and track it across multiple sessions. Then add a second feature: who interrupts whom. Then a third: where people position themselves around the table. Layered attention builds capacity that single-feature attention cannot.

The body-knowledge exercise. Notice the bodily sensations the setting produces in you. The smell. The temperature. The acoustics. The pace. Your own discomfort or ease. Ethnographic insight is partly embodied; what your body notices is data, even if it never makes it into the final report verbatim.

2.3 Continuous Monitoring

Continuous monitoring is the structured cousin of participant observation. The observer watches a specific behavior stream, not the whole setting, and records it systematically. Examples in public health include hand-hygiene observation in hospitals (the World Health Organization's “5 Moments” observation protocol), clinical-encounter observation (how much of a 15-minute primary-care visit is spent on what), classroom observation of school-meal consumption, and harm-reduction street-outreach observation of who uses what services in what order.

Continuous monitoring trades the breadth of participant observation for the precision of structured measurement. The observer typically uses a coding sheet, recording each event of interest with a timestamp. The data are dense and tabular. They can be analysed both qualitatively (what is the texture of the behavior? what coding categories needed to be added in the field?) and quantitatively (how often does each behavior occur per unit time? are there temporal patterns?).

Bernard, Wutich, and Ryan are explicit that continuous monitoring outperforms self-report whenever the behavior is one people would mis-remember, under-report, or socially-desirably-report. Hand hygiene is the canonical example: when clinicians are asked how often they wash their hands between patients, they say roughly 90 percent of the time. When observed, the rate is closer to 40 percent. The discrepancy is not because clinicians lie; it is because behavior at that frequency is invisible to self-report.

2.4 Spot Observation and Time-Allocation Studies

Spot observation is the sampling-based cousin of continuous monitoring. Instead of watching a stream of behavior continuously, the observer makes brief observations at randomly sampled times, recording who is doing what in that instant. Aggregated across many such instants, the data yield a time-allocation profile: what proportion of a population's time, on average, is spent on each activity.

The classical use is in cultural-anthropology economic research, asking how subsistence-farming households allocate labour between fields, livestock, household, and leisure, but the method translates directly to public-health questions. Time-allocation studies have been used to characterise informal caregiving in aging populations, sedentary behavior in office workers, and child supervision in low-income households. The method's strength is that it does not depend on participants' ability to recall how they spent their time (which is notoriously inaccurate). Its weakness is that brief snapshots cannot capture the meaning of activities and may miss rare but important events.

2.5 When to Use Direct Methods

Direct observation is the right first choice when you need to see behavior in context, when you suspect that what people do differs from what they say they do, when the setting itself is part of the object of study, when the behavior is too frequent or too embodied to be accurately recalled, or when you need to characterise an ordinary practice that participants take so for granted they cannot describe it. It is the wrong choice when the population is dispersed, when the behavior is private, when the budget for fieldwork is small, or when the question is fundamentally about meaning rather than action.

For loneliness research, direct observation would be a powerful complement to interviews if the question is, for example, “What does loneliness look like in residential settings?” You could spend weeks in a long-term-care facility watching the morning routine, mealtime seating patterns, who walks with whom on the corridor, when residents return to their rooms. None of this would replace interviews like Helen's, but it would let you see the loneliness Helen could only describe to you in fragments.

Introduction and Overview

The third and largest family in Chapter 4 is elicitation: methods in which the researcher actively asks participants to produce data. Bernard, Wutich, and Ryan dedicate most of pages 79–97 to this family because it dominates contemporary qualitative health research and because the design decisions are non-obvious. The family contains several quite different methods: unstructured interviews, semi-structured interviews, structured interviews, focus groups, free lists, pile sorts, triads, ranking tasks, and open-ended survey items. Each has a different relationship between researcher control and participant freedom; each is good for different kinds of questions.

The course dataset was elicited using semi-structured interviewing, so this section dwells on that method longest. The other methods matter too, because they appear in the literature and because some of them (free listing in particular) reappear later in the course as the basis of cultural-domain analysis.

3.1 Unstructured Interviews

The unstructured interview, defined in the Background box, is foundational in cultural anthropology (Spradley's The Ethnographic Interview, 1979, is the classic methodological treatment) and is used heavily in long-term fieldwork where the same researcher interviews the same participants many times over months or years.

The strength of unstructured interviewing is that the participant sets the agenda. They name the topics they think matter; they choose the words; they impose their categories before the researcher imposes theirs. This is invaluable when you are working in an unfamiliar cultural domain or with a population whose ways of talking about the phenomenon are themselves the object of study. A researcher trying to understand how Vietnamese-Canadian elders in East Vancouver talk about buon ba (the rough translation might be “loneliness”) will learn more from unstructured conversation than from a guide constructed in English-language categories. The cost is comparability: if every interview follows different threads, claims about patterns across cases rest on uncertain ground, so most public-health studies use unstructured interviewing only in an early scoping phase.

Interviewing for interpretative phenomenological analysis. Interpretative phenomenological analysis (IPA; Smith, Flowers, & Larkin, 2022) uses a distinctive interview style, close to the unstructured end of the range. The sample is small and homogeneous, often between three and ten people who share a particular experience, so that the analysis can attend to each case in detail before looking across cases. Each participant usually takes part in one long interview that is only minimally structured: a short schedule of open questions serves as a loose guide, and the interviewer follows the participant's account of a specific experience wherever it leads. Probes ask for meaning and concrete detail, such as “What was that like for you?” or “What did that mean to you at the time?”, and avoid steering the participant toward the researcher's categories. The contrast with the course dataset is instructive. The loneliness interviews (Section 3.2) used a semi-structured guide across twenty deliberately varied participants, a design that suits comparison across cases; an IPA study of loneliness would interview a handful of people who share one situation, such as recent widowhood, about what that experience has been like for them.

3.2 Semi-Structured Interviews: The Format of the Course Dataset

Semi-structured interviewing is the workhorse of contemporary qualitative health research (Brinkmann, 2007), and it is the method used to produce the 20 transcripts of the course dataset. The method sits between unstructured and structured: it uses a written guide that covers the topics the researcher wants to address, but treats the guide as a checklist rather than a script. The interviewer follows the participant's lead within each topic, asks probes responsively, skips items the participant has already covered, and reorders items as needed.

The defining feature is the guide-but-not-script approach (Kvale & Brinkmann, 2018). The interviewer should be able to conduct the interview without looking at the page; the guide is internalised, not read. The reason is that reading questions aloud creates a school-test register that suppresses the discursive material the method is meant to elicit.

A semi-structured interview is also a relationship, and who the interviewer appears to be shapes what a participant will say. The interviewer's positionality (age, gender, perceived ethnicity, accent, and evident insider or outsider status) affects rapport, what feels safe to disclose, and which answers seem expected. This is why careful interviewers practise reflexivity, keeping track of how their own presence may be steering the account and noting it alongside the data rather than treating the interview as a neutral extraction of fact.

The art of the probe

Probes that worked, probes that didn't: lessons from the corpus

Read alongside the transcripts, you can see the probes working. With Maya, the silent probe after “the SkyTrain at 9 p.m. on a Sunday” produced the elaboration “everyone's just on their phones, and nobody acknowledges that anybody else exists.” With Helen, the echo probe “Fading...?” produced the elaboration about three days without speaking and the voice sounding strange. With Amira, the uh-huh probe held the space open during the difficult disclosure about the anniversary of when her home was destroyed.

You can also see, in places, probes that did not produce expansion. Amira's response to a probe about Canadian friends, “To explain everything is to live through it again,” signals that the probe touched material the participant did not want to elaborate on. The interviewer correctly did not push. The discipline of qualitative interviewing is partly the discipline of not probing: recognising when to step back, when silence is what the participant needs, and when the probe would extract material the participant would later regret giving.

Notice in the excerpt that the bracketed [pause] is a transcription convention, an artefact of the analytic choice made during transcription, not of the spoken utterance itself. We return to that in a later section. Notice also that the participant's response is full of filled pauses (“like,” “um”) and false starts (“nobody, nobody”). The fact that these survived into the transcript means the transcription used a verbatim convention, which keeps every utterance; an intelligent-verbatim transcript would have removed them. The fact that they did not survive into a polished journal-article quote would mean the analyst then cleaned them for publication. Both are legitimate choices at different stages.

Piloting the guide

Before the main interviews, a guide is usually piloted with one or two people who resemble the intended participants, or with colleagues when the population is small or hard to reach. The pilot shows which questions confuse, which produce short answers, which topics run long, and which probes open an account and which close it. The researcher then revises the wording, order, and probes, and keeps a dated record of each change and the reason for it, so that the methods section can report how the guide evolved and an ethics board can see whether a change altered the risk to participants. Whether pilot interviews are analyzed with the main data is decided in advance and reported. HSCI 207 Lesson 10, Section 2.7 (Collecting Qualitative Data) works through piloting an interview guide and is optional reading.

3.3 Structured Interviews

Structured interviewing, defined in the Background box, blurs into survey research at the structured end and is most useful when cases must be compared on standardised items.

Bernard, Wutich, and Ryan treat structured interviewing as legitimate and underused in qualitative methods. A grounded-theory study that has matured to the point of needing to test specific propositions can benefit from a structured-interview phase, even if the early phases used semi-structured or unstructured methods. The constant-comparative method is well-served by structured comparison at a late stage.

3.4 Focus Groups

Focus groups (or group interviews) are a qualitatively distinct elicitation method, well beyond “an interview with more people.” The defining feature is that the data are produced by the group interaction rather than by individuals serially (Kitzinger, 1994). Participants respond to each other; they agree, disagree, build on, qualify, and contest one another's framings. The data are dialogical. Richard Krueger's Focus Groups: A Practical Guide for Applied Research (5th edition, 2015) is the canonical methodological treatment; Kitzinger (1995) is the standard short-form introduction in the medical literature.

When focus groups outperform individual interviews

Focus groups (Krueger & Casey, 2015) are the right choice in five situations identified across Bernard, Wutich, and Ryan (2017) and Krueger:

1. When you want to surface the range of views in a community, where the group format brings out positions individuals might not articulate alone.
2. When the topic is best discussed collectively: community priorities, policy preferences, evaluation of a programme, perceptions of a public-health campaign.
3. When you want to observe how categories are negotiated in real time: what becomes consensus, what gets contested, what is unspeakable.
4. When you have limited time and the question is breadth more than depth, six focus groups of eight people each produce a dataset of 48 voices in roughly the same time as eight individual interviews.
5. When the population is reluctant to speak alone: some communities prefer collective speech; some topics are easier to discuss with peers present than with a researcher alone.

When focus groups are the wrong choice

Focus groups are the wrong choice when the topic is too sensitive for collective disclosure (sexual behavior, intimate partner violence, suicidality, stigmatised illness), when the participants are in unequal power relationships with each other (boss and subordinate, parent and adolescent), when the population is too small to recruit groups, or when the research question requires the kind of sustained individual narrative that group dynamics interrupt.

For loneliness research specifically, the choice is non-obvious. Individual interviews allow the participant to disclose the intimate and stigmatising dimensions of loneliness (Maya's comment “loneliness feels like admitting I'm failing at being 22” would be hard to say in a group). Focus groups allow you to see how loneliness is talked about collectively: what the public vocabulary is, what is performable and what is not, what stays unsayable. A study using both methods would learn things neither alone could reveal.

3.5 Cultural-Domain Elicitation Methods (Preview)

Bernard, Wutich, and Ryan (pp. 92–96) introduce a family of elicitation methods specifically designed to surface the structure of a cultural domain: how members of a community categorise, order, and relate concepts within a topic area. These methods will be the focus of a later module, where you will analyse them with networking and clustering techniques. For now, learn the names and what they do.

• Free listing. The simplest cultural-domain method: ask a sample of people to list, say, “all the kinds of loneliness you can think of.” The frequency with which each item appears, and the average position in the list, together index its cultural salience.
• Pile sorts. Hand participants a set of cards (each with a concept or item) and ask them to sort the cards into piles of things that go together. Aggregated across participants, the sorts yield a similarity matrix that can be analysed with multidimensional scaling or hierarchical clustering (statistical techniques that turn those groupings into a map of what people treat as similar to what).
• Triad tests. Show participants three items at a time and ask which two are most similar (or which one is most different). Aggregated across triads, the data yield a similarity matrix similar to pile-sort output.
• Ranking tasks. Ask participants to order a set of items along a specified dimension (e.g., from least to most lonely, from most to least helpful).

These methods are powerful for studying the structure of a cultural domain, what its elements are and how they relate, in a way that open-ended interviewing cannot match. They are also fast: a free list can be elicited in two minutes per participant, allowing samples of several hundred people in a single study. The cost is depth: cultural-domain methods are structurally rich but phenomenologically shallow. You learn how loneliness is categorised, not what it feels like.

3.6 Open-Ended Survey Items

The final elicitation form is the humble open-ended survey item: the “please describe in your own words” box at the back of a questionnaire. Bernard, Wutich, and Ryan treat these as the most underused qualitative-data source in public health, partly because the items are often included for completeness rather than analysed, partly because the data are typically thin (a sentence or two per response) and easy to dismiss.

The corrective is to design open-ended items deliberately, position them where respondents have time to answer (early in the survey, not buried at the end), provide enough space to invite expansion, and budget the analytic time the responses deserve. A 2,000-respondent survey with even a 40 percent response rate to one open-ended item gives you 800 qualitative responses, a respectable corpus that can be theme-analysed, content-analysed, or topic-modelled (a later module).

Introduction and Overview

You have now seen the three families of qualitative data collection: indirect, direct, and elicitation. The last section of this lesson turns to what happens after the data are collected: the work of transforming spoken speech into transcripts and field experience into field notes. Bernard, Wutich, and Ryan treat both as analytic acts in their own right, not as neutral preparation. The decisions you make at this stage shape what later analysis can see, and, for a pre-collected dataset such as the course's loneliness interviews, the decisions someone else made before the analyst arrived have already shaped what is available.

4.1 Transcription as Analytic Act

Transcription is the conversion of recorded speech into written text. The conversion seems, on first encounter, mechanical: type what you hear. In practice, transcription requires hundreds of small interpretive decisions per transcript. Should “um” be transcribed? What about “you know” and “like” when they are filler? Should false starts be preserved or smoothed? Should the pause between words be timed? Should laughter be marked, and if so, how? Should overlapping speech be shown with brackets? Should non-verbal sounds (a sigh, a cough, a chair scraping) be annotated?

Each of these decisions shapes what later analysis can see. A transcript that omits filled pauses and false starts cannot support conversation analysis, because the analytic categories conversation analysts work with (a later module) are built on exactly those features. A transcript that omits laughter cannot support narrative-affective analysis, because the laugh-marker is often the most analytically interesting moment in a turn. A transcript that strips out vocalised pauses turns the speech of an articulate participant and the speech of a halting one into the same kind of text, masking a phenomenon that may matter for what you are studying.

Bernard, Wutich, and Ryan frame this as a methodological commitment: the level of transcription should be matched to the analytic intent. If you plan content analysis or thematic analysis, light transcription is sufficient. If you plan discourse or conversation analysis, you need much heavier transcription. If you do not yet know which method you will use, err on the side of more detail: you can simplify a detailed transcript later, but you cannot recover what was never written down.

4.2 Four Transcription Conventions

No convention is right for every study. The level follows the analytic aim: a study of what participants said can work from intelligent or clean verbatim, while a study of how they said it needs verbatim or Jefferson detail. Whatever the level, the research team writes down which sounds it keeps (fillers, laughter, pauses, overlaps) and applies that rule to every transcript, so that the transcripts are comparable and the methods section can report the convention.

What level is this course's dataset?

The course dataset is transcribed at the verbatim level, without Jefferson detail. Read any transcript and you can see the conventions: filled pauses (“um,” “like”) are kept, false starts and self-corrections are visible (Maya's “nobody, nobody acknowledges” and “hollow isn't the right word, it's like an ache”), laughter is annotated [laughs], long pauses are marked [pause] or [long pause] without timing, and dashes mark mid-utterance self-interruptions. Because fillers and false starts are kept, the transcripts are verbatim; an intelligent-verbatim version would have removed them.

What the dataset does not have is Jefferson-level detail: pause durations are not numerically timed, overlapping speech is not bracketed in CA notation, intonation contours and stress are not marked, in-breaths are not transcribed. A later module, which works on discourse and conversation analysis, will return to this. For most analytic work in this course, the verbatim level is what the transcripts provide.

4.3 Field Notes: Emerson, Fretz & Shaw

Robert Emerson, Rachel Fretz, and Linda Shaw's Writing Ethnographic Fieldnotes (Emerson, Fretz, & Shaw, 2011) is the standard methodological treatment of field-note writing in contemporary qualitative methodology. The Emerson/Fretz/Shaw progression organises field-note writing into three stages, each with a distinct purpose and discipline.

Stage 1: Jottings. Brief, in-the-moment notes scribbled in a small notebook (or, increasingly, in a phone notes app) during or immediately after observation. Jottings are not for the reader; they are for the writer's later self. They typically include a few key words per moment, enough to trigger memory when the writer sits down to expand them. The discipline is to capture the specific concrete particular: who said what, what they were doing, what time it was, what was on the wall. The temptation is to write analytic interpretations on the spot; the discipline is to resist this and write only what could be photographed if a camera had been present.

Stage 2: Expanded notes. Written as soon as possible after the observation (ideally the same day), expanded notes turn the jottings into full descriptive prose. The discipline is to write at length and in the present tense, recreating the scene so a reader could enter it. Expanded notes are typically several pages per hour of observation. They include direct quotations where possible, descriptive detail of setting, and observations of body language, sequence, and timing. They do not yet include analytic interpretation: the discipline is to keep description and analysis separated, because analysis dressed as observation gets remembered as observation and cannot be challenged later.

Stage 3: Analytic memos. Written separately from the expanded notes (often in a different document or notebook section), analytic memos record the researcher's evolving interpretation: what the field experience seems to mean, what patterns are emerging, what theoretical connections are forming, what hypotheses are taking shape. Memos are dated, indexed, and treated as part of the data corpus, and you cite your own memos in the eventual methods section because the audit trail of analytic development is part of what transparency owes the reader.

Analytic memos in transcript-based work

Work with a pre-collected dataset involves no fieldwork in the traditional sense, but the discipline of separating description from analysis applies to reading transcripts. Analysts keep an analytic-memo file (a single .md or .docx document, with dated entries that are never deleted) throughout a project. Every analytic insight about the data, every “what if” thought, every emerging connection, every “Maya and Helen both...” observation, goes into the memo file. Lesson 6 returns to memos; by the time codebook development begins, the accumulated memos are its raw material.

4.4 Familiarisation Before Coding

Familiarisation is the first phase of most approaches to qualitative analysis, including thematic analysis (Lesson 5, Section 1.4). Bernard, Wutich, and Ryan are explicit, as most experienced qualitative researchers are, that familiarity with the data is the precondition of analysis. Transcripts that have only been skimmed cannot be coded well, and a theme is hard to recognise in a transcript read for the first time inside coding software.

A practical tool is a dataset familiarisation log: a structured table with one row per transcript, recording who the participant is, the main topics of the account, striking phrases and metaphors, moments where the transcription conventions matter, and first analytic hunches, followed by a short reflection on what the reading has taught the analyst about the data. For the course dataset, six to eight transcripts chosen to span age, gender, and life stage give a good first sense of the corpus. The transcripts are in HSCI_841_loneliness_data.zip (the 20 interview transcripts, participant tables and codebooks).

Bringing It All Together

This lesson has mapped the three families of qualitative data collection (indirect, direct, elicitation), located the course dataset within the semi-structured-interview tradition, treated transcription and field-note writing as analytic acts in their own right, and described familiarisation with the data before coding. With this lesson complete, you have the full design vocabulary the rest of the term will draw on: later in the course you start coding, in later modules you start building conceptual models, in later modules you move into specialised analytic techniques. The data are now familiar enough to start working on, beyond reading.

The final reflection asks you to integrate what you have learned about data collection with what you know about the course dataset, before the next lesson turns to coding.

Final Knowledge Assessment

This glossary collects the key concepts, people, and methodological stances introduced in this lesson. Use it as a reference while you work through the material, or as a review before the final assessment. Type in the search box to filter entries.