S27 · Chapter 14 · MC 451 Research Methods in Mass Media
Dr. Alex Leith
Where the study stands
The Publisher
A question and a theory, a codebook tested for reliability
A sample drawn with a defensible procedure, and a clean dataset
Three figures, and a finding tested and interpreted honestly
Every hard part is finished. And the study is still not done.
It lives in pieces: a script, a folder of images, output that scrolled past
Scattered across a dozen files, that is raw material, not a study
The fragile way to write it up
Run the analysis in R
Copy the numbers into a word processor
Screenshot the figures and paste them in
Write the prose around them
This works, and it is quietly fragile. Change one coding rule and every pasted number is silently out of date, with nothing in the document saying so.
A report that rebuilds itself
Stop copying. Put the analysis inside the document.
A Quarto document (.qmd) interleaves prose with code chunks
When you render, Quarto runs every chunk and drops the output where it sat
Tables, figures, and test statistics all arrive from the code
Nothing is typed by hand, so nothing can fall out of date
Numbers computed inline
The analysis dataset held `r nrow(analysis)` coded messages, of which`r sum(!is.na(analysis$is_gaming))` carried a gaming-status label.
Those backtick expressions become the actual counts in the rendered report. Add a hundred messages, re-render, and the sentence updates itself.
Figures produced, not pasted
#| label: fig-msglen#| echo: false#| fig-cap: "Message length by channel type."ggplot(msglen, aes(message_length, fill = is_gaming)) +geom_histogram(binwidth =5) + v2v::theme_v2v()
The histogram is not an image you drag in. It is a chunk that lives in the report and redraws itself every render. echo: false hides the code, shows the plot.
Your turn
Where in your own project have you already pasted a number by hand?
What would break if your data changed tomorrow?
Which of your figures could you produce from code inside the report today?
Two minutes with a neighbor, then we compare.
Why this matters
The report cannot drift from the analysis, because the report is the analysis
Anyone with your source and your data can render it and get your results
That is the standard a scientific claim is supposed to meet
Donald Knuth named the idea literate programming in 1984
Runnable code and the prose explaining it belong in one document, not two
IMRaD, the shape of a report
Introduction, Methods, Results, Discussion. Four sections, in that fixed order, and the order is itself an argument.
It carries a reader from why the study was done, to what it found, to what it means
An abstract sits in front. References close it.
The V2V Hub ships an imrad-template.qmd with the skeleton in place
Not bureaucracy: a contract with the reader about where to look
Introduction and Methods
Introduction states the question and why it is worth asking. For the chat study that is the prospectus: do gaming and non-gaming channels differ, and what would a uses-and-gratifications account predict.
Methods says exactly what was done, in enough detail to repeat it. Your codebook, your sampling procedure, your reliability check, your wrangling.
Methods earns the reader’s trust, and a reproducible document supports it best: the code that did the work is right there to read.
Results and Discussion
Results reports what was found, plainly and without interpretation. Your figures, your distributions, your group means, your test statistic with its degrees of freedom, its p-value, and its effect size. Facts only.
Discussion says what it means: that the difference is statistically real but negligible, and what that implies for the question you opened with.
Discussion is also where an honest study states its limits.
One site, many pages
The report is not the only document your study produced
There is also the codebook, the sampling record, the wrangling log
These do not get crushed into one enormous file. They become pages of one site.
_quarto.yml names the site and lists its pages and navigation bar
quarto render builds every page at once into a complete website
Going live
A website in a folder on a laptop is still private
Publishing means giving it a public address
The standard free option is GitHub Pages, which serves a site from a repo
v2v::deploy_portfolio() runs the checks and then publishes
What it hands back is a URL. That URL is your White Paper.
The pre-flight checks
v2v::deploy_portfolio()
Pre-flight checks
renv library in sync ......... ok
no uncommitted changes ....... ok
_quarto.yml valid ............ ok
Rendering 4 pages ... done
Live at: https://username.github.io/twitch-chat-study/
Three checks run before anything publishes, and only if all three pass does it deploy.
Why the checks exist
renv in sync: the site was built with the package versions your source declares
No uncommitted changes: what goes live matches the work you actually saved
Valid _quarto.yml: the render will not collapse halfway through
Each heads off a specific, demoralizing failure
The point is that the last step of a long study is the calm one
The reflection
One short piece remains: a one-paragraph reflection
Not part of IMRaD, not a result. Your own candid account.
Name what was harder than expected, where a coding rule went ambiguous, what the dataset could not answer
Resist both easy failures: everything went well, everything went wrong
A researcher who can say where their study is weak understands it
Before next time
Thursday is a studio: peer review, plus the reflection, in class
Bring a rendered draft of your White Paper, not notes toward one
It does not have to be finished. It has to render.
Bring your project’s public URL if you have one, or the error stopping you
The White Paper is due finals week. Thursday is your last full work session.