- Write a methods section that names the methodology and makes the workflow traceable.
- Map a study’s inputs, actors, procedures, decisions, outputs, and deviations.
- Separate a short summary of a study from a description another researcher could follow.
- Choose a reporting guide that fits the research design.
By the end of this module, you will be able to:
Map a study from its research question through data generation, decisions, and results.
Distinguish a methodological label from a traceable description of what researchers actually did.
Identify missing information about sampling, procedures, instruments, decisions, and deviations.
Select reporting guidance that fits a study’s design and use it to improve a methods account.
A methods section says, “We recruited students and conducted a learning activity,” but never explains which students were eligible, how they entered the study, or what the activity involved. A reader cannot trace the path from the research question to the reported result when these decisions remain implicit. A usable account identifies the setting, data source or participants, selection process, procedures, instruments, data generation, analytic decisions, and departures from the original plan. Reporting guidance exists to help authors communicate this information clearly and to help readers assess what was done. Journal Article Reporting Standards for Quantitative Research in Psychology
Transparent reporting makes a design inspectable. It does not establish that the design was valid, ethical, unbiased, or suitable for the research question; readers still need to make those judgements from the reported evidence.
A reader should be able to move forward through the study and answer a simple question at every stage: what happened next, who made the decision, and on what basis? The pathway begins with the research question and ends with the results, but it must show the intermediate steps that connect them.
Use this sequence to draft or review a methods account:
Research question and aim
State the problem, question, objective, or hypothesis. Explain how the design addresses that question.
Methodological approach
Name the approach—such as observational, experimental, qualitative, mixed methods, longitudinal, or secondary-data analysis—and explain how it shaped the work. A methodological approach is the overall logic for gathering and interpreting evidence.
Setting and data source
Describe where and when the study occurred, or identify the existing data source. Include contextual features that could affect data generation or interpretation.
Participants, cases, or records
State what was studied: people, teams, courses, events, documents, platform records, or another unit of analysis. Give characteristics needed to understand the sample or source.
Sampling and selection
Explain how cases were approached, recruited, identified, or selected. Report inclusion and exclusion criteria, self-selection where relevant, and decisions about incomplete, duplicate, or ineligible records. Quantitative reporting guidance specifically calls for inclusion and exclusion criteria and for procedures used to select participants. Journal Article Reporting Standards for Quantitative Research in Psychology
Procedure or intervention
Describe what participants, researchers, instructors, or systems did, in order. For an intervention, report the materials, activities, provider, delivery mode, setting, timing, and intended amount. A label alone does not tell another researcher how to carry out the procedure. Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide
Instruments and data generation
Define measures, variables, prompts, logs, observations, or records. Explain how data were collected, recorded, transformed, and linked to cases.
Decision points
State rules made before data analysis where possible: eligibility decisions, stopping rules, missing-data handling, transformations, outlier processing, and distinctions between planned and exploratory analyses. If a decision changed after analysis began, say so and give the reason. Journal Article Reporting Standards for Quantitative Research in Psychology
Deviations from plan
Report what changed, when it changed, why it changed, and how the actual study differed from the intended study. A deviation is not automatically a flaw; hiding it prevents readers from understanding the study as conducted.
Analysis and result
Explain how the generated data became the reported result. Keep the chain visible: question → design → source → selection → procedure → data → decisions → analysis → result.
Naming a design is useful, but it is only a starting point. “We used a mixed-methods design” or “we conducted a quasi-experiment” tells the reader a broad category, not the workflow that produced the evidence.
For qualitative work, a complete design description includes the approach to inquiry, data-collection strategies, and data-analytic strategies—not merely the name of an established method. Journal Article Reporting Standards for Qualitative Primary, Qualitative Meta-Analytic, and Mixed Methods Research in Psychology
Too vague | What is missing | More useful reporting |
|---|---|---|
“We analysed learning-platform data using a quasi-experimental design.” | The platform, course context, date range, comparison groups, assignment process, inclusion rules, measures, and analysis decisions. | “We compared two sections of the same graduate course during one term. Students remained in their enrolled sections; no random assignment occurred. We included students with consent and at least one recorded course activity, extracted weekly activity records and assessment scores, and compared change in assessment scores while reporting missing-score handling.” |
“We interviewed instructors and used thematic analysis.” | Who the instructors were, how they were selected, interview conditions, central prompts, recording and transcription, who analysed the data, and how themes were developed. | “We invited instructors who had taught the course in the previous year. One researcher conducted recorded semi-structured online interviews using prompts about feedback practices; recordings were transcribed before two researchers developed and revised theme definitions through repeated comparison of transcripts.” |
“Students received a feedback intervention.” | The feedback content, materials, provider, delivery mode, timing, frequency, adaptations, and whether delivery matched the plan. | “Teaching assistants sent each participant a rubric-based message through the course system after each weekly task. The message identified one strength, one improvement priority, and one suggested next action; staff used a shared template and recorded whether each message was sent.” |
The improved statements are still brief. Their value is that they reveal the actors, inputs, sequence, and decisions a reader needs to inspect.
Reporting guidance can prompt authors to describe information readers need to understand and evaluate a study. It can also help reviewers notice absent details, such as participant selection, measurement, procedure, data processing, or changes during the study. Quantitative guidance is designed to be comprehensive, but authors are expected to select the items that apply to the particular study. Journal Article Reporting Standards for Quantitative Research in Psychology
Choose a guide by starting with the study’s design and data-generating process, not with the journal, discipline, or a desire to complete every possible item. For example:
Use guidance for a new quantitative data collection when reporting sampling, measures, conditions, and analysis.
Add design-specific guidance when the study includes an experimental manipulation, observational comparison, longitudinal data, or a replication.
Use qualitative guidance that supports reporting the approach to inquiry, researcher role, participant or data-source selection, data collection, analysis, and methodological integrity.
For a mixed-methods study, report the qualitative and quantitative strands separately and explain how they were integrated. Journal Article Reporting Standards for Qualitative Primary, Qualitative Meta-Analytic, and Mixed Methods Research in Psychology
A guide is not a quality guarantee. Completing prompts cannot prove that a study was well designed, ethically conducted, free of bias, or appropriate for its question. It can only make the reported account more complete and easier to examine.
We investigated whether automated progress messages improve participation in an online course. We used a quasi-experimental design with undergraduate students. Students in the intervention course received progress messages for six weeks, and we compared their activity with that of students in another course. We analysed platform logs and found higher participation in the intervention course.
Research question: Whether progress messages improve participation is stated.
Approach: “Quasi-experimental” signals a nonrandom comparison, but the excerpt does not explain how courses were chosen or whether the groups differed before the intervention.
Setting and participants: The excerpt identifies undergraduate students and online courses, but not the institution, course context, period, or number of students.
Sampling: Gap 1: It does not state who was eligible, whether all enrolled students were included, whether consent affected inclusion, or how inactive or incomplete records were handled.
Procedure: Gap 2: “Progress messages” does not explain their content, sender, delivery channel, schedule, or whether all students received them as planned.
Data generation: Platform logs are named, but the participation measure is undefined.
Decision points: The excerpt does not state how missing data, withdrawals, or course differences were handled.
Result: The reported comparison cannot be interpreted fully because the pathway into the analysis is unclear.
In the intervention course, a teaching assistant sent each enrolled student one progress message through the learning platform at the end of each week for six weeks. Each message stated the student’s completion status for that week’s required activities, identified any incomplete activity, and directed the student to the relevant course page. The assistant used a shared message template and recorded the date each message was sent. Students in the comparison course received the course’s usual weekly announcements but no individual progress message.
This revision makes the intervention inspectable. It still does not establish that the comparison was fair or that the messages caused any difference in participation.