Explain how to choose and justify a methodology for the Independent Study, matching method to question across conceptual, empirical and mixed approaches and addressing rigour and ethics

What this dot point is asking

SEAB wants you to understand how to choose and justify a methodology for the Independent Study: the set of methods by which the inquiry will actually answer its research question. The governing idea is fit: the method must be capable of producing the kind of evidence or argument the question requires, and you must be able to justify it, not merely default to whatever is convenient. Your task is to explain how to match method to question and how to judge a method's rigour and appropriateness.

The answer

Fit method to question, not question to method

The first principle is that the research question dictates the method, not the reverse. The question determines what would count as an answer, and therefore what kind of evidence or reasoning could provide it. Choosing a method first and then bending the question to suit it is a common and serious error, because it produces a study that answers a different question from the one posed. So methodology selection begins by asking: what would it take to answer this question?

Conceptual methods

A conceptual or evaluative question, the kind Knowledge and Inquiry often favours, is answered by philosophical method rather than data collection. This means clarifying and defining the key concepts, reconstructing the relevant arguments and positions, evaluating them for validity and soundness, and testing principles with thought experiments and counterexamples. A question such as "does a desert-based or a need-based principle better fit our considered judgements about fair access to healthcare?" cannot be settled by a survey; it requires the analysis and argument-evaluation skills of the reasoning area.

Empirical methods: qualitative and quantitative

An empirical question, about how things actually are, calls for the collection and analysis of evidence. Qualitative methods (interviews, focus groups, close textual or case analysis) are suited to questions about meaning, interpretation and the texture of experience, where the aim is depth and understanding. Quantitative methods (surveys, experiments, statistical analysis) are suited to questions about measurement, frequency and generalisable patterns, where the aim is breadth and the testing of hypotheses. The choice between them follows from whether the question seeks understanding of meaning or measurement of a pattern.

Mixed and the danger of category errors

Many strong questions are mixed, requiring empirical findings to feed a conceptual argument: you might survey attitudes to fairness and then ask whether those attitudes match a defensible conception of fairness. A frequent category error is to answer a conceptual question with an empirical method, for example treating "what is just?" as settled by a poll of opinion. What people think is just is an empirical fact; what is just is a conceptual and evaluative question. Confusing the two derails the study, so part of justifying a method is showing it addresses the right kind of question.

Criteria of rigour, feasibility and ethics

A method must be judged rigorous and appropriate. For empirical methods, rigour means validity (it measures what it claims to), reliability (consistent results on repetition), representativeness of any sample (so findings generalise), control of confounders, and freedom from bias. For conceptual methods, rigour means clear definitions, valid arguments, charitable treatment of opposing views, and well-constructed cases. Cutting across both are appropriateness (the method genuinely bears on the question), feasibility (it can be done with the available time, access and skills), and ethics (it respects the rights and wellbeing of any participants, including informed consent, confidentiality and the avoidance of harm). A defensible methodology section states the method, justifies it against these criteria, and acknowledges its limits.

Examples in context

Example 1. A survey that answers the wrong question. A student wants to know whether a punishment is just and runs a survey asking people if they think it is just. The survey reliably measures opinion, but the research question was normative, so the data cannot answer it: widespread approval does not make a punishment just. The example shows the category error of answering a conceptual question with an empirical method, and why justifying a method requires matching it to the kind of question.

Example 2. Qualitative depth versus quantitative breadth. Two students study trust in expert advice. One wants to understand how individuals reason about whom to trust and chooses in-depth interviews (qualitative), suited to meaning and texture. The other wants to know how trust varies across a population and chooses a large survey (quantitative), suited to measurable patterns. Neither method is better in the abstract; each fits its question. The case illustrates choosing between qualitative and quantitative by what the question seeks.

Try this

Q1. Explain the principle that should govern the choice of methodology and why. [6 marks]

• Cue. Method must fit the question, because the question determines what would count as an answer and hence what evidence or reasoning could provide it; choosing a method first risks answering a different question.

Q2. Distinguish when a qualitative and when a quantitative empirical method is appropriate. [6 marks]

• Cue. Qualitative (interviews, textual analysis) suits questions about meaning, interpretation and depth; quantitative (surveys, experiments) suits questions about measurement, frequency and generalisable patterns.

Q3. State four criteria for judging whether an empirical method is rigorous and appropriate. [8 marks]

• Cue. Any four of: validity, reliability, representativeness of the sample, control of confounders, freedom from bias, and the cross-cutting appropriateness, feasibility and ethics (consent, confidentiality, avoidance of harm).