6.1 Writing your research question

So, what makes a good research question? First, it is generally written in the form of a question. To say that your research question is “the opioid epidemic” or “animal assisted therapy” or “oppression” would not be correct. You need to frame your topic as a question, not a statement. A good research question is also one that is well-focused. A well-focused question helps you tune out irrelevant information and not try to answer everything about the world all at once. You could be the most eloquent writer in your class, or even in the world, but if the research question about which you are writing is unclear, your work will ultimately lack direction.

Criteria of a good research question

In addition to being written in the form of a question and being well-focused, a good research question is one that cannot be answered with a simple yes or no. For example, if your interest is in gender norms, you could ask, “Does gender affect a person’s performance of household tasks?” but you will have nothing left to say once you discover your yes or no answer. Instead, why not ask, about the relationship between gender and household tasks. Alternatively, maybe we are interested in how or to what extent gender affects a person’s contributions to housework in a marriage? By tweaking your question in this small way, you suddenly have a much more fascinating question and more to say as you attempt to answer it.

A good research question should also have more than one plausible answer. In the example above, the student who studied the relationship between gender and household tasks had a specific interest in the impact of gender, but she also knew that preferences might be impacted by other factors. For example, she knew from her own experience that her more traditional and socially conservative friends were more likely to see household tasks as part of the female domain, and were less likely to expect their male partners to contribute to those tasks. Thinking through the possible relationships between gender, culture, and household tasks led that student to realize that there were many plausible answers to her questions about how gender affects a person’s contribution to household tasks. Because gender doesn’t exist in a vacuum, she wisely felt that she needed to consider other characteristics that work together with gender to shape people’s behaviors, likes, and dislikes. By doing this, the student considered the third feature of a good research question–she thought about relationships between several concepts. While she began with an interest in a single concept—household tasks—by asking herself what other concepts (such as gender or political orientation) might be related to her original interest, she was able to form a question that considered the relationships among those concepts.

This student had one final component to consider. Social work research questions must contain a target population. Her study would be very different if she were to conduct it on older adults or immigrants who just arrived in a new country. The target population is the group of people whose needs your study addresses. Maybe the student noticed issues with household tasks as part of her social work practice with first-generation immigrants, and so she made it her target population. Maybe she wants to address the needs of another community. Whatever the case, the target population should be chosen while keeping in mind social work’s responsibility to work on behalf of marginalized and oppressed groups.

In sum, a good research question generally has the following features:

• It is written in the form of a question
• It is clearly written
• It cannot be answered with “yes” or “no”
• It has more than one plausible answer
• It considers relationships among multiple variables
• It is specific and clear about the concepts it addresses
• It includes a target population

Let’s take a look at a few more examples of possible research questions and consider the relative strengths and weaknesses of each. Table 6.1 does just that. While reading the table, keep in mind that I have only noted what I view to be the most relevant strengths and weaknesses of each question. Certainly each question may have additional strengths and weaknesses not noted in the table. Each of these questions is drawn from student projects in my research methods classes and reflects the work of many students on their research question over many weeks.

Writing a research question is an iterative process, and you will need to reflect on your learning to make sure your question continues to reflect the unfolding focus of your inquiry.

Matching your research question and instructor expectations

This chapter described how to create a good quantitative and qualitative research question. Perhaps this is as far as it needs to go for your project. Some students may only need to conduct an evidence-based practice literature review, and in that case, Parts 2 and 3 of this textbook will be of use as a reference for further information about the research process.

As you are getting ready to finalize your research question and move into designing your research study, it is important to check whether your research question is feasible for you to answer and what importance your results will have in the community, among your participants, and in the scientific literature. For the majority of students in a social work research methods class, you are required to create a research question that can be answered in an empirical study using quantitative or qualitative methods. Some students will even need to collect and analyze data. if you are not sure yet, please consult the course syllabus and your instructor!

Feasibility of student data collection

Many programs use their research methods courses as a capstone or multi-semester project. Many students want to write honors theses. There are good reasons to collect your own data, and student research has the potential to impact local communities, programs, and clients. For those on the journey of human subjects research from data collection to data analysis, there are a few key elements of feasibility to consider when crafting your research question:

• Do you have access to the data you need?
• Will you be able to get consent from stakeholders, gatekeepers, and others?
• Does your project pose risk to individuals through direct harm, dual relationships, or breaches in confidentiality? (see Chapter 6 for more ethical considerations)
• Are you competent enough to complete the study?
• Do you have the resources and time needed to carry out the project?

For example, students in my classroom have often had to survey or interview practitioners, rather than clients, to avoid having to get ethics board approval. Students may have to analyze autobiographies or movies, rather than asking community members about sensitive topics. There are a lot of compromises that go into setting a feasible project for data analysis, and these should be reflected in your question. If a student’s original question centered on the relationship between suicide and homelessness among older adults, a feasible project’s research question might start, “According to popular movies, what is the relationship between suicide and homelessness among older adults?” or “According to clinical social workers, what is the relationship between suicide and homelessness among older adults?”

Other students, like those in my class, have to propose a hypothetically feasible study. It could work, if given enough funding, training, and time! In that case, you will need to ask yourself could you have access to the data you need, could you get consent from stakeholders, and so forth. Students can demonstrate research competence by proposing a multi-million dollar demonstration project testing three different evidence-based therapies, but they would not feasibly be able to carry out such an endeavor. Someone with a big federal grant could, and writing such a proposal is good practice for future grant writing.

Despite practical limitations, as we reviewed in Chapter 2, student projects can make a difference. Key questions to consider when evaluating the importance of your question include:

• Can we answer your research question simply by looking at the literature on your topic? Why do we need to collect new data?
• How does your data collection add something new to the scholarly literature? (raises a new issue, addresses a controversy, studies a new population, etc.)
• How will your target population benefit, once you collection your data?
• How will the community, social work practice, and the broader social world benefit, once you answer your research question?

Be honest. If your project won’t contribute much to an agency or client you collect data from, it should help you frame that as solely a learning experience for you.

6.2 Writing your literature review

Writing about research is different than other types of writing. Research writing is not like a journal entry or opinion paper. The goal here is not to apply your research question to your life or growth as a practitioner. Research writing is about the provision and interpretation of facts. The tone should be objective and unbiased, and personal experiences and opinions are excluded. Particularly for students who are used to writing case notes, research writing can be a challenge. That’s why its important to normalize getting help! If your professor has not built in peer review, consider setting up a peer review group among your peers. You should also reach out to your academic advisor to see if there are writing services on your campus available to graduate students. No one should feel bad for needing help with something they haven’t done before, haven’t done in a while, or were never taught how to do. 

If you’ve followed the steps in this chapter, you likely have an outline, summary table, and concept map from which you can begin the writing process. But what do you need to include in your literature review? We’ve mentioned it before, but to summarize, a literature review should:

• Introduce the topic and define its key terms.
• Establish the importance of the topic.
• Provide an overview of the important literature related to the concepts found in the research question.
• Identify gaps or controversies in the literature.
• Point out consistent findings across studies.
• Synthesize that which is known about a topic, rather than just provide a summary of the articles you read.
• Discuss possible implications and directions for future research.

Do you have enough facts and sources to accomplish these tasks? It’s a good time to consult your outlines and notes on each article you plan to include in your literature review. You may also want to consult with your professor on what is expected of you. If there is something you are missing, you may want to jump back to section 2.3 where we discussed how to search for literature. While you can always fill in material, there is the danger that you will start writing without really knowing what you are talking about or what you want to say. For example, if you don’t have a solid definition of your key concepts or a sense of how the literature has developed over time, it will be difficult to make coherent scholarly claims about your topic.

There is no magical point at which one is ready to write. As you consider whether you are ready, it may be useful to ask yourself these questions:

• How will my literature review be organized?
• What section headings will I be using?
• How do the various studies relate to each other?
• What contributions do they make to the field?
• Where are the gaps or limitations in existing research?
• And finally, but most importantly, how does my own research fit into what has already been done?

The problem statement

Scholarly works often begin with a problem statement, which serves two functions. First, it establishes why your topic is a social problem worth studying. Second, it pulls your reader into the literature review. Who would want to read about something unimportant?

A problem statement generally answers the following questions, though these are far from exhaustive:

• Why is this an important problem to study?
• How many people are affected by this problem?
• How does this problem impact other social issues relevant to social work?
• Why is your target population an important one to study?

A strong problem statement, like the rest of your literature review, should be filled with empirical results, theory, and arguments based on the extant literature. A research proposal differs significantly from other more reflective essays you’ve likely completed during your social work studies. If your topic were domestic violence in rural Appalachia, I’m sure you could come up with answers to the above questions without looking at a single source. However, the purpose of the literature review is not to test your intuition, personal experience, or empathy. Instead, research methods are about gaining specific and articulable knowledge to inform action. With a problem statement, you can take a “boring” topic like the color of rooms used in an inpatient psychiatric facility, transportation patterns in major cities, or the materials used to manufacture baby bottles, and help others see the topic as you see it—an important part of the social world that impacts social work practice.

The structure of a literature review

In general, the problem statement belongs at the beginning of the literature review. We usually advise students to spend no more than a paragraph or two for a problem statement. For the rest of your literature review, there is no set formula by which it needs to be organized. However, a literature review generally follows the format of any other essay—Introduction, Body, and Conclusion.

The introduction to the literature review contains a statement or statements about the overall topic. At a minimum, the introduction should define or identify the general topic, issue, or area of concern. You might consider presenting historical background, mentioning the results of a seminal study, and providing definitions of important terms. The introduction may also point to overall trends in what has been previously published on the topic or on conflicts in theory, methodology, evidence, conclusions, or gaps in research and scholarship. We also suggest putting in a few sentences that walk the reader through the rest of the literature review. Highlight your main arguments from the body of the literature review and preview your conclusion. An introduction should let the reader know what to expect from the rest of your review.

The body of your literature review is where you demonstrate your synthesis and analysis of the literature. Again, do not just summarize the literature. We would also caution against organizing your literature review by source—that is, one paragraph for source A, one paragraph for source B, etc. That structure will likely provide an adequate summary of the literature you’ve found, but it would give you almost no synthesis of the literature. That approach doesn’t tell your reader how to put those facts together, it doesn’t highlight points of agreement or contention, or how each study builds on the work of others. In short, it does not demonstrate critical thinking.

Organize your review by argument

Instead, use your outlines and notes as a guide what you have to say about the important topics you need to cover. Literature reviews are written from the perspective of an expert in that field. After an exhaustive literature review, you should feel as though you are able to make strong claims about what is true—so make them! There is no need to hide behind “I believe” or “I think.” Put your voice out in front, loud and proud! But make sure you have facts and sources that back up your claims.

I’ve used the term “argument” here in a specific way. An argument in writing means more than simply disagreeing with what someone else said, as this classic Monty Python sketch demonstrates. Toulman, Rieke, and Janik (1984) identify six elements of an argument:

1. Claim: the thesis statement—what you are trying to prove
2. Grounds: theoretical or empirical evidence that supports your claim
3. Warrant: your reasoning (rule or principle) connecting the claim and its grounds
4. Backing: further facts used to support or legitimize the warrant
5. Qualifier: acknowledging that the argument may not be true for all cases
6. Rebuttal: considering both sides (as cited in Burnette, 2012)^[1]

Let’s walk through an example. If I were writing a literature review on a negative income tax, a policy in which people in poverty receive an unconditional cash stipend from the government each month equal to the federal poverty level, I would want to lay out the following:

1. Claim: the negative income tax is superior to other forms of anti-poverty assistance.
2. Grounds: data comparing negative income tax recipients to people receiving anti-poverty assistance in existing programs, theory supporting a negative income tax, data from evaluations of existing anti-poverty programs, etc.
3. Warrant: cash-based programs like the negative income tax are superior to existing anti-poverty programs because they allow the recipient greater self-determination over how to spend their money.
4. Backing: data demonstrating the beneficial effects of self-determination on people in poverty.
5. Qualifier: the negative income tax does not provide taxpayers and voters with enough control to make sure people in poverty are not wasting financial assistance on frivolous items.
6. Rebuttal: policy should be about empowering the oppressed, not protecting the taxpayer, and there are ways of addressing taxpayer spending concerns through policy design.

Like any effective argument, your literature review must have some kind of structure. For example, it might begin by describing a phenomenon in a general way along with several studies that provide some detail, then describing two or more competing theories of the phenomenon, and finally presenting a hypothesis to test one or more of the theories. Or, it might describe one phenomenon, then describe another that seems inconsistent with the first, then propose a theory that resolves the inconsistency, and finally present a hypothesis to test that theory. In applied research, it might describe a phenomenon or theory, then describe how that phenomenon or theory applies to some important real-world situation, and finally, may suggest a way to test whether it does, in fact, apply to that situation.

Use signposts

Another important issue is signposting. It may not be a term you are familiar with, but you are likely familiar with the concept. Signposting refers to the words used to identify the organization and structure of your literature review to your reader. The most basic form of signposting is using a topic sentence at the beginning of each paragraph. A topic sentence introduces the argument you plan to make in that paragraph. For example, you might start a paragraph stating, “There is strong disagreement in the literature as to whether psychedelic drugs cause people to develop psychotic disorders, or whether psychotic disorders cause people to use psychedelic drugs.” Within that paragraph, your reader would likely assume you will present evidence for both arguments. The concluding sentence of your paragraph should address the topic sentence, discussing how the facts and arguments from the paragraph you’ve written support a specific conclusion. To continue with our example, I might say, “There is likely a reciprocal effect in which both the use of psychedelic drugs worsens pre-psychotic symptoms and worsening psychosis increases the desire to use psychedelic drugs.”

Signposting also involves using headings and subheadings. Your literature review will use APA formatting, which means you need to follow their rules for bolding, capitalization, italicization, and indentation of headings. Headings help your reader understand the structure of your literature review. They can also help if the reader gets lost and needs to re-orient themselves within the document. We often tell our students to assume we know nothing (they don’t mind) and need to be shown exactly where they are addressing each part of the literature review. It’s like walking a small child around, telling them “First we’ll do this, then we’ll do that, and when we’re done, we’ll know this!”

Another way to use signposting is to open each paragraph with a sentence that links the topic of the paragraph with the one before it. Alternatively, one could end each paragraph with a sentence that links it with the next paragraph. For example, imagine we wanted to link a paragraph about barriers to accessing healthcare with one about the relationship between the patient and physician. We could use a transition sentence like this: “Even if patients overcome these barriers to accessing care, the physician-patient relationship can create new barriers to positive health outcomes.” A transition sentence like this builds a connection between two distinct topics. Transition sentences are also useful within paragraphs. They tell the reader how to consider one piece of information in light of previous information. Even simple transitional words like ‘however’ and ‘similarly’ can help demonstrate critical thinking and link each building block of your argument together.

Many beginning researchers have difficulty incorporating transitions into their writing. Let’s look at an example. Instead of beginning a sentence or paragraph by launching into a description of a study, such as “Williams (2004) found that…,” it is better to start by indicating something about why you are describing this particular study. Here are some simple examples:

• Another example of this phenomenon comes from the work of Williams (2004)…
• Williams (2004) offers one explanation of this phenomenon…
• An alternative perspective has been provided by Williams (2004)…

Now that we know to use signposts, the natural question is “What goes on the signposts?” First, it is important to start with an outline of the main points that you want to make, organized in the order you want to make them. The basic structure of your argument should then be apparent from the outline itself. Unfortunately, there is no formula we can give you that will work for everyone, but we can provide some general pointers on structuring your literature review.

From general to specific

The literature review tends to move from general to more specific ideas. You can build a review by identifying areas of consensus and areas of disagreement. You may choose to present historical studies—preferably seminal studies that are of significant importance—and close with the most recent research. Another approach is to start with the most distantly related facts and literature and then report on those most closely related to your research question. You could also compare and contrast valid approaches, features, characteristics, theories – that is, one approach, then a second approach, followed by a third approach.

Here are some additional tips for writing the body of your literature review:

• Start broad and then narrow down to more specific information.
• When appropriate, cite two or more sources for a single point, but avoid long strings of references for a single idea.
• Use quotes sparingly. Quotations for definitions are okay, but reserve quotes for when something is said so well you couldn’t possible phrase it differently. Never use quotes for statistics.
• Paraphrase when you need to relay the specific details within an article
• Include only the aspects of the study that are relevant to your literature review. Don’t insert extra facts about a study just to take up space.
• Avoid reflective, personal writing. It is traditional to avoid using first-person language (I, we, us, etc.).
• Avoid informal language like contractions, idioms, and rhetorical questions.
• Note any sections of your review that lack citations from the literature. Your arguments need to be based in empirical or theoretical facts. Do not approach this like a reflective journal entry.
• Point out consistent findings and emphasize stronger studies over weaker ones.
• Point out important strengths and weaknesses of research studies, as well as contradictions and inconsistent findings.
• Implications and suggestions for further research (where there are gaps in the current literature) should be specific.

The conclusion should summarize your literature review, discuss implications, and create a space for further research needed in this area. Your conclusion, like the rest of your literature review, should make a point. What are the important implications of your literature review? How do they inform the question you are trying to answer?

You should consult with your professor and the course syllabus about the final structure your literature review should take. Here is an example of one possible structure:

• Problem statement
  • Establish the importance of the topic
  • Number and type of people affected
  • Seriousness of the impact
  • Physical, psychological, economic, social, or spiritual consequences of the problem
• Argument 1
  • Definitions of key terms
  • Supporting evidence
  • Common findings across studies, gaps in the literature
• Argument 2
  • Definitions of key terms
  • Supporting evidence
  • Common findings across studies, gaps in the literature
• Argument 3
  • Definitions of key terms
  • Supporting evidence
  • Common findings across studies, gaps in the literature
• Final paragraph
  • Aim
  • Research question(s) and hypothesis(es)

Editing your literature review

Literature reviews are more than a summary of the publications you find on a topic. As you have seen in this brief introduction, literature reviews represent a very specific type of research, analysis, and writing. We will explore these topics further in upcoming chapters. As you begin your literature review, here are some common errors to avoid:

• Accepting a researcher’s finding as valid without evaluating methodology and data
• Ignoring contrary findings and alternative interpretations
• Using findings that are not clearly related to your own study or using findings that are too general
• Dedicating insufficient time to literature searching
• Reporting statistical results from a single study, rather than synthesizing the results of multiple studies to provide a comprehensive view of the literature on a topic
• Relying too heavily on secondary sources
• Overusing quotations
• Not justifying arguments using specific facts or theories from the literature

For your literature review, remember that your goal is to construct an argument for the importance of your research question. As you start editing your literature review, make sure it is balanced. Accurately report common findings, areas where studies contradict each other, new theories or perspectives, and how studies cause us to reaffirm or challenge our understanding of your topic.

It is acceptable to argue that the balance of the research supports the existence of a phenomenon or is consistent with a theory (and that is usually the best that researchers in social work can hope for), but it is not acceptable to ignore contradictory evidence. A large part of what makes a research question interesting is uncertainty about its answer (University of Minnesota, 2016).^[2]

In addition to subjectivity and bias, writer’s block can obstruct the completion of your literature review. Often times, writer’s block can stem from confusing the creating and editing parts of the writing process. Many writers often start by simply trying to type out what they want to say, regardless of how good it is. Author Anne Lamott (1995)^[3] terms these “shitty first drafts,” and we all write them. They are a natural and important part of the writing process.

Even if you have a detailed outline from which to work, the words are not going to fall into place perfectly the first time you start writing. You should consider turning off the editing and critiquing part of your brain for a while and allow your thoughts to flow. Don’t worry about putting a correctly formatted internal citation (as long as you know which source you used there) when you first write. Just get the information out. Only after you’ve reached a natural stopping point might you go back and edit your draft for grammar, APA style, organization, flow, and more. Divorcing the writing and editing process can go a long way to addressing writer’s block—as can picking a topic about which you have something to say!

As you are editing, keep in mind these questions adapted from Green (2012):^[4]

• Content: Have I clearly stated the main idea or purpose of the paper? Is the thesis or focus clearly presented and appropriate for the reader?
• Organization: How well is it structured? Is the organization spelled out and easy to follow for the reader ?
• Flow: Is there a logical flow from section to section, paragraph to paragraph, sentence to sentence? Are there transitions between and within paragraphs that link ideas together?
• Development: Have I validated the main idea with supporting material? Are supporting data sufficient? Does the conclusion match the introduction?
• Form: Are there any APA style issues, redundancy, problematic wording and terminology (always know the definition of any word you use!), flawed sentence constructions and selection, spelling, and punctuation?

APA Style

Social workers use the APA style guide to format and structure their literature reviews. Most students know APA style only as it relates to internal and external citations. If you are confused about them, consult this amazing APA style guide from the University of Texas-Arlington library. Your university’s library likely has resources they created to help you with APA style, and you can meet with a librarian or your professor to talk about formatting questions you have. Make sure you budget in a few hours at the end of each project to build a correctly formatted references page and check your internal citations. The highest quality online source of information on APA style is the APA style blog, where you can search questions and answers from the organization that wrote the publication manual!

Of course, APA style is about much more than knowing there is a period after “et al.” or citing the location a book was published. APA style is also about what the profession considers to be good writing. If you haven’t picked up an APA publication manual because you use citation generators, know that I did the same thing when I was in school. Purchasing the APA manual can help you with a common problem we hear about from students. Every professor (and every website about APA style) seems to have their own peculiar idea of “correct” APA style that you can, if needed, demonstrate is not accurate.

6.3 Writing from an outline

The previous section introduced how research writing uses arguments to structure the review. In Chapter 4, we reviewed how to build a topical outline using quotations and facts from other authors. As you organized new scientific information into a topical outline, the categories and subcategories you created should inform the structure of the arguments in your literature review. It is imperative that you move away from direct block quotations from sources towards your own arguments and ideas. This chapter is all about how to write from an outline of quotes from scientific literature (a topical outline).

I strongly recommend that you watch this video from Nicholas Cifuentes-Goodbody on Outlining. It is not openly licensed, so I cannot embed it here. As the host highlights, outlining is like building a mise en place before a meal–arranging your ingredients in an orderly way so you can create your masterpiece. Personally, I write without an exact sentence in mind but with a pretty detailed outline of the facts and topics I want to cover.

From quotations to original writing

Much like combining ingredients on a kitchen countertop, you will need to mix your ingredients together. If you have ever had a dish with too much parsley or pepper in it, you know the problem of overusing a single ingredient when cooking. In writing research writing, don’t rely too heavily on your sources/ingredients. As you begin writing from your outline, avoid long, block quotations. Put your voice front-and-center! The strategies below should assist you with synthesizing information in your own words.

Make a claim without a quote

Oftentimes you do not need to directly quote a source to convey its conclusions or arguments – and some disciplines discourage quoting directly! Rather you can paraphrase the main point of a paper in your own words and provide an in-text citation. A benefit of using this strategy is that you can offer support for a claim without using a whole paragraph to introduce and frame a quote. You should make sure that you fully understand the paper’s argument and that you are following university citation guidelines before attempting to paraphrase something from a paper.

Example

Claim (Citation)

Submitting the output of large language models (LLMs) like ChatGPT as your own scholarship is plagiarism. The entire purpose of this textbook is so you don’t have to rely on LLMs to read and understand scholarly literature. Requiring your instructor to read the output of LLMs is a waste of everyone’s time. If you picked a topic you feel is important enough, you should feel responsible to learn the skills necessary to competency consume and communicate scientific information about it. Learn the skills, and if you need feedback and support to further develop your skills, you are currently paying a lot of money for access to those supports! Attend office hours, send early drafts, and use peer support networks!