Glossary
- accountability
-
The idea that researchers are responsible for conducting research that is ethical, honest, and following accepted research practices.
- action research
-
research that is conducted for the purpose of creating social change
- aggregate matching
-
In nonequivalent comparison group designs, the process in which researchers match the population profile of the comparison and experimental groups.
- alternate/multiple forms reliability
-
A type of reliability in which multiple forms of a tool yield the same results from the same participants.
- artifacts
-
Artifacts are a source of data for qualitative researcher that exist in some form already, without the research having to create it. They represent a very broad category that can range from print media, to clothing, to tools, to art, to live performances.
- assent form
-
Comparable to the informed consent for BUT this is for children who are old enough to understand and make a decision about a research project.
- assumptions
-
The characteristics we assume about our data, like that it is normally distributed, that makes it suitable for certain types of statistical tests
- availability sampling
-
researcher gathers data from whatever cases happen to be convenient or available
- beneficence
-
One of the three values indicated in the Belmont report. An obligation to protect people from harm by maximizing benefits and minimizing risks.
- BIASES
-
Biases are conscious or subconscious preferences that lead us to favor some things over others.
- bivariate analysis
-
a group of statistical techniques that examines the relationship between two variables
- bracketing
-
A qualitative research technique where the researcher attempts to capture and track their subjective assumptions during the research process. * note, there are other definitions of bracketing, but this is the most widely used.
- BRUSO model
-
An acronym, BRUSO for writing questions in survey research. The letters stand for: “brief,” “relevant,” “unambiguous,” “specific,” and “objective.”
- case studies
-
Case studies are a type of qualitative research design that focus on a defined case and gathers data to provide a very rich, full understanding of that case. It usually involves gathering data from multiple different sources to get a well-rounded case description.
- categorical variables
-
variables whose values are organized into mutually exclusive groups but whose numerical values cannot be used in mathematical operations.
- chronbach’s alpha
-
Statistical tool used to asses the internal consistency of an instrument. See also split-half approach.
- cluster sampling
-
a sampling approach that begins by sampling groups (or clusters) of population elements and then selects elements from within those groups
- coding
-
Part of the qualitative data analysis process where we begin to interpret and assign meaning to the data.
- coercion
-
When a participant faces undue or excess pressure to participate by either favorable or unfavorable means, this is known as coercion and must be avoided by researchers
- comparison group
-
the group of participants in our study who do not receive the intervention we are researching in experiments without random assignment
- concurrent validity
-
A type of Criterion validity. Examines how well a tool provides the same scores as an already existing tool.
- conditions
-
The different levels of the independent variable in an experimental design.
- confidence interval
-
a range of values in which the true value is likely to be, to provide a more accurate description of their data
- confound
-
a variable whose influence makes it difficult to understand the relationship between an independent and dependent variable
- constant comparison
-
Constant comparison reflects the motion that takes place in some qualitative analysis approaches whereby the researcher moves back and forth between the data and the emerging categories and evolving understanding they have in their results. They are continually checking what they believed to be the results against the raw data they are working with.
- constructivist
-
Constructivist research is a qualitative design that seeks to develop a deep understanding of the meaning that people attach to events, experiences, or phenomena.
- constructs
-
Conditions that are not directly observable and represent states of being, experiences, and ideas.
- content validity
-
The extent to which a measure “covers” the construct of interest, i.e., it's comprehensiveness to measure the construct.
- context-dependent
-
Research findings are applicable to the group of people who contributed to the knowledge building and the situation in which it took place.
- contingency table
-
a visual representation of across-tabulation of categorical variables to demonstrate all the possible occurrences of categories
- continuous variables
-
variables whose values are mutually exclusive and can be used in mathematical operations
- control group
-
the group of participants in our study who do not receive the intervention we are researching in experiments with random assignment
- control variable
-
a confounding variable whose effects are accounted for mathematically in quantitative analysis to isolate the relationship between an independent and dependent variable
- correlation
-
a relationship between two variables in which their values change together.
- correlation coefficient
-
a statistically derived value between -1 and 1 that tells us the magnitude and direction of the relationship between two variables
- covariation
-
when the values of two variables change at the same time
- criterion validity
-
The extent to which people’s scores on a measure are correlated with other variables (known as criteria) that one would expect them to be correlated with.
- cross-sectional
-
Research that collects data at one point in time.
- data dictionary
-
This is the document where you list your variable names, what the variables actually measure or represent, what each of the values of the variable mean if the meaning isn't obvious.
- data triangulation
-
Including data from multiple sources to help enhance your understanding of a topic
- database
-
a searchable collection of information
- deconstructing data
-
The act of breaking piece of qualitative data apart during the analysis process to discern meaning and ultimately, the results of the study.
- descriptive statistics
-
A technique for summarizing and presenting data.
- direct relationship
-
Occurs when two variables move together in the same direction - as one increases, so does the other, or, as one decreases, so does the other
- discrete variables
-
Variables with finite value choices.
- dissemination
-
“a planned process that involves consideration of target audiences and the settings in which research findings are to be received and, where appropriate, communicating and interacting with wider policy and…service audiences in ways that will facilitate research uptake in decision-making processes and practice” (Wilson, Petticrew, Calnan, & Natareth, 2010, p. 91)
- dissemination plan
-
how you plan to share your research findings
- dissemination strategy
-
How you plan to share your research findings
- document analysis
-
The analysis of documents (or other existing artifacts) as a source of data.
- element
-
the units in your sampling frame, usually people or documents
- empirical data
-
information about the social world gathered and analyzed through scientific observation or experimentation
- equity-informed research agenda
-
A general approach to research that is conscientious of the dynamics of power and control created by the act of research and attempts to actively address these dynamics through the process and outcomes of research.
- essence
-
Often the end result of a phenomological study, this is a description of the lived experience of the phenomenon being studied.
- ethnography
-
Ethnography is a qualitative research design that is used when we are attempting to learn about a culture by observing people in their natural environment.
- ex post facto
-
After the fact
- exclusion criteria
-
characteristics that disqualify a person from being included in a sample
- expedited review
-
Expedited review is the middle level of review. Studies considered under expedited review do not have to go before the full IRB board because they expose participants to minimal risk. However, the studies must be thoroughly reviewed by a member of the IRB committee.
- experiment
-
an operation or procedure carried out under controlled conditions in order to discover an unknown effect or law, to test or establish a hypothesis, or to illustrate a known law.
- extraneous variables
-
variables and characteristics that have an effect on your outcome, but aren't the primary variable whose influence you're interested in testing.
- face validity
-
The extent to which a measurement method appears “on its face” to measure the construct of interest
- feasibility
-
whether you can practically and ethically complete the research project you propose
- field notes
-
Notes that are taken by the researcher while we are in the field, gathering data.
- generalize
-
(as in generalization) to make claims about a large population based on a smaller sample of people or items
- histogram
-
a graphical display of a distribution.
- human subject
-
The US Department of Health and Human Services (USDHHS) defines a human subject as “a living individual about whom an investigator (whether professional or student) conducting research obtains (1) data through intervention or interaction with the individual, or (2) identifiable private information” (USDHHS, 1993, para. 1). [2]
- impact
-
Tthe long-term condition that occurs at the end of a defined time period after an intervention.
- indirect observables
-
In measurement, conditions that are subtle and complex that we must use existing knowledge and intuition to define.
- individual matching
-
In nonequivalent comparison group designs, the process by which researchers match individual cases in the experimental group to similar cases in the comparison group.
- inter-rater reliability
-
The extent to which different observers are consistent in their assessment or rating of a particular characteristic or item.
- interval
-
A higher level of measurement. Denoted by having mutually exclusive categories, a hierarchy (order), and equal spacing between values. This last item means that values may be added, subtracted, divided, and multiplied.
- intra-rater reliability
-
Type of reliability in which a rater rates something the same way on two different occasions.
- intuitions
-
yer gut feelin'
- inverse relationship
-
occurs when two variables change in opposite directions - one goes up, the other goes down and vice versa
- justice
-
One of the three ethical principles in the Belmont Report. States that benefits and burdens of research should be distributed fairly.
- keywords
-
the words or phrases in your search query
- level of measurement
-
The level that describes the type of operations can be conducted with your data. There are four nominal, ordinal, interval, and ratio.
- levels
-
The possible values of the variable - like a participant's age, income or gender.
- linear regression
-
a statistical technique that can be used to predict how an independent variable affects a dependent variable in the context of other variables.
- macro
- magnitude
-
The strength of a correlation, determined by the absolute value of a correlation coefficient
- measurement
-
The process by which we describe and ascribe meaning to the key facts, concepts, or other phenomena that we are investigating.
- measurement error
-
The differerence between that value that we get when we measure something and the true value
- measurement validity
-
Refers to the ability of a tool to measure what it claims to measure.
- member-checking
-
Member checking involves taking your results back to participants to see if we "got it right" in our analysis. While our findings bring together many different peoples' data into one set of findings, participants should still be able to recognize their input and feel like their ideas and experiences have been captured adequately.
- Memorandum of Understanding (MOU) or Memorandum of Agreement (MOA)
-
A written agreement between parties that want to participate in a collaborative project.
- meso
- meta-analysis
-
a study that combines raw data from multiple quantitative studies and analyzes the pooled data using statistics
- meta-research
-
uses the scientific method to analyze and improve the scientific production of knowledge (e.g., systematic review, meta-analysis)
- micro
-
individual
- mixed methods research
-
when researchers use both quantitative and qualitative methods in a project
- narratives
-
Those stories that we compose as human beings that allow us to make meaning of our experiences and the world around us
- negative correlation
-
occurs when two variables change in opposite directions - one goes up, the other goes down and vice versa
- negative relationship
-
relationship in which the independent and dependent variables move in opposite directions (e.g., as one goes up, the other goes down). Also called an inverse relationship.
- neutrality
-
The idea that qualitative researchers attempt to limit or at the very least account for their own biases, motivations, interests and opinions during the research process.
- nomothetic
-
A type of understanding that
- non-probability sampling
-
sampling approaches for which a person’s likelihood of being selected for membership in the sample is unknown
- nonresponse Bias
-
The bias that occurs when those who respond to your request to participate in a study are different from those who do not respond to you request to participate in a study.
- null hypothesis
-
the assumption that no relationship exists between the variables in question
- observational terms
-
In measurement, conditions that are easy to identify and verify through direct observation.
- observations/cases
-
The rows in your data set. In social work, these are often your study participants (people), but can be anything from census tracts to black bears to trains.
- observer triangulation
-
including more than one member of your research team to aid in analyzing the data
- operational definitions
-
The concrete and specific defintion of something in terms of the operations by which observations can be categorized.
- operationalization
-
The process of determining how to measure a construct that cannot be directly observed
- oral histories
-
Oral histories are a type of qualitative research design that offers a detailed accounting of a person's life, some event, or experience. This story(ies) is aimed at answering a specific research question.
- ordinal
-
Level of measurement that follows nominal level. Has mutually exclusive categories and a hierarchy (order).
- participant
-
Those who are asked to contribute data in a research study; sometimes called respondents or subjects.
- periodicity
-
the tendency for a pattern to occur at regular intervals
- phenomenology
-
A qualitative research design that aims to capture and describe the lived experience of some event or "phenomenon" for a group of people.
- pilot testing
-
Testing out your research materials in advance on people who are not included as participants in your study.
- population
-
the larger group of people you want to be able to make conclusions about based on the conclusions you draw from the people in your sample
- positionality
-
describes an individual’s world view and the position they adopt about a research task and its social and political context
- positive correlation
-
Occurs when two variables move together in the same direction - as one increases, so does the other, or, as one decreases, so does the other
- positive relationship
-
relationship in which both the independent and dependent variables move in the same direction (e.g., as one goes up, so does the other)
- power
-
the odds you will detect a significant relationship between variables when one is truly present in your sample
- predictive validity
-
A type of criterion validity that examines how well your tool predicts a future criterion.
- probability proportionate to size
-
in cluster sampling, giving clusters different chances of being selected based on their size so that each element within those clusters has an equal chance of being selected
- probability sampling
-
sampling approaches for which a person’s likelihood of being selected from the sampling frame is known
- probes
-
Probes a brief prompts or follow up questions that are used in qualitative interviewing to help draw out additional information on a particular question or idea.
- professional development
-
the "uptake of formal and informal learning opportunities that deepen and extend...professional competence, including knowledge, beliefs, motivation, and self-regulatory skills" (Richter, Kunter, Klusmann, Lüdtke, & Baumert, 2014)
- program evaluation
-
The systematic process by which we determine if social programs are meeting their goals, how well the program runs, whether the program had the desired effect, and whether the program has merit according to stakeholders (including in terms of the monetary costs and benefits)
- pseudoscience
-
claims about the world that appear scientific but are incompatible with the values and practices of science
- psychometrics
-
The science of measurement. Involves using theory to assess measurement procedures and tools.
- quantitative data
-
numerical data
- quantitative methods
-
quantitative methods examine numerical data to precisely describe and predict elements of the social world
- questionnaire
-
The actual tool that collects data in survey research.
- random errors
-
Errors lack any perceptable pattern.
- ratio
-
The highest level of measurement. Denoted by mutually exclusive categories, a hierarchy (order), values can be added, subtracted, multiplied, and divided, and the presence of an absolute zero.
- reciprocal determinism
-
Concept advanced by Albert Bandura that human behavior both shapes and is shaped by their environment.
- reconstruction
-
The act of putting the deconstructed qualitative back together during the analysis process in the search for meaning and ultimately the results of the study.
- recruitment
-
the process by which the researcher informs potential participants about the study and attempts to get them to participate
- reliability
-
The ability of a measurement tool to measure a phenomenon the same way, time after time. Note: Reliability does not imply validity.
- respect for persons
-
One of the three ethical principles espoused in the Belmont Report. Treating people as autonomous beings who have the right to make their own decisions. Acknowledging participants' personal dignity.
- sample
-
the group of people you successfully recruit from your sampling frame to participate in your study
- sampling distribution
-
the set of all possible samples you could possibly draw for your study
- sampling frame
-
the list of people from which a researcher will draw her sample
- secondary data
-
Data someone else has collected that you have permission to use in your research.
- sequence
-
in mixed methods research, this refers to the order each method is used
- signposting
-
the words used to identify the organization and structure of your literature review to your reader
- simple random sampling
-
selecting elements from a list using randomly generated numbers
- split-half reliability
-
A reliability evaluation that examines the internal consistency of a a measurement tool. This process involves comparing one half of a tool to the other half of the same tool and evaluating the results.
- spurious
-
A relationship where it appears that two variables are related BUT they aren't. Another variable is actually influencing the relationship.
- spurious relationship
-
when a relationship between two variables appears to be causal but can in fact be explained by influence of a third variable
- strata
-
the characteristic by which the sample is divided in stratified random sampling
- stratified random sampling
-
dividing the study population into subgroups based on a characteristic (or strata) and then drawing a sample from each subgroup
- systematic errors
-
Errors that are generally predictable.
- systematic sampling
-
selecting every kth element from your sampling frame
- target population
-
the group of people whose needs your study addresses
- temporality
-
as a criteria for causal relationship, the cause must come before the effect
- Test
-
this is a test to see if the box pops up
- test-retest reliability
-
The extent to which scores obtained on a scale or other measure are consistent across time
- the literature
-
published works that document a scholarly conversation on a specific topic within and between disciplines
- transferability
-
whether a research result is applicable in another context or situation
- transparency
-
The process of research is record and described in such a way that the steps the researcher took throughout the research process are clear.
- triangulation
-
Triangulation of data refers to the use of multiple types, measures or sources of data in a research project to increase the confidence that we have in our findings.
- trustworthy data
-
Data that accurately portrays information that was shared in or by the original source.
- unit of analysis
-
entity that a researcher wants to say something about at the end of her study (individual, group, or organization)
- unit of observation
-
the entities that a researcher actually observes, measures, or collects in the course of trying to learn something about her unit of analysis (individuals, groups, or organizations)
- univariate data analysis
-
Univariate data analysis is a quantitative method in which a variable is examined individually to determine its distribution.
- validity
-
The extent to which the scores from a measure represent the variable they are intended to.
- variable name
-
The name of your variable.
- variables
-
“a logical grouping of attributes that can be observed and measured and is expected to vary from person to person in a population” (Gillespie & Wagner, 2018, p. 9)
- vulnerable populations
-
People who are at risk of undue influence or coercion. Examples are children, prisoners, parolees, and persons with impaired mental capabilities. Additional groups may be vulnerable if they are deemed to be unable to give consent.
- word
-
thing that is a thing