Research and Program Evaluation Practice Exam

These questions are part of the practice quiz. Start practicing

• What is the primary purpose of program theory evaluation?
• What can occur when participants are overexposed to a measure?
• What is a primary responsibility of an evaluator?
• Researchers should be judicious when using _____ to support their writing due to potential bias.
• What is peer review in the context of evaluation?
• What is an evaluation framework?
• Mete-analysts establish a systematic search strategy after determining which criteria?
• Participants in a _____ can be followed repeatedly and sometimes over the span of years.
• What does a mixed-methods approach in evaluation involve?
• What is the primary goal of qualitative research?
• Survey research typically requires what size of sample?
• What is meant by a program's "theory of action"?
• How can focus groups be beneficial in program evaluation?
• In evaluating a program, conducting both interviews and surveys is an example of what method?
• Why is stakeholder feedback critical in program planning?
• Which group is most likely to be engaged in a needs assessment for community programs?
• How is “validity” defined in research?
• Why is it important to define success indicators?
• Why are ethical considerations important in program evaluation?
• Why is it important to conduct a pilot test before a full evaluation?
• What distinguishes the "Theory of Change" from a Logic Model?
• The process in which researchers intentionally select participants is called ______.
• What is the purpose of a "case study" in program evaluation?
• Which philosophical stance supports community-based application of research results with participants?
• What term describes the potential influence of an external factor on study outcomes?
• What is an advantage of using qualitative data in program evaluation?
• What is the purpose of a program theory?
• Why is data triangulation a crucial aspect of evaluation?
• Which philosophical stance is most aligned with the scientific method?
• Why is generalizability important in evaluation findings?
• What is a key outcome of effective community engagement in program evaluation?
• Name one profession that commonly uses program evaluation techniques.
• What is a quasi-experimental design?
• What characterizes quantitative research?
• How is mixed methods research defined?
• In which situation would a summative evaluation be most appropriate?
• What role does a logic model serve in communicating evaluation results?
• Which of the following is NOT a characteristic of good evaluation questions?
• One of the broad categories of interest to meta-analysis is what?
• What are the key components of a logic model?
• Which population is most likely to be protected under research ethics guidelines?
• What is one benefit of utilizing a logic model in program evaluation?
• In a longitudinal study, what is primarily being tracked?
• What is a “control group” in the context of experimental evaluation?
• What are standardized assessments?
• Which of the following was not outlined in the Common Rule?
• What does summative evaluation specifically assess?
• In qualitative research, which concept refers to the trustworthiness and credibility of the research findings?
• In quantitative research, what does a hypothesis represent?
• How do evaluators ensure ethical standards are upheld during evaluations?
• What does the term "baseline data" signify in program evaluation?
• How can feedback from stakeholders improve program planning?
• Which research approach combines both qualitative and quantitative methods to explore a research question?
• What does reliability directly assess in evaluation research?
• In program evaluation, what does utilization-focused evaluation emphasize?
• How can logic models help in identifying evaluative questions?
• How can reliability be defined in research?
• What is meant by "participatory evaluation"?
• What are evaluation questions primarily designed to do in an evaluation study?
• In correlational research, the researcher is primarily interested in the _____ between or among variables.
• What role do data collection instruments play in evaluations?
• What is meant by "impact evaluation"?
• Which qualitative methodology is most appropriate for exploring the lived experiences of individuals?
• The development of research ethics in the United States is tied directly to studies such as _____, which involved exploitation and social injustices.
• Pearson's r is a coefficient used in _____ research.
• How can an evaluator assess program fidelity?
• _____ refers to the order in which interventions are prescribed in a study.
• Which sampling strategy is often used in qualitative research to help identify participants through referrals?
• What is program sustainability?
• According to the Office of Human Research Protections, _____ refers to unexpected events that likely occur as a result of participation in the research.
• What are “external evaluators”?
• In evaluation research, a group not receiving the intervention is essential for what purpose?
• The practice of obtaining informed consent from participants is vital for what purpose in research?
• How can surveys be utilized in program evaluation?
• How is “outcome evaluation” defined?
• Define “experimental design” in evaluation research.
• Which component ensures a study's findings can be applied across different settings?
• The fit of a study's parameters with the guiding questions is referred to as what?
• Which of the following is NOT a characteristic of a good study?
• Which qualitative approach emphasizes the co-construction of meaning between the researcher and participants?
• How can an evaluator establish the credibility of their findings?
• ______ refers to the personal and professional experiences that facilitate understanding of the data.
• Why is it important to articulate evaluation questions early in the process?
• Which of the following statements about research methodology is true?
• The social sciences, and counseling research in particular, are dependent on _____ at a human level.
• If a researcher wanted to evaluate differences between treatment and control groups, which would be group or condition and would have two levels: treatment and control?
• What is a "mixed methods design"?
• What research design is characterized by observing changes over time in a single group?
• What is the primary goal of program evaluation?
• Describe "self-evaluation" in the context of program evaluation.
• What are the two predominant ideologies concerning the role of research within the counseling profession?
• How do qualitative and quantitative research differ?
• How does stakeholder feedback improve evaluation findings?
• What aspect of evaluation does process evaluation focus on?
• The extent to which findings from a study can be attributed to a larger population is known as _____.
• What term refers to the order in which interventions are prescribed in a study?
• Which of the following sampling methods aims to select specific participants who can provide rich information for qualitative research?
• Formative evaluation is primarily focused on what aspect of a program?
• In qualitative research, validity is often assessed through which of the following?
• How does ethical consideration influence program evaluation practice?
• What does the term "outcomes" refer to in a logic model?
• What is a critical difference between formative and summative evaluation?
• Who are considered "stakeholders" in program evaluation?
• What does “disaggregation of data” mean?
• How does evaluating program fidelity contribute to understanding program success?
• What is the importance of feedback in program evaluation?
• What is external validity in evaluation?
• In an A-B-A design, what does the last A indicate?
• Every meta-analytic report should evaluate the influence of what on the results?
• What is a key characteristic of qualitative research?
• What are outcome indicators?
• What does qualitative research primarily focus on?
• What are indicators in an evaluation context?
• What is a baseline measure?
• The ___ design is a design that may be appropriate in quasi-experimental research and experimental research.
• What is a primary concern for program evaluators when engaging stakeholders?
• What is a “theory-based evaluation”?
• What does "data saturation" refer to in qualitative research?
• How can evaluation results influence decision-making?
• In an A-B-A design, what does the last 'A' signify?
• Researchers need to understand not only if there is a statistically significant difference, but also the _____ of that difference.
• What is a primary characteristic of mixed-methods research?
• Which term refers to the investigation of processes, events, or interactions in their natural settings?
• What strategies can evaluators use to ensure cultural competence?
• What qualitative methods are commonly used in program evaluation?
• Why is it important to include diverse stakeholders in the evaluation process?
• When conducting a search, search terms should target what?
• What is the purpose of a logic model in program evaluation?
• Which component of evaluation helps determine if the program has achieved its intended outcomes?
• Research involving benign behavioral interventions does not require regulatory oversight once an IRB declares the study _____.
• What is the role of a needs assessment in program evaluation?
• What aspect of program evaluation does the concept of "sustainability" primarily address?
• What is an evaluation plan?
• What is a key difference between qualitative and quantitative data analysis?
• What type of data is primarily collected in qualitative research?
• Explain the term "program fidelity."
• What does informed consent involve in research?
• What does the 'A' in A-B-A design usually signify?
• What is the significance of sampling in evaluation research?
• Under the Common Rule, individuals with impaired decision-making capacity are considered _____ populations.
• A researcher is evaluating group counseling effectiveness using motivational interviewing for adolescents. What is the dependent variable?
• What is the significance of "logic models" in evaluation?
• The term that describes the consistency of a treatment or intervention is _____.
• Why is stakeholder involvement crucial in program evaluation?
• What role does a logic model play in program design?
• What type of insight does a focus group typically provide in program evaluation?
• Which type of study involves comparisons between groups without formal manipulation and random assignment?
• What does a logic model visually represent?
• What is the form of sampling most commonly associated with qualitative research?
• What does triangulation in evaluation refer to?
• The direction and analytic strategy of a research study is guided by the _____.
• What does a theory of change illustrate?
• What role does the evaluation plan serve?
• In correlational research, variables are most often _____.
• Which of the following is a key component of a logic model?
• Which factor is most likely to influence a researcher's choice of qualitative methodology?
• Why is extrapolation important in evaluation?
• Which type of data is essential for qualitative research?
• What philosophical stance serves as the conceptual home for intersectionality theory?
• What is the primary goal of using qualitative methods in research?
• What is the primary focus of impact evaluation?
• What are demographic variables?
• What distinguishes primary data from secondary data?
• Moderation is to _____ as mediation is to _____.
• In an A-B design, what does the 'B' refer to?
• Which design may be appropriate for quasi-experimental and experimental research?
• Graduate students in a master's-level counseling program should begin by reviewing the literature to _____.
• What is the role of data collection in program evaluation?
• Which of the following is in the correct order?
• Which research approach includes both qualitative and quantitative data collection methods?
• What does "reliability" refer to in research?
• _____ can occur when participants are overexposed to a measure.
• Survey research and longitudinal studies require _____ sample sizes, which can be challenging to obtain.
• What are output measures in program evaluation?
• What type of research design assesses the relationship between variables without manipulating them?
• Who is typically considered a stakeholder in program evaluation?
• Define "findings" in the context of program evaluation reports.
• What is the focus of formative evaluation?
• What is the role of theory in evaluation practice?
• Which approach focuses on the needs and interests of the evaluators?
• What is participatory evaluation?
• Which type of evaluation would be best suited for program improvement during its execution?
• How can bias be reduced in evaluation?
• Which of the following is a characteristic of a well-defined evaluation question?
• What is the primary purpose of program evaluation?
• Which of the following is not a common type of program evaluation?
• Which of the following best describes "formative evaluation"?
• What is the primary purpose of program evaluation?
• How would you define an evaluation framework?
• What role does a control group play in evaluation research?
• What are some common challenges faced in program evaluation?
• In conducting a literature review, which strategy assists in identifying specific manuscripts/articles on a given topic?
• What is the purpose of a needs assessment?
• How can program evaluators communicate their findings effectively?
• What is usually the first step in program evaluation?
• What are the two main types of program evaluation?
• Why is stakeholder involvement critical in program evaluation?
• In qualitative research, what type of philosophical stance focuses on the subjective experiences and viewpoints of participants?
• What are the characteristics of good evaluation questions?
• What is a major benefit of program evaluation?
• Participants in which type of study can be followed repeatedly over years?
• What is a primary focus during a summative evaluation?
• In which type of research design can researchers examine differences across time and between groups?
• A ___ approach to research is most appropriate for those wishing to focus primarily on clinical work.
• What is the primary use of summative evaluation?
• What is triangulation in evaluation?
• Models, the nature of the variables, experimental validity, random assignment, and statistical control from the blueprint of an experimental design and play an important role in the ____ of results.
• In evaluation research, what distinguishes “experimental design” from other designs?
• Between groups analyses are appropriate when a researcher is interested in examining ______.
• Which of the following best describes the Delphi technique?
• What is the Delphi technique?
• What kind of validity assesses if the findings can be generalized to other settings?
• Define “sustainability” in the context of program evaluation.