The public funding of research includes many discrete components: setting research priorities; securing funds; funding research infrastructure; selecting and funding meritorious projects; conducting research; monitoring research progress; communicating research findings; and training researchers. This FAES survey course is deigned to review theories, methods, and practices in program and policy evaluation as they relate to research, particularly publicly funded biomedical research. The full range of the evaluation hierarchy (needs assessment and program planning, feasibility and implementation evaluation, process evaluation, and outcome and impact evaluation) is considered as students will be guided to develop a comprehensive framework for the evaluation of federally funded biomedical research.
In her webinar, Dr. Cara Lewis provides an overview of findings from the Society for Implementation Research Collaboration (SIRC) Enhanced Systematic Review and Synthesis of Measures, and discusses several measurement issues that threaten the field of implementation science and directions for possible solutions.
In this Methods: Mind the Gap webinar, Dr. David MacKinnon describes mediation analysis methods with attention to solutions for some of the limitations of these methods. He also discussed future directions in mediation theory and statistical analysis.
Applying Models and Frameworks to Dissemination and Implementation (D&I) Research: An Overview & Analysis
Part of a joint presentation, Dr. Rachel Tabak presents a review which uses snowball sampling to develop an inventory of models, synthesizes this information, and provide guidance on how to select a model. Dr. Ted Albert Skolarus discusses an examination of citation frequency and impact of D&I models using citation analysis.
This webinar presents insights from a National Academies report exploring how reports on obesity prevalence and trends differ and what these differences mean for interpretation and application. Speakers provide an overview of the various data collection and analysis approaches that have been used across population groups, but particularly as they relate to children and adolescents.
In this Methods: Mind the Gap webinar, Dr. Jason Moore reviews the new discipline of automated machine learning (AutoML). The goal of AutoML is to simplify the process of combining different types of algorithms and methods in an analytical pipeline and to make machine learning more accessible.
Balancing Fidelity & Adaptation: If We Want More Evidence-Based Practice, We Need More Practice-Based Evidence
In this webinar, Drs. Larry Green and Rachel Gold deliver a joint presentation on fidelity and adaptation. Fidelity and adaptation relate to the manner in which the evidence from a research study is brought to practice. There is fidelity if the program is implemented in a way that is very similar to how it was originally designed, and there is adaptation when there are changes made to the process and content of the program to fit to a particular context. In most cases, contextual factors can influence the ability to maintain fidelity as well as the need for adaptation.
A collection of online chapters that provide an introduction to selected behavioral and social science research approaches, including theory development and testing, survey methods, measurement, and study design. eSource was developed in 2010, and these chapters have not been updated to reflect advances in the past decade. However, they can still be used as supplementary teaching materials.
A series of six webinars related to designing clinical trials to include patient-reported outcomes. The videos in the series may be viewed in any order.
A report that provides guidance to NIH investigators on how to rigorously develop and evaluate mixed methods research applications.
Big Data and the Promise and Pitfalls When Applied to Disease Prevention and Promoting Better Health
How disruptive will Big Data be in the long run to biomedical research and health care? In his Methods: Mind the Gap webinar, Dr. Philip Bourne addresses this question in light of the Big Data to Knowledge (BD2K) initiative and other trans-NIH data science programs.
In this Methods: Mind the Gap webinar, Dr. Stuart G. Baker focuses on the method of latent class instrumental variables (often called the LATE or CACE approach). He discusses how to estimate the effect of treatment received (in the complier latent class) in a randomized trial with all-or-none compliance.
This archive provides a collection of webinars on methodology. The topics include HIV prevention, implementation methods, personalized medicine, complexity, and longitudinal data. In 2017, the Office of Disease Prevention (ODP) provided co-funding to the Center for Prevention Implementation Methodology to help create this archive.
A collection of training modules that came out of the NIH's initiative to enhance rigor and reproducibility in the research endeavor. The modules were developed by the NIH or NIH-funded grantees and focus on a variety of topics, including integrating sex and gender into research, the design and analysis of group-randomized trials, and computational analyses.
In this webinar, Drs. Maria Fernandez and Gregory Aarons discuss the development, submission, and review of grants and scientific publications from the perspective of both author and reviewer. They also touch on larger issues for the field including the scientific and technical aspects of career development in implementation science, focusing research efforts, and the landscape of traditional journals, open access, social media, and other mechanisms for communicating.
In this Methods: Mind the Gap webinar, Dr. David M. Murray reviews the options available to evaluate multilevel interventions, including group- or cluster-randomized trials, and discusses their strengths and weaknesses.
In this Methods: Mind the Gap webinar, Dr. Melody S. Goodman discusses her efforts to develop and validate quantitative measures of stakeholder engagement in research and research literacy. Emerging data suggest a valid and reliable measure to accurately assess associations between research outcomes and stakeholder engagement. Data on the measure of research literacy show mixed results and Dr. Goodman discusses potential areas for modification.
This webinar outlines successes, motivators, and challenges faced by early-stage investigators in the field. In response to audience feedback, the speakers touch on issues in implementation science, such as training, career development, and working with an active D&I funding portfolio with a focus on early and mid-career researchers.
In this Methods: Mind the Gap webinar, participants learn what the field of dissemination and implementation (D&I) is, why it is important, what it is trying to achieve, and how it is relevant to research and practice. Dr. Fernandez discusses the major components of a D&I study, D&I theories, models and frameworks, and design considerations. She also teaches participants how to tailor their own research to better enhance its value for dissemination and implementation.
This purpose of this Methods: Mind the Gap webinar is to equip public health researchers and practitioners with awareness and confidence in approaching and conducting qualitative research projects, and to familiarize participants with qualitative data collection and data analysis techniques and tools.