Getting Started with EdTech Research
Topic Overview
Research Basics
Researchers have an enormous burden placed on them by the trust that society puts into our work. Therefore, we have an ethical obligation to take every possible step to ensure that the conclusions and impact of our work are positive. The following are some sources on how to monitor for ethics in research.
- What is Ethics in Research & Why is it Important?, from David Resnik of the National Institute of Environmental Health Sciences
- Ethics and Educational Research, from Martyn Hammersley of the Open University and Anna Traianou of the University of London
- Ethics in Educational Research, from Kenneth Howe and Michele Moses of the University of Colorado at Boulder
- Conflict of Interest, from On Being a Scientist: Responsible Conduct in Research
- The Allocation of Credit, from On Being a Scientist: Responsible Conduct in Research
- Error and Negligence in Science, from On Being a Scientist: Responsible Conduct in Research
- Misconduct in Science, from On Being a Scientist: Responsible Conduct in Research
- Responding to Violations of Ethical Standards, from On Being a Scientist: Responsible Conduct in Research
- Five principles for research ethics, from Deborah Smith of the American Psychological Association
IRB Procedures
If your work qualifies as human subjects research, then you’ll need IRB approval to conduct your work. Your work generally qualifies as human subjects research if:
- It involves human subjects. This includes data on human subjects that is already generated, such as OMS student data.
- It is research. According to the Federal Policy for the Protection of Human Subjects, research is “a systematic investigation, including research development, testing and evaluation, designed to develop or contribute to generalizable knowledge.” Thus, if your intent is not to contribute to generalizable knowledge (for example, if your intent is instead to simply improve your tool), this does not qualify as research. Note that if you have any intention of publishing your work in academic conferences or journals, then it does qualify as research.
Here are some resources on understanding what IRB is, whether you need to work with them, and how to go about doing so. If you think you need IRB approval, please make sure to consult with your mentor and the teaching team.
- What is IRB, and when is IRB needed?, from Brown University
- Does My Research Need IRB Review?, from the University of Minnesota
- About the Georgia Tech IRB, from the Georgia Tech Office of Research Integrity Assurance
- IRB Required Training, from the Georgia Tech Office of Research Integrity Assurance
- IRB Informed Consent, from the Georgia Tech Office of Research Integrity Assurance
- IRB Protocol and Submissions, from the Georgia Tech Office of Research Integrity Assurance
- Georgia Tech IRBWISE, for IRB submissions (please do not submit to IRB without consulting with your mentor first)
Research Vocabulary
Scientific research comes with its own vocabulary. The list here gives some of the most important terms, and the links direct straight to the definitions in Colorado State’s excellent Glossary of Key Research Terms. The full lists are provided below.
Scholarly Resources
These are scholarly resources useful for starting a deep dive into the topic. You’re welcome to use some of these in your assignments, although everyone will need to find many resources far beyond those listed on this web site.
Once you have a solid foundation in the accessible basics of scientific research and the scientific method, it’s good to move on to a broader understanding of the research community and its value in society. The following sources cover some of these broader issues and relationships.
- What is Basic Research?, from the NSF’s 1953 Annual Report
- Doing Educational Research in a Complex World, from Kenneth Tobin of the City University of New York and Joe Kincheloe of McGill University
- Values in Science, from On Being a Scientist: Responsible Conduct in Research
- The Scientist in Society, from On Being a Scientist: Responsible Conduct in Research
- Social Science Research: Principles, Methods, and Practices, from Anol Bhattacherjee of the University of South Florida
General Media
These sources would generally not be suitable for use in your assignments, but they may provide a useful general overview of the topic if you find yourself struggling with the more scholarly resources.
Research is, in many ways, a way of thinking about investigating the world. The following are some introductory, accessible resources on the nature of research. You should pay attention especially to the general methodology of research, the aims and purposes of research, and the application of research in multiple fields. In education, most often we draw from the research methodologies of the psychology community.
- Introduction to Scientific Research, from Pearson Higher Education
- Introduction to Scientific Research Projects, from Graham Basten of De Montfort University
- Research, from WikiEducator
- Research Basics, from Explorable
Additional useful readings on the nature of scientific research, especially in the context of educational technology, include:
- The value of basic scientific research, from the International Council for Science
- Educational Technology Research That Makes a Difference, from M. D. Roblyer of the University of Maryland
- Research on Educational Technology: Challenges to Implementation and Impact of Scientifically Based Research, from Lynne Schrum and Kelly Glassett of the University of Utah
- The Learning Return on Our Educational Technology Investment, from Cathy Ringstaff and Loretta Kelley of WestEd RTEC.
Research Designs
There are a number of different possible research designs. Below are some sources list the various designs, followed by some specific sources on particularly useful designs for this class.
- Research Design, from Phil Hodkinson of the University of Exeter
- Types of Designs, from SocialResearchMethods.net
- Research Design and Methods, from London Deanery Faculty Development
- Research Designs, from Explorable
- Research Design and Research Methods, from Integrating Qualitative and Quantitative Methods
- The four main approaches, from Alzheimer Europe
For more comprehensive information, see:
- Research Methods in Education (Chapters 3, 6, 8, 9, 10, and 12)
Descriptive Designs
- What is Descriptive Research?, from the Association for Educational Communications and Technology
- Descriptive Study, from the National Emergency Medical Services for Children Data Analysis Resource Center
- Descriptive Studies, from the US Office of Research Integrity
Correlational Designs
- Correlational Research Guidelines, from Janet Waters of Capilano University
- Survey and Correlational Research Designs, from Research Methods for the Behavioral Sciences
- Correlational Research, from Education.com
Quasi-Experimental Designs
- Experimental and Quasi-Experimental Designs for Research, from Donald Campbell of Syracuse University and Julian Stanley of Johns Hopkins University
- Quasi-Experimental Design, from SocialResearchMethods.net
- The Use and Interpretation of Quasi-Experimental Studies in Medical Informatics, from Anthony Harris, Jessina McGregor, Eli Perencevich, Jon Furuno, Jingkun Zhu, and Joseph Finkelstein of the University of Maryland, and Dan Peterson of Cereplex, Inc.
Experimental Designs
- Experimental and Quasi-Experimental Designs for Research, from Donald Campbell of Syracuse University and Julian Stanley of Johns Hopkins University
- Experimental Research, from Education.com
- Experimental Design, from SocialResearchMethods.net
Survey Designs
- Good practice in the conduct and reporting of survey research, from Kate Kelley, Belinda Clark, Vivienne Brown, and John Sitzia of Worthing & Southlands Hospitals NHS Trust
- Survey Design Software, from Creative Research Systems
- Survey Research and Questionnaires, from Research Connections
Controlling for Biases
Educational, social, and psychological research may be highly prone to biases due in part to the intimate involvement of experimenters. Below are a few sources on monitoring for bias in your research.
- Conflict of Interest, from On Being a Scientist: Responsible Conduct in Research
- Identifying and Avoiding Bias in Research, from Christopher Pannucci and Edwin G. Wilkins of the University of Michigan-Ann Arbor
- Bias in Research Studies, from Gregory Sica of Harvard Vanguard Medical Associates
- Error, Bias, and Validity in Qualitative Research, from Nigel Norris of the University of East Anglia
- Research Bias, from Explorable.com
Some sources more specifically on bias in educational research include:
- Outcome-Reporting Bias in Education Research, from Therese Pigott of Loyola University, Jeffrey Valentine of the University of Louisville, Joshua Polanin of Vanderbilt University, Ryan Williams of the University of Memphis, and Dericka Canada of Boston College
- Bias in Qualitative Research: Voices from an Online Classroom, from Beloo Mehra
- Selection Bias in Educational Research, from A.C. Tuijnman of OCDE France
- Bias in Social Research, from Martyn Hammersley and Roger Gomm of Open University
- Research Detects Bias in Classroom Observations, from Stephen Sawchuk of EdWeek
For more comprehensive information, see:
- Research Methods in Education (Chapter 5)