The fourth step in the process of generating a SoTL design has to do with deciding on the research design you will use in the study. Almost any quantitative, qualitative or mixed-methods research design could be used in a SoTL project; however, there are some special considerations that set SoTL studies apart from other research studies.
SoTL has blurry boundaries with related concepts like research on the science of learning and Disciplinary-Based Educational Research (DBER), which can cause some confusion among those new to educational research. All are focused on teaching and learning, but each can differ from the others in aims, scope, and methodology.
Faculty in fields like Psychology and Education may conduct research on teaching and learning as part of their disciplinary research agendas, with an aim toward building theory about how people learn. This large body of literature, collectively known as the “science of learning,” informs and is informed by SoTL, but it is not SoTL in the way most scholars define it. Rather than being focused inward on the researcher's own context--an important attribute of SoTL--theoretical research on the science of learning is focused outward, with a goal of producing generalizable theory (Larsson, et al., 2020).
The fact that SoTL is conducted in the classroom gives the researcher less control over some aspects of the design (for example, students cannot typically be randomly placed into course sections), but it gives the research more ecological validity because the data is being collected in the authentic environment where the learning takes place. SoTL, then, can serve as the proving ground for theories built by research on the science of learning (Daniel, 2012)
Review the following research designs to decide which fits with your topic of interest, theoretical perspective, and personal paradigm. Post-positivists are often drawn to quantitative designs, constructivists to qualitative designs, and pragmatists to mixed method designs.
Qualitative Research Traditions
Action research (A-R) is the research tradition most oriented to the educational practice of the six presented by Hopscotch. From this tradition, the essential purpose of the research is not the accumulation of knowledge about teaching-learning, or the understanding of the educational reality, but, fundamentally, to provide information that guides a decision-making process and the innovation and change processes for the improvement of a given reality or issue. Therefore, the main goal of action research is to improve the practice instead of generating knowledge about it (Elliott, 1993).
Berg (2001) raises the existence of three fundamental types of action research: a) Technical Action Research; b) Practical Action Research, and e; c) Emancipatory Action Research. Each of them presents a different goal and it is based on a different worldview. Technical Action Research aims to "prove a particular intervention / innovation based on a specific theoretical framework" (p.186). Supported therefore in post-positivist explanatory positions. Practical Research-Action, on the other hand, "seeks to improve practice" (p.186), thus sustaining itself in an interpretive position that allows the discovery of social meanings. Finally, the emancipatory or critical Action Research has as the essential objective of social, political or personal change; its roots can be found in a transformative paradigmatic position. Currently, practical and emancipatory A-R predominate, thus framing a large percentage of the studies supported by this research tradition in the interpretative and critical paradigms (transformative Cosmovision).
However, and from our point of view, the emancipatory / critical A-R constitutes the approach that we understand should govern the studies carried out by and for teachers. We believe that a teacher should not only face a practical problem in the classroom, but should face the study of that problem from a social perspective that might help him to better understand its origins and structure, thus favoring a social change in the end.
Within the emancipatory/critical A-R, we also found participatory A-R (Kemmis and McTaggart, 2005). It is a form of Action Research that differs from conventional research in three ways. First, it focuses on research whose objective is to allow and promote action. This is achieved through a reflection cycle, through which participants collect and analyze the data, to later decide what action should be followed to improve the practice. The resulting action is then re-investigated in an iterative reflective cycle that perpetuates data collection, reflection and action. Second, participatory A-R pays close attention to power relations, advocating that power be shared deliberately between the researcher and the researched. Third, participatory A-R contrasts with less dynamic approaches and argues that those being investigated should actively participate in the process. Kemmis and McTaggart (2005) specify some of the characteristics of this particular form of A-R:
a) It constitutes a social process: participative A-R studies the relationship between the individual and the social sphere of any phenomenon under study. As we mentioned earlier, when a teacher investigates his own practice, he does it by understanding it as an educational process that has close relationships with the prevailing social model.
b) It is participatory: participatory A-R promotes that people examine their knowledge and the way in which they interpret themselves and their actionS in the surrounding social context. It is therefore participative since we can only conduct A-R about ourselves, as individuals or as a collective.
c) It is practical and collaborative: participatory A-R encourages people to examine social practices (communication, production and social organization) that relate them to other people in social interactions.
d) It is emancipatory: participatory A-R allows people to free themselves from the constraints imposed by social structures that limit their self-development and self-determination.
e) It is critical: participatory A-R helps people to free themselves from the constraints generated by social media, through which they interact.
f) It is reflexive: participatory A-R investigates the reality to change it, and changes the reality to investigate it. That is, it proposes a constant cyclical process of questioning and transforming people's practices through a cycle of critical and self-critical analysis, action and reflection.
g) It transforms theory and practice: participatory A-R aims to articulate and develop both theory and practice through a process of reflection and criticism about them. Therefore, it involves addressing daily practice from the people involved in it, to "explore the potential of different perspectives, theories and discourses that help illuminate particular practices and practical situations, as a basis for the development of critical understandings and ideas on how Things must be transformed. " (Kemmis and McTaggart, 2005, p.568).
The following clip summarizes in a visual manner what Action Research is:
You can generate a visual representation of your Action Research study using this tool. It will help you create a visual like the one you can find below.
Narrative Inquiry is a form of qualitative research that deals with the analysis of human experience, more specifically "it studies the lives of individuals and asks one or more individuals to provide stories about their lives. This information is then retold or restoried by the researcher into a narrative chronology" (Clandinin & Connellly, 2000).
It can be understood as "the transdisciplinary study of the activities involved in the generation and analysis of stories of life experiences (for example, life stories, narrative interviews, magazines, diaries, memoirs, autobiographies, biographies) and the presentation of reports adapted to this type of research" (Schwandt, 2007, p.204).
Other authors such as Creswell (2013) also define it as "a research tradition in which the narrative is understood as a spoken or written text that accounts for an event, action or a series of events and / or actions, connect-two in chronological order." It is convenient at this point to clarify that although the use of narrative texts, stories and vignettes is a fundamental strategy for most research traditions, in this case we refer to narrative research as a particular form of research with characteristics and own procedures. In this way and despite the fact that "narratives can be both a method of study and the phenomenon of study itself" (Pinnegar & Daynes, 2007), we will only focus on the first ones. Narrative Inquiry emerged in the decade of the nineties of the last century and has its roots in literature, history, anthropology, sociology, sociolinguistics, and education; different fields of study that have also adopted their own approaches within this tradition of naturalistic research (Chase, 2005).
This type of research has been supported by the turn towards narrative and autobiography that has taken place in the social sciences, the result of postmodernist thinking and the lack of faith in the traditional discourses of the positivist paradigm. This new paradigmatic situation, described as the era of "blurred genres" (Denzin & Lincoln, 1994), arose as a response in the 70s and 80s to a variety of paradigms, theories, methods and research strategies, that from a criticism of faith to positivism advocated more interpretative-naturalist approaches for the study of social phenomena.
In narrative inquiry stories constitute the fundamental data for the researcher, which have come to be called "field texts." Usually these are collected through interviews and conversations that are then used to generate detailed portraits of the informants, in order to document their voices in a certain social and cultural framework.
Generally, the researcher compiles the stories of his informants, between one and five, and then "re-story" them (Creswell, 2013, p.74) according to a series of themes that emerge from them. The new story/narrative generated by the researcher can be structured around a chronology of events that describe the person's past, present and future experiences, always located within a specific socio-cultural context or context.
When putting into practice a narrative study it is convenient to follow a series of steps that under our point of view are masterfully summarized by John Creswell (2013) in the following way:
1. Determine if the research problem fits the characteristics of narrative research: it is advisable to use this research tradition when we intend to capture the detailed stories or life experiences of a single person or the experiences of a small number of individuals.
2. Review of the literature: Narrative researcher place in the foreground the experiences of the participants and relegate to the background the academic literature related to the research topic. They generally find the underlying direction and structure of their research reports in the participants' history rather than through a formal review of the literature.
3. Select between one and five informants with interesting stories and life experiences around the topic of research: Narrative researchers usually spend extended periods with their informants in order to capture their stories in their own words. For this they collect information in multiple formats (field texts, field notes, letters, photographs, videos, artifacts created by informants, etc.).
4. Collect information about the context of the informants' stories: It is vitally important to situate the stories within the personal experiences of the participants in their work, family, cultural, political and historical environment.
5. Analyze the stories of the informants in depth: The narrative researcher must generate a process of detailed analysis of the stories of their informants to later be able to "chronicle" them around a set of topics that make sense within the proposed study.
6. Verify the accuracy of the narrative report generated: Although John Creswell does not include this last step among his specific recommendations for the implementation of narrative research, we have considered it appropriate to include it as a final stage since it is of vital importance for the credibility of a study of these characteristics. The triangulation of data and the processes of checking with the informants (member checking) the consistency of the information shared with the researcher, are crucial to adequately represent the voices and life experiences of the informants.
The following clip summarizes in a visual manner what Narrative Inquiry is:
You can generate a visual representation of your narrative study using this tool. It will help you create a visual like the one you can find below.
A phenomenological study describes the meaning of the experiences lived by a person or group of individuals regarding a certain concept or phenomenon. For example, a research study focused on how a group of young people have experienced "Bullying" in secondary education, could be phenomenological if we focus our attention in the analysis of the common aspects experienced by them. Like the rest of the research traditions within the qualitative approach, phenomenology is not ultimately interested in explanation, but in reaching a deep understanding of a phenomenon from the eyes (frame of reference) of the person who has experienced it.
When designing a phenomenological (transcendental) qualitative study, the main steps to follow according to Moustakas (1994) are:
a) In the first place, the researcher must ask himself if his object of study really constitutes a phenomenon that can be investigated from this research tradition. As we anticipated earlier, this particular form of research focuses on understanding the way in which a group of individuals have experienced a certain phenomenon. The central thing will be, therefore, what their experiences have in common, not the personal history of each one as it would happen in a narrative investigation.
b) Secondly, the researcher must describe in depth the phenomenon that will focus the study.
c) Third, the researcher must submit his preconceptions about the phenomenon under study to a suspension process or "Bracketing" called "epoche." For this, the researcher must "suspend" his or her preconceived ideas about the phenomenon, to better understand it through the voices of the informants in his study.
d) In the data collection phase, the researcher generally develops in-depth interviews with a group of 7-12 participants who have experienced the phenomenon under. Usually the researcher opens the interview by asking two only questions to the interviewee: The first one related to their experience of the phenomenon; and the second related to the contexts and previous lived situations that he considers have affected him to experience the phenomenon under study, in the way he has done it.
e) In the data analysis phase, the researcher proceeds to the identification of dimensions or units of meaning that emerge from the in-depth interviews; these units are transformed into "clusters" of meanings, expressed in the form of psychological and phenomenological concepts. Finally, these transformations lead to a general description of the experience, the "textual description" of what the participants experienced and the "structural description" of how the phenomenon under study was experienced. Subsequently, starting from the "structural description," the researcher generates a composite description, called "essential" that brings together the essence of the phenomenon or invariant structure. This is derived from the common experiences described by the participants, making clear the underlying structure of the faith-phenomenon under study.
The following clip describes in a visual manner what phenomenological studies are:
You can generate a visual representation of your phenomenological study using this tool. It will help you create a visual like the one you can find below.
Ethnography is a research tradition widely used in the social sciences that arises from cultural anthropology and qualitative sociology. We speak of ethnographic research or simply of ethnography, to allude both to the research process by which one inquires, learns and reflects on the way of life of a certain social group, as well as the final product (ethnographic portrait) of that research.
Hammersley and Atkinson (2007) define ethnography as the study of social interactions, behaviors, and perceptions that occur within social groups, teams, organizations, and communities. Therefore, the ultimate goal of this tradition is the analysis and detailed understanding of the particularities of a given social group. Due largely to this last aspect (the study of the particularities of a social group), we see that in some qualitative research manuals, the terms ethnography and case studies have been used indistinctly. From our point of view, there is a great conceptual difference between these two research traditions.
In ethnography, the researcher uses a macroscopic approach to study the social norms, rituals and perceptions of a particular social group; while in case studies the researcher uses a microscopic approach, based on the analysis of the singularity and uniqueness of the actions developed by the participants of a system with clearly defined limits.
A particular type of ethnography is the so-called school ethnography (Erickson, 1973). Although we can not directly apply all the approaches that govern traditional ethnography to school, we can establish certain parallelisms that allow us to use this tradition for the study of educational problems. Regardless of whether we want to conduct an ethnographic study on the performance of a group of teachers or students; or even a curriculum, we must understand the school context as a small social community with specific norms, rituals, values and beliefs.
Although all ethnographic studies must evolve and adapt to the demands that emerge from the field, it is important to define the main steps we can take when developing an ethnographic study. Creswell (2013) establishes the following:
a) First we must determine if ethnography is the most appropriate research tradition to study our research topic. We can use an ethnographic design if, as we said before, we are interested in describing and understanding the culture of a certain social group, its beliefs, its language, the rituals of its members, their behaviors. In the specific case of school ethnography, we will refer, therefore, to studies in which we intend to analyze, for example, the reasons why an educational center is innovative, or even the impact that the collaboration culture of a school has that they can successfully develop a learning community.
b) In the second place we must identify a social group with a shared culture that allows us to study it in detail (i.e. an educational center, an association to help relatives of people with disabilities, a sports team, a neighborhood action group, etc.). The ethnographic study will be more feasible if the members of the social group have lived together for a prolonged period of time, so that their shared language, behavior patterns and attitudes are identifiable.
c) When planning our study following this tradition of research, we must select subjects that embrace the analysis of the culture shared by its members. Some examples of topics that could be analyzed under the umbrella of ethnography are: the study of enculturation processes, the socialization processes of children and young people, the way in which they learn, the analysis of inequality, etc.
d) Subsequently we must collect information in the places where the group develops as such. In the spaces where its members work, live and interact on a daily basis.
e) Finally, we must analyze the data collected in a holistic way, trying to identify defining features and cultural patterns that help us understand the functioning of the group under study.
The following clip summarizes in a visual manner what an ethnographical study is:
You can generate a visual representation of your ethnographical study using this tool. It will help you create a visual like the one you can find below.
Grounded Theory is a research tradition strongly influenced by symbolic interactionism, which was raised and developed by the sociologists Barney Glaser and Anselm Strauss (Glaser and Strauss, 1967). This, unlike those presented previously, offers the possibility for the researcher to generate theory through a systematic process of data collection and analysis. This tradition of research assumes that the behaviors that occur naturally in social contexts can be better analyzed from the generation of "bottom-up" categories and concepts. Glasser and Strauss (1967) define GT "as the discovery of theories from data systematically obtained from social research." Grounded Theory was initially developed in the nursing school of the University of California in San Francisco, when trying to develop theories in support of the awareness of the proximity of their death, that terminal patients had.
Glasser and Strauss proposed an innovative methodology that would help them investigate a topic that had not been previously investigated. As we mentioned earlier, his new methodological proposal was rooted in symbolic interactionism (Blumer, 1969).
According to symbolic interactionism, the meaning of a certain behavior is formed from social interaction. Therefore, this line of thought emphasizes the importance of meaning and interpretation as essential human processes. People create shared meanings through their social interactions, which will later define their reality. GT is very effective at exploring in a holistic way, both the relationships of a particular social group and the behavior of its members, insofar as they affect the life of the individual.
Grounded theory is especially recommended for the study of situations, phenomena and contexts that have not been studied enough, and on which there is not enough literature. Its essential characteristic is that theoretical propositions are not postulated as in other research traditions at the beginning of the study, but that generalizations emerge from the data themselves and not prior to the collection of them. Therefore, theories are constructed on the basis of interaction, fundamentally based on the actions, interactions and social processes that take place between people. Charmaz (2006) proposes the following phases for the implementation of the Grounded Theory:
1. Identification of our area of substantive interest: As it happens in the research traditions previously shown, a study based on GT must also start from the identification of an area of interest and research topic. In the case of this tradition, the selection of the area of interest and the specific topic of research, as well as relying on the personal interests of the researcher, must be based on the identification of an area whose theoretical development has not been satisfactorily covered in the literature. The identification of a theoretical "gap" will provide us with the starting point for the definition of our research design. However, unlike what happens in the rest of the research traditions, at this time we should not conduct a formal review of literature, just an initial screening that allows us to identify the aforementioned lack of theoretical support of the topic that we wish to study.
2. Data collection: As established by (Charmaz, 2006, Strauss & Corbin, 1990) the fundamental techniques of data collection in GT are observations, interviews, document analysis, and in some cases, even the collection of quantitative data from, for example, the completion of questionnaires, the use of social networks or even formal techniques of discourse analysis. The decisions regarding the data collection techniques to be used will be strongly directed by the informants included in our study. Both the data collection techniques and the informants will determine the quality and completeness of the emerging theory of the process. Strauss and Corbin (1990) offer the following recommendations in this regard: a) The context, group and / or individuals to be studied should be chosen on the basis of the main research question; b) The types of data collection techniques that will be used should be chosen according to their convenience to capture the information that we seek to generate our theory; c) In the case of longitudinal studies, it is necessary to make a decision about whether to follow an individual throughout the process, or certain individuals at different points in the process.
3. Open coding and axial coding of data: As we mentioned before, when we carry out a GT study, the data collection and analysis happen simultaneously. The first step in the analysis is based on data coding. Holton (2007) identifies two fundamental types of coding; the substantive (substantive coding) and the theoretical (theoretical coding). The substantive coding aims to conceptualize the empirical substance of the studied topic, that is, to help us analyze the data in which the theory is submerged (grounded). On the other hand, the theoretical coding helps us conceptualize the way in which the substantive codes are related to each other and are integrated to form our emerging theory. Strauss & Corbin (1990) identify three fundamental types of substantive coding: open coding, axial coding and selective coding. Open coding consists of scrutinizing the data (usually texts) by separating them into units of content, or codes, in order to identify concepts, ideas and meanings contained therein. The meticulous examination of the data allows us to identify, and what is more important, to conceptualize meanings in the analyzed texts. To implement this coding strategy, we must examine, segment and compare the data in relation to their similarities and differences. For this, the researcher conscientiously reads the texts under analysis and identifies portions of them that point out ideas, concepts and / or meanings, relevant for the understanding and conceptualization of the topic subject of study. The codes generated from the researcher's interpretation are called "open," while those that come from textual phrases mentioned by our informants (in an interview, for example) are called "in vivo." At the end of an open coding process we will obtain a list, generally extensive, of codes that, when compared and reduced among them, will allow us to obtain a classification of the second degree, composed of the so-called analysis categories (San Martín, 2014). Once the process of open encoding of our data has been concluded, and having obtained a set of categories of analysis, we will proceed to the axial coding. Through axial coding, the researcher identifies possible relationships between the categories obtained in the open coding, grouping them and / or sub-dividing them into sub-categories, as appropriate.
4. Production of "memos": During the open coding and the axial coding of the data, the researcher must annotate in an organized way the decisions that he is taking, as well as the abstractions that he generates. The so-called "memos" are notes that researchers generate as they codify the data, which allows a written record of abstract thinking when creating codes and categories. Strauss and Corbin (1990, p.197) define them as "written records of analysis." The generation of memos is essential in GT because it constitutes a process of reflection by which researchers interpret the data in an analytical manner in order to discover emerging patterns that help develop the sought after substantive theory.
5. Selective coding of data: As mentioned previously, the third type of substantive coding is the so-called selective coding. It occurs as an extension of the axial coding, characterized by a higher level of abstraction. This third coding process is intended to help the researcher identify what the authors of the grounded theory call the "core category." This allows the researcher to express the phenomenon of research through the integration of the categories and sub-categories of open and axial coding. The central category that results from a selective coding process must group the categories in the axial coding phase, in order to explain the phenomenon or phenomena studied in our research.
6. Search for abstract theoretical codes: In parallel to the realization of axial and selective coding, the researcher must also begin to develop what is called "theoretical coding." Unlike the three procedures of substantive coding previously described, in the theoretical coding the researcher tries to identify a series of theoretical codes that allow him to develop an integrated and explanatory substantive theory of the phenomenon object of study. A theoretical code consists of the relational model through which all previously identified codes and substantive categories are related to the central category.
7. Review of the literature: Until now, it is not recommended to carry out an exhaustive review of the literature related to the phenomenon under study. This should be done around the category or central categories emanated from the previous phase. It is in this moment of the investigation when the existing literature in the field will allow us to generate our emergent or substantive theory.
8. Generation of the emerging theory and its integration with preexisting knowledge: GT focuses on the generation of what is called "substantive theory." This differs from formal theory, of a universal nature, in that the substantive theory deals with a type of theoretical construction of inductive order, which allows us to understand singular social realities. The substantive theory is generated from the dynamic analysis of data and therefore differs from the deductive and static nature involved in the processes of generation of formal theories. It is to this particular type of theory, to which we will refer in this eighth phase of the process of implementing a study supported by Grounded Theory.
The following clip summarizes in a visual manner what Grounded Theory is:
You can generate a visual representation of your Grounded Theory study using this tool. It will help you create a visual like the one you can find below.
Case Study is a research tradition that allows the in-depth analysis of particular social realities, or as MacDonald and Walker (1975) indicate, for the study of well-defined systems in action. This is a tradition that has been used since we have historical records (Flyvbjerg, 2011). However, case studies as we understand them today have their origins at the end of the 19th century and the first decades of the 20th century, in interpretative studies carried out in anthropology, psychology, history and sociology (Simons, 2009).
The main definitions of this tradition reveal that a case study, as proposes by (Rodríguez Gómez et al., 1999), implies a process of inquiry characterized by detailed, comprehensive, systematic and in-depth examination of the case under study. However there are many approaches to this tradition of research.
Yazan (2016) states that the three most relevant case study approaches in the social sciences have been proposed by Robert Yin, Sharan Merriam and Robert Stake. The three approaches differ fundamentally in the worldview or paradigmatic position from which they were conceived, as well as in the practical procedures they propose. Yin makes his proposal from a positivist position, while Merriam and Stake propose their models from constructivistic conceptions that align better with qualitative studies. Therefore, from this moment we opted for the existentialist model proposed by Stake (1995) since we consider that it has had the greater impact in the social sciences, perhaps because of the refinement of its proposal and its recommendations of practical application .
For Stake (1995), a case study should allow us to understand in depth and holistically, empirically, empathically and interpretively the person, innovation or program object of study. To do so, the researcher should focus on the observable actions of the informants that are part of the case, instead of analyzing their perceptions of attitudes and beliefs. These research design follows a progressive approach (progressive in focus) so they are flexible and they adapt to the problems and tensions identified by the informants as the study evolves. Despite the widespread belief that this type of studies do not allow the researcher to generalize their results, it does facilitate a particular type of generalization called naturalistic (Stake, 1998). The in-depth study of particular situations clearly delimited, allows that third parties in similar contexts can learn from the conclusions obtained in a specific case study.
It is important to distinguish the typology of the case object of our study in order to design it properly, and always keep in mind the ultimate objective with which we study it. Stake (1995) identifies three types of case studies depending on the purpose of the study:
a) Intrinsic case study: The intrinsic case study is conducted to learn about a unique phenomenon which the study focuses on. The researcher needs to be able to define the uniqueness of this phenomenon which distinguishes it from all others; possibly based on a collection of features or the sequence of events.
b) Instrumental case study: The instrumental case study is done to provide a general understanding of a phenomenon using a particular case. The case chosen can be a typical case although an unusual case may help illustrate matters overlooked in a typical case because they are subtler there.
c) Multiple case study: The collective case study is done to provide a general understanding using a number of instrumental case studies that either occur on the same site or come from multiple sites.
The following clip summarizes in a visual manner what a Case Study is:
You can generate a visual representation of your Case Study study using this tool. It will help you create a visual like the one you can find below.
Phenomenography denotes a research tradition aiming at describing the different ways a group of people understand a phenomenon (Marton, 1981), whereas phenomenology aims to clarify the structure and meaning of a phenomenon (Giorgi, 1999). Phenomenography aims to identify and interrogate the range of different ways in which people perceive or experience specific phenomena (typically learning, teaching or aspects thereof).
Marton, F. (1981). Phenomenography-Describing Conceptions of the World Around Us. Instructional Science, 10, 177-200.
Giorgi, A. (1999). A phenomenological perspective on some phenomenographic results on learning. Journal of Phenomen- ological Psychology, 30(2), 68-93.
Phenomenographic or phenomenological analysis: does it matter?
Making sense of ‘pure’ phenomenography in information and communication technology in education
The Concepts and Methods of Phenomenographic Research
The following clip summarizes what phenomenography is:
You can generate a visual representation of your phenomenography using this tool. It will help you create a visual like the one you can find below.
Quantitative Research Traditions
Descriptive designs are intended to describe an educational situation or reality and/or classify it in a certain category. They are very frequent in education and in general in the field of social sciences. Most of the descriptive studies are carried out through questionnaires or observations. Hence, the types of descriptive designs that can be carried out are survey-research and observational.
An example of descriptive design tries to answer the following question: what is the use of mobile phones by teenagers throughout the day? It is interesting to know the following variables: the daily time dedicated and the differential frequency of use of Whatsapp, social networks, and calls.
Survey-research: The main objective of a survey-research design is to describe features or characteristics of a group or population through the responses provided by the participants to a questionnaire or interview administered by the researcher. They seek to collect information referring to the entire population, and in cases where this is not possible, a sample that represents it. The main instruments in this type of design are questionnaires and structured or semi-structured interviews. The information collected through the questionnaires is usually of two types: a) sociodemographic characteristics of the participants, such as gender, profession, age, etc., and b) attitudes, opinions, perceptions, behaviors, habits, experiences, etc. Because the objective of these designs is to see the distribution of a certain variable, for example, the opinion of people over 65 years of age regarding the digitalization of the health system in Madrid- in the entire population -persons of 65 who live in Madrid-, it is vitally important that when this is not possible, a sample is selected through the probabilistic sampling procedures that allow to represent the population from which it has been extracted and thus generalize the results. In addition to the rigor in the selection of the sample, another of the decisive questions in this type of research is the validation of the instrument that will be used when it is prepared by the researcher.
Observational designs: Observation is defined by Martínez-González (2007) as the act of looking carefully at something without intervening in its natural course, with the intention of examining it, interpreting it and obtaining conclusions. The description may introduce some confusion with the observation used in qualitative research. In this case, we are referring to an intentional, planned, structured observation, registered in an objective manner, and seeking the explanation of the observed phenomenon. That is, what is observed is quantified by different criteria such as frequency, intensity, domain, etc. One of the most complicated aspects of an intentional observation is the work that needs to be done to define what needs to be observed. For example, if we want to observe the attachment behavior of children with their teacher in early childhood education, we must explicitly and clearly specify which behaviors characterize each type of attachment in order to identify them when conducting an observation. It will also be necessary to determine if what matters is the appearance of the behavior, its frequency, or perhaps the registration of patterns of relationship between the teacher and the child. To carry out this process we have to be very sure that a certain behavior expresses what we want to measure. Hence the difficulty to observe internal aspects of the human being, which have a difficult manifestation sometimes to interpret, such as moods, thoughts or even emotions. As described in the case of survey-research studies, the measurements of an observational study can be carried out over time (longitudinal) or at a single moment (cross-sectional). The most frequently used observational designs can be found in the clinical field. The instruments for collecting observational information in a quantifiable way are observational codes, some of them already elaborated, validated and published for use in samples determined according to context and age. Control lists or estimation scales are also common.
You can use the following tool to generate a visual representation of a Descriptive non-experimental design:
A Correlational Design explores the relationship between variables using statistical analyses. However, it does not look for cause and effect and therefore, is mostly observational in terms of data collection. A correlational study determines whether or not two variables are correlated. This means to study whether an increase or decrease in one variable corresponds to an increase or decrease in the other variable.
There are three types of correlations that are identified:
Positive correlation: Positive correlation between two variables is when an increase in one variable leads to an increase in the other and a decrease in one leads to a decrease in the other. For example, the amount of money that a person possesses might correlate positively with the number of cars he owns.
Negative correlation: Negative correlation is when an increase in one variable leads to a decrease in another and vice versa. For example, the level of education might correlate negatively with crime. This means if by some way the education level is improved in a country, it can lead to lower crime. Note that this doesn't mean that a lack of education causes crime. It could be, for example, that both lack of education and crime have a common reason: poverty.
No correlation: Two variables are uncorrelated when a change in one doesn't lead to a change in the other and vice versa. For example, among millionaires, happiness is found to be uncorrelated to money. This means an increase in money doesn't lead to happiness.
There are essentially two reasons that researchers interested in statistical relationships between variables would choose to conduct a correlational study rather than an experiment. The first is that they do not believe that the statistical relationship is a causal one. The second reason that researchers would choose to use a correlational study rather than an experiment is that the statistical relationship of interest is thought to be causal, but the researcher cannot manipulate the independent variable because it is impossible, impractical, or unethical.
The two main types of correlational designs are:
Explanatory Correlational Design: An explanatory design seeks to determine to what extent two or more variablesco-vary. Co-vary simply means the strength of the relationship of one variable to another. In general, two or more variables can have a strong, weak, or no relationship. This is determined by the product moment correlation coefficient, which is usually referred to as r. The r is measured on a scale of -1 to 1. The higher the absolute value the stronger the relationship.
Prediction Correlational Design: Prediction design has most of the same functions as explanatory design with a few minor changes. In prediction design, we normally do not use the term explanatory and response variable. Rather we have predictor and outcome variable as terms. This is because we are trying to predict and not explain. In research, there are many terms for independent and dependent variable and this is because different designs often use different terms.
You can use the following tool to generate a visual representation of your Correlational Design:
Pre-experiments are the simplest form of research design. In a pre-experiment either a single group or multiple groups are observed subsequent to some agent or treatment presumed to cause change.
Types of Pre-Experimental Design
One-shot case study design: A single group is studied at a single point in time after some treatment that is presumed to have caused change. The carefully studied single instance is compared to general expectations of what the case would have looked like had the treatment not occurred and to other events casually observed. No control or comparison group is employed.
One-group pretest-posttest design: A single case is observed at two time points, one before the treatment and one after the treatment. Changes in the outcome of interest are presumed to be the result of the intervention or treatment. No control or comparison group is employed.
Advantages of pre-experimental designs:
As exploratory approaches, pre-experiments can be a cost-effective way to discern whether a potential explanation is worthy of further investigation.
Disadvantages of pre-experimental designs:
Pre-experiments offer few advantages since it is often difficult or impossible to rule out alternative explanations. The nearly insurmountable threats to their validity are clearly the most important disadvantage of pre-experimental research designs.
You can use the following tool to generate a visual representation of your Pre-Experimental Design
Quasi-experimental designs examine cause-and-effect relationships between or among independent and dependent variables. However, one of the characteristics of true-experimental design is missing, typically the random assignment of subjects to groups. Although quasi-experimental designs are useful in testing the effectiveness of an intervention and are considered closer to natural settings, these research designs are exposed to a greater number of threats of internal and external validity, which may decrease confidence and generalization of study's findings.
Nonequivalent control group designs: The most common subset of quasi-experimental research designs are the nonequivalent control group designs. In one implementation of this design, subjects in the control group are intentionally matched by the researcher to subjects in the treatment group on characteristics which might be associated with the outcome of interest. This matching can be done at the individual level, resulting in a one-to-one match of individuals in the two groups. Another approach is aggregate matching, in which researchers select a control group with the same general composition of relevant characteristics (for example, the same proportion of females and the same age distribution) as the treatment group. These approaches are considered quasi-experimental due to the fact that assignment of subjects to groups is intentional and not random. Another common approach to this type of quasi-experimental research design is the use of existing groups. For example, a comparison could be made between students in two classrooms, with the stimulus administered in only one classroom.
Time-series data Designs: Another quasi-experimental approach involves time-series data, in which researchers observe one group of subjects repeatedly both before and after the administration of the treatment. This can be done in a controlled experimental setting, but this design also lends itself well to a more naturalistic setting in which data are commonly collected on a group of subjects and researchers are interested in the effects of some treatment or intervention which they did not experimentally apply. For example, researchers might examine the yearly test scores of students at a given school for several years both before and after the implementation of an extended school day; in this situation the yearly tests scores represent the time-series data and the change to an extended school day is the naturally occurring, quasi-experimental treatment. This approach is an improvement over the single pre-test/post-test design, which is unable to demonstrate long-term effects. The time-series data design can be further improved by including a control group which is also examined over time but which does not experience the treatment; such a design is termed a multiple time-series design.
While quasi-experimental designs are often more practical to implement than true experiments, they are more susceptible to threats to internal validity. Special care must be taken to address validity threats, and the use of additional data to rule out alternate explanations is advised.
You can use the following tool to generate a visual representation of your Quasi-experimental Design
An experiment is a study in which the researcher manipulates the level of some independent variable and then measures the outcome. Experiments are powerful techniques for evaluating cause-and-effect relationships. Many researchers consider experiments the "gold standard" against which all other research designs should be judged. Experiments are conducted both in the laboratory and in real life situations.
True experiments, in which all the important factors that might affect the phenomena of interest are completely controlled, are the preferred design. Often, however, it is not possible or practical to control all the key factors, so it becomes necessary to implement a quasi-experimental research design.
In an experiment, the researcher manipulates the factor that is hypothesized to affect the outcome of interest. The factor that is being manipulated is typically referred to as the treatment or intervention. The researcher may manipulate whether research subjects receive a treatment and the level of treatment.
Example of true experiment: Suppose, for example, a group of researchers was interested in the causes of maternal employment. They might hypothesize that the provision of government-subsidized child care would promote such employment. They could then design an experiment in which some subjects would be provided the option of government-funded child care subsidies and others would not. The researchers might also manipulate the value of the child care subsidies in order to determine if higher subsidy values might result in different levels of maternal employment.
-Study participants are randomly assigned to different treatment groups
-All participants have the same chance of being in a given condition
-Participants are assigned to either the group that receives the treatment, known as the "experimental group" or "treatment group," or to the group which does not receive the treatment, referred to as the "control group"
-Random assignment neutralizes factors other than the independent and dependent variables, making it possible to directly infer cause and effect
-Traditionally, experimental researchers have used convenience sampling to select study participants. However, as research methods have become more rigorous, and the problems with generalizing from a convenience sample to the larger population have become more apparent, experimental researchers are increasingly turning to random sampling. In experimental policy research studies, participants are often randomly selected from program administrative databases and randomly assigned to the control or treatment groups.
Advantages of Experimental Designs
The environment in which the research takes place can often be carefully controlled. Consequently, it is easier to estimate the true effect of the variable of interest on the outcome of interest.
Disadvantages of Experimental Designs
It is often difficult to assure the external validity of the experiment, due to the frequently nonrandom selection processes and the artificial nature of the experimental context.
You an use the following tool to create your Experimental Design
Mixed-methods Research Designs
Convergent parallel mixed methods is a form of mixed methods design in which the researcher converges or merges quantitative and qualitative data in order to provide a comprehensive analysis of the research problem. In this design, the investigator typically collects both forms of data at roughly the same time and then integrates the information in the interpretation of the overall results. Contradictions or incongruent findings are explained or further probed in this design.
The following tool will help you generate a visual representation of your Convergent parallel mixed methods
Explanatory sequential mixed methods is one in which the researcher first conducts quantitative research, analyzes the results and then builds on the results to explain them in more detail with qualitative research. It is considered explanatory because the initial quantitative data results are explained further with the qualitative data. It is considered sequential because the initial quantitative phase is followed by the qualitative phase. This type of design is popular in fields with a strong quantitative orientation (hence the project begins with quantitative research), but it presents challenges of identifying the quantitative results to further explore and the unequal sample sizes for each phase of the study.
The following tool will help you generate a visual representation of your Explanatory sequential mixed methods Design
Exploratory sequential mixed methods is the reverse sequence from the explanatory sequential design. In the exploratory sequential approach the researcher first begins with a qualitative research phase and explores the views of participants. The data are then analyzed, and the information used to build into a second, quantitative phase. The qualitative phase may be used to build an instrument that best fits the sample under study, to identify appropriate instruments to use in the follow-up quantitative phase, or to specify variables that need to go into a follow-up quantitative study. Particular challenges to this design reside in focusing in on the appropriate qualitative findings to use and the sample selection for both phases of research.
The following tool will help you generate a visual representation of your Exploratory sequential mixed methods Design
- Daniel, D. B. (2012). Promising principles: Translating the science of learning to educational practice. Journal of Applied Research in Memory and Cognition, 1(4), 251-253.
- Larsson, M., Mårtensson, K., Price, L., & Roxå, T. (2020). Constructive friction? Charting the relation between educational research and the scholarship of teaching and learning. Teaching & Learning Inquiry, 8(1)