Difference between revisions of "Coordinative Learning"

From LearnLab
Jump to: navigation, search
(Abstract)
m (Reverted edits by Petrachaney (Talk); changed back to last version by Alida)
 
(38 intermediate revisions by 15 users not shown)
Line 1: Line 1:
== The PSLC Coordinative Learning cluster ==
+
= The PSLC Coordinative Learning cluster =
  
=== Abstract ===
+
== Abstract ==
 
The studies in the Coordinative Learning cluster tend to focus on varying ''a)'' the types of information available to learning or ''b)'' the instructional methods that they employ. In particular, the studies focus on the impact of having learners coordinate two or more types.  Given that the student has multiple [[sources]]/methods available, two factors that might impact learning are:
 
The studies in the Coordinative Learning cluster tend to focus on varying ''a)'' the types of information available to learning or ''b)'' the instructional methods that they employ. In particular, the studies focus on the impact of having learners coordinate two or more types.  Given that the student has multiple [[sources]]/methods available, two factors that might impact learning are:
  
Line 9: Line 9:
 
At the micro-level, the overall hypothesis is that robust learning occurs when the [[learning event space]] has target paths whose [[sense making]] difficulties complement each other (as expressed in the first bullet above) and the students make path choices that take advantage of these [[complementary]] paths (as in the second bullet, above).  This hypothesis is just a specialization of the [[Root_node|general PSLC hypothesis]] to this cluster.
 
At the micro-level, the overall hypothesis is that robust learning occurs when the [[learning event space]] has target paths whose [[sense making]] difficulties complement each other (as expressed in the first bullet above) and the students make path choices that take advantage of these [[complementary]] paths (as in the second bullet, above).  This hypothesis is just a specialization of the [[Root_node|general PSLC hypothesis]] to this cluster.
  
<br><center>[[Image:cl-theory.jpg]]</center>
+
The matrix below shows how studies in this cluster (pages for these studies can be found Descendants section below) either test or make use of various [[instructional method|instructional methods]] or treatments. When a study tests an instructional method a "v" is one shown in the appropriate cell to indicate that that method is '''varied''' in the study, that is, the [[robust learning]] gains of an experimental condition that receives this method are contrasted with those of an otherwise equivalent control condition that does not receive this method.  In this case (when a "v" is present), the study tests the [[InstructionalPrinciples|instructional principle]] indicated in the column.  When a cell contains a "b" it indicates that '''both''' the experimental and control conditions use this instructional method (or employ this instructional principle).  In this case, the study is not a true experimental test of the principle.
  
=== Glossary ===
+
<br><center>[[Image:Cl.JPG]]</center>
 +
 
 +
== Glossary ==
 
[[:Category:Coordinative Learning|Coordinative Learning]] glossary.
 
[[:Category:Coordinative Learning|Coordinative Learning]] glossary.
  
 +
*'''[[Analogical comparison]]'''
 
*'''[[Co-training]]'''
 
*'''[[Co-training]]'''
 
*'''[[Complementary]]'''
 
*'''[[Complementary]]'''
Line 19: Line 22:
 
*'''[[Contiguity]]'''
 
*'''[[Contiguity]]'''
 
*'''[[Coordination]]'''
 
*'''[[Coordination]]'''
*'''[[Ecological Control Group]]'''
+
*'''[[Ecological control group]]'''
 
*'''[[External representations]]'''
 
*'''[[External representations]]'''
 
*'''[[Input sources ]]'''
 
*'''[[Input sources ]]'''
Line 31: Line 34:
 
*'''[[Unlabeled examples]]'''
 
*'''[[Unlabeled examples]]'''
  
=== Research question ===
+
== Research questions ==
  
 
When and how does coordinating multiple sources of information or lines of reasoning increase robust learning?
 
When and how does coordinating multiple sources of information or lines of reasoning increase robust learning?
Line 37: Line 40:
 
Two sub-groups of coordinative learning studies are exploring these more specific questions:
 
Two sub-groups of coordinative learning studies are exploring these more specific questions:
  
1) Visualizations and Multi-modal sources
+
=== Visualizations and Multi-modal sources ===
  
 
When does adding visualizations or other multi-modal input enhance robust learning and how do we best support students in coordinating these sources?
 
When does adding visualizations or other multi-modal input enhance robust learning and how do we best support students in coordinating these sources?
  
2) Examples and Explanations
+
=== Examples and Explanations ===
  
 
When and how should example study be combined and coordinated with problem solving to increase robust learning?  When and how should explicit explanations be added or requested of students before, during, or after example study and problem solving practice?
 
When and how should example study be combined and coordinated with problem solving to increase robust learning?  When and how should explicit explanations be added or requested of students before, during, or after example study and problem solving practice?
  
=== Independent variables ===
+
== Independent variables ==
  
 
*Content of the sources (e.g., pictures, diagrams, written text, audio, animation) or the encouraged lines of reasoning (e.g., example study, self-explanation, conceptual task, procedural task) and combinations
 
*Content of the sources (e.g., pictures, diagrams, written text, audio, animation) or the encouraged lines of reasoning (e.g., example study, self-explanation, conceptual task, procedural task) and combinations
  
 
*Instructional activities designed to engage students in [[coordination]] (e.g., conceptual vs. [[procedural]] exercises, contiguous presentation of sources, [[self-explanation]])
 
*Instructional activities designed to engage students in [[coordination]] (e.g., conceptual vs. [[procedural]] exercises, contiguous presentation of sources, [[self-explanation]])
 
  
 
See [[:Category:Independent Variables]]
 
See [[:Category:Independent Variables]]
  
=== Dependent variables ===
+
== Dependent variables ==
 
[[Normal post-test]] and measures of [[robust learning]].
 
[[Normal post-test]] and measures of [[robust learning]].
  
=== Hypotheses ===
+
== Hypotheses ==
 
When students are given sources/methods whose [[sense making]] difficulties are complementary and they are engaged in coordinating the sources/methods, then their learning will be more robust than it would otherwise be.
 
When students are given sources/methods whose [[sense making]] difficulties are complementary and they are engaged in coordinating the sources/methods, then their learning will be more robust than it would otherwise be.
  
=== Explanation ===
+
== Explanation ==
  
There are both [[sense making]] and [[foundational skill building]] explanations.  From the sense making perspective, if the sources/methods yield complementary content and the student is engaged in coordinating them, then the student is more likely to successfully understand the instruction because if a student fails to understand one of the sources/methods, he can use the second to make sense of the first.  From a foundational skill building perspective, attending to both sources/methods simultaneously associates [[features]] from both with the learned knowledge components, thus potentially increasing feature validity and hence robust learning.
+
There are both [[sense making]] and [[foundational skill building]] explanations.  From the sense making perspective, if the sources/methods yield complementary content and the student is engaged in coordinating them, then the student is more likely to successfully understand the instruction because if a student fails to understand one of the sources/methods, he can use the second to make sense of the first.  From a foundational skill building perspective, attending to both sources/methods simultaneously associates [[features]] from both with the learned knowledge components, thus potentially increasing [[feature validity]] and hence [[robust learning]].
  
=== Descendents ===
+
== Descendents ==
  
;Visualizations and Multi-modal sources
+
=== Visualizations and Multi-modal sources ===
 
*[[Contiguous Representations for Robust Learning (Aleven & Butcher)]]
 
*[[Contiguous Representations for Robust Learning (Aleven & Butcher)]]
 +
**[[Static vs. Animated Visual Representations for Science Learning (Kaye, Small, Butcher, & Chi)]]
 
*[[Mapping Visual and Verbal Information: Integrated Hints in Geometry (Aleven & Butcher)]]
 
*[[Mapping Visual and Verbal Information: Integrated Hints in Geometry (Aleven & Butcher)]]
 +
**[[Training Geometry Concepts with Visual and Verbal Sources (Burchfield, Aleven, & Butcher)]]
 
*[[Visual Representations in Science Learning | Visual Representations in Science Learning (Davenport, Klahr & Koedinger)]]
 
*[[Visual Representations in Science Learning | Visual Representations in Science Learning (Davenport, Klahr & Koedinger)]]
*[[Co-training of Chinese characters| Co-training of Chinese characters (Liu, Perfetti, Dunlap, Zi, Mitchell)]]
+
* Cotraining in language learning
 +
**[[Co-training of Chinese characters| Co-training of Chinese characters (Liu, Perfetti, Dunlap, Zi, Mitchell)]]
 +
**[[Co-training and pairing| The pairing effect in Chinese cotraining (Liu, Perfetti, Dunlap, Wu, Mitchell)]]
 
*[[Learning Chinese pronunciation from a “talking head”| Learning Chinese pronunciation from a “talking head” (Liu, Massaro, Dunlap, Wu, Chen,Chan, Perfetti)]] [Was in Refinement and Fluency]
 
*[[Learning Chinese pronunciation from a “talking head”| Learning Chinese pronunciation from a “talking head” (Liu, Massaro, Dunlap, Wu, Chen,Chan, Perfetti)]] [Was in Refinement and Fluency]
 +
*[[Visual Feature Focus in Geometry: Instructional Support for Visual Coordination During Learning (Butcher & Aleven)]]
 +
*[[Learning About Emergence and Heat Transfer (Chi)]]
 +
*[[Sequencing learning with multiple representations of rational numbers (Aleven, Rummel, & Rau)]]
 +
*[[Leverage Learning from Chemistry Visualizations (Ming & Schoenfield)]]
 +
*[[Perceptual Fluency in Geometry Achievement(Kao)]]
  
 
+
=== Examples and Explanations ===
;Examples and Explanations
+
*[[Booth | Improving skill at solving equations through better encoding of algebraic concepts (Booth, Siegler, Koedinger & Rittle-Johnson)]]
*[[Booth | Knowledge component construction vs. recall (Booth, Siegler, Koedinger & Rittle-Johnson)]]
+
*[[McLaren_et_al_-_Studying_the_Learning_Effect_of_Personalization_and_Worked_Examples_in_the_Solving_of_Stoich_Problems | Studying the Learning Effect of Personalization and Worked Examples in the Solving of Stoichiometry Problems (McLaren, Koedinger & Yaron)]]
*[[Stoichiometry_Study | Studying the Learning Effect of Personalization and Worked Examples in the Solving of Stoichiometry Problems (McLaren, Koedinger & Yaron)]]
+
 
*[[Note-Taking_Technologies | Note-taking Project Page (Bauer & Koedinger)]]
 
*[[Note-Taking_Technologies | Note-taking Project Page (Bauer & Koedinger)]]
 
**[[Note-Taking: Restriction and Selection]] (completed)
 
**[[Note-Taking: Restriction and Selection]] (completed)
Line 87: Line 97:
 
**[[In vivo comparison of Cognitive Tutor Algebra using handwriting vs typing input]] (in progress)
 
**[[In vivo comparison of Cognitive Tutor Algebra using handwriting vs typing input]] (in progress)
 
*[[Bridging_Principles_and_Examples_through_Analogy_and_Explanation | Bridging Principles and Examples through Analogy and Explanation (Nokes & VanLehn)]]
 
*[[Bridging_Principles_and_Examples_through_Analogy_and_Explanation | Bridging Principles and Examples through Analogy and Explanation (Nokes & VanLehn)]]
*[[Does learning from worked-out examples improve tutored problem solving? | Does learning from worked-out examples improve tutored problem solving? (Renkl, Aleven & Salden)]]  [Also in Interactive Communication]
+
*[[Does learning from worked-out examples improve tutored problem solving? | Does learning from worked-out examples improve tutored problem solving? (Renkl, Aleven & Salden)]]
 
*[[Ringenberg_Examples-as-Help | Scaffolding Problem Solving with Embedded Example to Promote Deep Learning (Ringenberg & VanLehn)]]
 
*[[Ringenberg_Examples-as-Help | Scaffolding Problem Solving with Embedded Example to Promote Deep Learning (Ringenberg & VanLehn)]]
 +
* [[The_Help_Tutor__Roll_Aleven_McLaren|Tutoring a meta-cognitive skill: Help-seeking (Roll, Aleven & McLaren)]]
 +
*[[Roll_IPL | Invention as Preparation for Learning (Roll, Aleven, Koedinger & Schwartz)]]
 +
*[[Baker_Choices_in_LE_Space | How Content and Interface Features Influence Student Choices Within the Learning Space (Baker, Corbett, Koedinger, & Rodrigo)]]
 +
*[[Mayer_and_McLaren_-_Social_Intelligence_And_Computer_Tutors | McLaren and Mayer - Social Intelligence and Learning from "polite" tutors]]
  
=== Annotated Bibliography ===
+
== Annotated Bibliography ==
 
Much research in human and machine learning research has advocated various kinds of “multiples” to assist learning:  
 
Much research in human and machine learning research has advocated various kinds of “multiples” to assist learning:  
 
* multiple data sources (e.g., human learning (HL): Mayer, 2001; machine learning (ML): Blum & Mitchell, 1998; Collins & Singer, 1999).   
 
* multiple data sources (e.g., human learning (HL): Mayer, 2001; machine learning (ML): Blum & Mitchell, 1998; Collins & Singer, 1999).   
Line 97: Line 111:
 
* multiple learning tasks (e.g., HL: Holland, Holyoak, Nisbett, & Thagard, 1986; ML: Caruana, 1997; Case, Jain, Ott, Sharma, & Stephan, 1998);  
 
* multiple learning tasks (e.g., HL: Holland, Holyoak, Nisbett, & Thagard, 1986; ML: Caruana, 1997; Case, Jain, Ott, Sharma, & Stephan, 1998);  
  
Experiments in human learning have demonstrated, for instance, that instruction that combines rules or principles and [[example]]s yields better results than either alone (Holland, Holyoak, Nisbett, & Thagard, 1986) or, for instance, iterative instruction of both [[Procedural tasks|procedures]] and [[Conceptual  tasks|concepts]] better learning (Rittle-Johnson & Koedinger, 2002; Rittle-Johnson, Siegler, & Alibali, 2001).  
+
Experiments in human learning have demonstrated, for instance, that instruction that combines rules or principles and [[example]]s yields better results than either alone (Holland, Holyoak, Nisbett, & Thagard, 1986) or, for instance, iterative instruction of both [[Procedural tasks|procedures]] and [[Conceptual  tasks|concepts]] better learning (Rittle-Johnson & Koedinger, 2002; Rittle-Johnson, Siegler, & Alibali, 2001).   See also the [http://www.psyc.memphis.edu/learning/principles/lp5.shtml variable learning principle.]
  
 
Experiments in machine learning have demonstrated how more robust, generalizable learning can be achieved by training a single learner on ''multiple'' related tasks (Caruana 1997) or by training ''multiple'' learning systems on the same task (Blum & Mitchell 1998; Collins & Singer 1999; Muslea, Minton, & Knoblock, 2002).  Blum and Mitchell (1998) provide both empirical results and a proof of the circumstances under which strategy combinations enhance learning.  In particular, the [[co-training]] approach for combining multiple learning strategies yields better learning to the extent that the learning strategies produce “uncorrelated errors” – when one is wrong the other is often right.  As an example of PSLC work, Donmez et al. (2005) demonstrate, using a multi-dimensional collaborative process analysis, that regularities across ''multiple'' codings of the same data can be exploited for the purpose of improving text classification accuracy for difficult codings.
 
Experiments in machine learning have demonstrated how more robust, generalizable learning can be achieved by training a single learner on ''multiple'' related tasks (Caruana 1997) or by training ''multiple'' learning systems on the same task (Blum & Mitchell 1998; Collins & Singer 1999; Muslea, Minton, & Knoblock, 2002).  Blum and Mitchell (1998) provide both empirical results and a proof of the circumstances under which strategy combinations enhance learning.  In particular, the [[co-training]] approach for combining multiple learning strategies yields better learning to the extent that the learning strategies produce “uncorrelated errors” – when one is wrong the other is often right.  As an example of PSLC work, Donmez et al. (2005) demonstrate, using a multi-dimensional collaborative process analysis, that regularities across ''multiple'' codings of the same data can be exploited for the purpose of improving text classification accuracy for difficult codings.

Latest revision as of 11:35, 31 August 2011

The PSLC Coordinative Learning cluster

Abstract

The studies in the Coordinative Learning cluster tend to focus on varying a) the types of information available to learning or b) the instructional methods that they employ. In particular, the studies focus on the impact of having learners coordinate two or more types. Given that the student has multiple sources/methods available, two factors that might impact learning are:

  • What is the relationship between the content in the two sources or the content generated by the two methods? Our hypothesis is that the two sources or methods facilitate robust learning when a knowledge component is difficult to understand or absent in one and is present or easier to understand in the other.
  • When and how does the student coordinate between the two sources or methods? Our hypothesis is that students should be encouraged to compare the two, perhaps by putting them close together in space or time.

At the micro-level, the overall hypothesis is that robust learning occurs when the learning event space has target paths whose sense making difficulties complement each other (as expressed in the first bullet above) and the students make path choices that take advantage of these complementary paths (as in the second bullet, above). This hypothesis is just a specialization of the general PSLC hypothesis to this cluster.

The matrix below shows how studies in this cluster (pages for these studies can be found Descendants section below) either test or make use of various instructional methods or treatments. When a study tests an instructional method a "v" is one shown in the appropriate cell to indicate that that method is varied in the study, that is, the robust learning gains of an experimental condition that receives this method are contrasted with those of an otherwise equivalent control condition that does not receive this method. In this case (when a "v" is present), the study tests the instructional principle indicated in the column. When a cell contains a "b" it indicates that both the experimental and control conditions use this instructional method (or employ this instructional principle). In this case, the study is not a true experimental test of the principle.


Cl.JPG

Glossary

Coordinative Learning glossary.

Research questions

When and how does coordinating multiple sources of information or lines of reasoning increase robust learning?

Two sub-groups of coordinative learning studies are exploring these more specific questions:

Visualizations and Multi-modal sources

When does adding visualizations or other multi-modal input enhance robust learning and how do we best support students in coordinating these sources?

Examples and Explanations

When and how should example study be combined and coordinated with problem solving to increase robust learning? When and how should explicit explanations be added or requested of students before, during, or after example study and problem solving practice?

Independent variables

  • Content of the sources (e.g., pictures, diagrams, written text, audio, animation) or the encouraged lines of reasoning (e.g., example study, self-explanation, conceptual task, procedural task) and combinations

See Category:Independent Variables

Dependent variables

Normal post-test and measures of robust learning.

Hypotheses

When students are given sources/methods whose sense making difficulties are complementary and they are engaged in coordinating the sources/methods, then their learning will be more robust than it would otherwise be.

Explanation

There are both sense making and foundational skill building explanations. From the sense making perspective, if the sources/methods yield complementary content and the student is engaged in coordinating them, then the student is more likely to successfully understand the instruction because if a student fails to understand one of the sources/methods, he can use the second to make sense of the first. From a foundational skill building perspective, attending to both sources/methods simultaneously associates features from both with the learned knowledge components, thus potentially increasing feature validity and hence robust learning.

Descendents

Visualizations and Multi-modal sources

Examples and Explanations

Annotated Bibliography

Much research in human and machine learning research has advocated various kinds of “multiples” to assist learning:

  • multiple data sources (e.g., human learning (HL): Mayer, 2001; machine learning (ML): Blum & Mitchell, 1998; Collins & Singer, 1999).
  • multiple representations (e.g., HL: Ainsworth & Van Labeke, 2004; ML: Liere & Tadepalli, 1997),
  • multiple strategies (e.g., HL: Klahr & Siegler, 1978; ML: Michalski & Tecucci 1997; Saitta, Botta, & Neri, 1993);
  • multiple learning tasks (e.g., HL: Holland, Holyoak, Nisbett, & Thagard, 1986; ML: Caruana, 1997; Case, Jain, Ott, Sharma, & Stephan, 1998);

Experiments in human learning have demonstrated, for instance, that instruction that combines rules or principles and examples yields better results than either alone (Holland, Holyoak, Nisbett, & Thagard, 1986) or, for instance, iterative instruction of both procedures and concepts better learning (Rittle-Johnson & Koedinger, 2002; Rittle-Johnson, Siegler, & Alibali, 2001). See also the variable learning principle.

Experiments in machine learning have demonstrated how more robust, generalizable learning can be achieved by training a single learner on multiple related tasks (Caruana 1997) or by training multiple learning systems on the same task (Blum & Mitchell 1998; Collins & Singer 1999; Muslea, Minton, & Knoblock, 2002). Blum and Mitchell (1998) provide both empirical results and a proof of the circumstances under which strategy combinations enhance learning. In particular, the co-training approach for combining multiple learning strategies yields better learning to the extent that the learning strategies produce “uncorrelated errors” – when one is wrong the other is often right. As an example of PSLC work, Donmez et al. (2005) demonstrate, using a multi-dimensional collaborative process analysis, that regularities across multiple codings of the same data can be exploited for the purpose of improving text classification accuracy for difficult codings.

An ambitious goal of PSLC is provide a rigorous causal theory of human learning results at the level of precision of machine learning research.

  • Ainsworth, S., Bibby, P., & Wood, D. (2002). Examining the effects of different multiple representational systems in learning primary mathematics. The Journal of the Learning Sciences, 11(1), 25–61.
  • Ainsworth, S.E. & Van Labeke (2004) Multiple forms of dynamic representation. Learning and Instruction, 14(3), 241-255.
  • Blum, A., & Mitchell, T. (1998). Combining labeled and unlabeled data with co-training. In Proceedings of Eleventh Annual Conference on Computational Learning Theory (COLT), (pp. 92–100). New York: ACM Press. Available: citeseer.nj.nec.com/blum98combining.html
  • Caruana, R. (1997). Multitask learning. Machine Learning 28(1), 41-75. Available: citeseer.nj.nec.com/caruana97multitask.html.
  • Case, J., Jain, S., Ott, M., Sharma, A., & Stephan, F. (1998). Robust learning aided by context. In Proceedings of Eleventh Annual Conference on Computational Learning Theory (COLT), (pp. 44-55). New York: ACM Press.
  • Collins, M., & Singer, Y. (1999). Unsupervised models for named entity classification. In Proceedings of the Joint SIGDAT Conference on Empirical Methods in Natural Language Processing and Very Large Corpora (pp. 189–196).
  • Donmez, P., Rose, C. P., Stegmann, K., Weinberger, A., and Fischer, F. (2005). Supporting CSCL with Automatic Corpus Analysis Technology, to appear in the Proceedings of Computer Supported Collaborative Learning.
  • Holland, J. H., Holyoak, K. J., Nisbett, R. E., & Thagard, P. R. (1986). Induction: Processes of inference, learning, and discovery. Cambridge, MA: MIT Press.
  • Klahr D., and Siegler R.S. (1978). The Representation of Children's Knowledge. In H.W. Reese and L.P. Lipsitt (Eds.), Advances in Child Development and Behavior, Academic Press, New York, NY, pp. 61-116.
  • Liere, R., & Tadepalli, P. (1997). Active learning with committees for text categorization. In Proceedings of AAAI-97, 14th Conference of the American Association for Artificial Intelligence (pp. 591—596). Menlo Park, CA: AAAI Press.
  • Mayer, R. E. (2001). Multimedia learning. New York: Cambridge University Press.
  • Michalski, R., & Tecuci, G. (Eds.) (1997). Machine learning: A multi-strategy approach. Morgan Kaufmann.
  • Muslea, I., Minton, S., & Knoblock, C. (2002). Active + semi-supervised learning = robust multi-view learning. In Proceedings of ICML-2002. Sydney, Australia.
  • Rittle-Johnson, B., Siegler, R. S., & Alibali, M. W. (2001). Developing conceptual understanding and procedural skill in mathematics: An iterative process. Journal of Educational Psychology, 93(2), 346–262.
  • Rittle-Johnson, B., & Koedinger, K. R. (2002). Comparing instructional strategies for integrating conceptual and procedural knowledge. Paper presented at the Psychology of Mathematics Education, National, Athens, GA.
  • Saitta, L., Botta, M., & Neri, F. (1993). Multi-strategy learning and theory revision. Machine Learning, 11(2/3), 153–172.