Effects of Feedback Interventions on Letter-String Problem Solving by Analogical Transfer Effects of feedback interventions.
Main Article Content
Abstract
This paper explored the effects of different feedback manipulations on letter-string problem solving by analogical transfer. Specifically, the present studies assessed the effects of the type of feedback (first experiment); long exposure to feedback (second experiment) and the number of feedback problems during the practice phase (experiment 3). Participants were college undergraduate students who voluntarily received and answered printed letter string problems. Results showed that correct answer feedback has a significant positive effect on deep structure problem solving; they also showed that problem solution occurs much faster and evolves in a more straightforward manner with this type of feedback. Results also showed a direct relationship between the number of problems with correct answer feedback during the training phase, and the number of correct answers during the testing trial. Results are discussed in terms of the importance of using within-subject experimental designs in both the feedback interventions and analogical transfer literatures.
Downloads
Article Details
This work is licensed under a Creative Commons Attribution 4.0 International License.
La RACC aplicará la licencia internacional de atribuciones comunes creativas (Reconocimiento 4.0 Internacional: https://creativecommons.org/licenses/by/4.0/).
Bajo esta licencia, se permite cualquier explotación de la obra, incluyendo la explotación con fines comerciales y la creación de obras derivadas, la distribución de las cuales también está permitida sin ninguna restricción. Esta licencia es una licencia libre según la Freedom Defined. La única condición es que siempre y en todos los casos se cite a los autores y a la fuente original de publicación (i.e., RACC). Esta licencia fue desarrollada para facilitar el acceso abierto, gratuito y libre a trabajos originales científicos y artísticos.
References
Alfieri, L., Nokes-Malach, T. J., & Schunn, C. D. (2013). Learning through case comparisons: A meta-analytic review. Educational Psychologist, 48(2), 87-113. http://dx.doi.org/10.1080/00461520.2013.775712
Anzanello, M. J., & Fogliatto, F. S. (2011). Learning curve models and applications: Literature review and research directions. International Journal of Industrial Ergonomics, 41(5), 573-583. https://doi.org/10.1016/j.ergon.2011.05.001
Ashford, S. J., & Cummings, L. L. (1983). Feedback as an individual resource: Personal strategies of creating information. Organizational Behavior and Human Performance, 32(3), 370-398. https://doi.org/10.1016/0030- 5073(83)90156-3
Balcazar, F., Hopkins, B. L., & Suarez, Y. (1985). A critical, objective review of performance feedback. Journal of Organizational Behavior Management, 7(3-4), 65-89. https://doi.org/10.1300/J075v07n03_05
Ball, L. J., Hoyle, A. M., & Towse, A. S. (2010). The facilitatory effect of negative feedback on the emergence of analogical reasoning abilities. British Journal of Developmental Psychology, 28(3), 583-602. https://doi.org/10.1348/026151009X461744
Bokhove, C., & Drijvers, P. (2012). Effects of a digital intervention on the development of algebraic expertise. Computers & Education, 58(1), 197-208. https://doi.org/10.1016/j.compedu.2011.08.010
Bolton, L. (2019). Foundational mathematics education in developing countries. K4D Helpdesk Report 657. Brighton, UK: Institute of Development Studies. https://opendocs.ids.ac.uk/opendocs/handle/20.500.12413/14736
Brown, P. L., & Jenkins, H. M. (1968). Auto‐shaping of the pigeon's key‐peck. Journal of the Experimental Analysis of Behavior, 11(1), 1-8. https://doi.org/10.1901/jeab.1968.11-1
Burns, B. D. (1996). Meta-analogical transfer: Transfer between episodes of analogical reasoning. Journal of Experimental Psychology: Learning, Memory, and Cognition, 22(4), 1032-1048. https://doi.org/10.1037/0278-7393.22.4.1032
Carpenter, S. K., & Vul, E. (2011). Delaying feedback by three seconds benefits retention of face–name pairs: The role of active anticipatory processing. Memory & Cognition, 39(7), 1211-1221. https://doi.org/10.3758/s13421-011-0092-1
Catania, A. C. (1998). Learning (4th ed.). Upper Saddle River, Prentice Hall.
Catrambone, R., & Holyoak, K. J. (1989). Overcoming contextual limitations on problem-solving transfer. Journal of Experimental Psychology: Learning, Memory, and Cognition, 15(6), 1147-1156. https://doi.org/10.1037/0278-7393.15.6.1147
Chen, Z. (1999). Schema induction in children's analogical problem solving. Journal of Educational Psychology, 91(4), 703-715. https://doi.org/10.1037/0022-0663.91.4.703
Chi, M. T., & VanLehn, K. A. (2012). Seeing deep structure from the interactions of surface features. Educational Psychologist, 47(3), 177-188. https://doi.org/10.1080/00461520.2012.695709
Christianson, K., Mestre, J. P., & Luke, S. G. (2012). Practice makes (nearly) perfect: Solving ‘students‐and‐professors’‐type algebra word problems. Applied Cognitive Psychology, 26(5), 810-822. https://doi.org/10.1002/acp.2863
Corbalan, G., Paas, F., & Cuypers, H. (2010). Computer-based feedback in linear algebra: Effects on transfer performance and motivation. Computers & Education, 55(2), 692-703. https://doi.org/10.1016/j.compedu.2010.03.002
Crooks, T. J. (1988). The impact of classroom evaluation practices on students. Review of Educational Research, 58(4), 438-481. https://doi.org/10.3102/00346543058004438
Deci, E. L., Koestner, R., & Ryan, R. M. (1999). A meta-analytic review of experiments examining the effects of extrinsic rewards on intrinsic motivation. Psychological Bulletin, 125(6), 692-700. https://doi.org/10.1037/0033-2909.125.6.627
Diehl, E., & Sterman, J. D. (1995). Effects of feedback complexity on dynamic decision making. Organizational Behavior and Human Decision Processes, 62(2), 198-215. https://doi.org/10.1006/obhd.1995.1043
Doabler, C. T., Clarke, B., Kosty, D., Turtura, J. E., Firestone, A. R., Smolkowski, K., Jungjohann, K., Brafford, T. L., Nelson, N. J., Sutherland, M., Fien, H., & Maddox, S. A. (2019). Efficacy of a First-Grade Mathematics Intervention on Measurement and Data Analysis. Exceptional Children, 86(1), 77–94. https://doi.org/10.1177/0014402919857993
European Education and Culture Executive Agency, Eurydice, Forsthuber, B., Horvath, A., Almeida Coutinho, A. (2012). Science education in Europe – National policies, practices and research, Publications Office. https://data.europa.eu/doi/10.2797/7170
Foreman-Murray, L., & Fuchs, L. S. (2019). Quality of explanation as an indicator of fraction magnitude understanding. Journal of Learning Disabilities, 52(2), 181-191. https://doi.org/10.1177/0022219418775120
Gick, M. L., & Holyoak, K. J. (1983). Schema induction and analogical transfer. Cognitive Psychology, 15(1), 1-38. https://doi.org/10.1016/0010-0285(83)90002-6
Goldwater, M. B., & Jamrozik, A. (2019). Can a relational mindset boost analogical retrieval? Cognitive Research: Principles and Implications, 4(47), 1-16. https://doi.org/10.1186/s41235-019-0198-8
Grose, R. F., & Birney, R. C. (1963). Transfer of learning: An enduring problem in psychology. Van Nostrand.
Grünke, M., Sperling, M., & Burke, M. D. (2017). The Impact of Explicit Timing, Immediate Feedback, and Positive Reinforcement on the Writing Outcomes of Academically and Behaviorally Struggling Fifth-Grade Students. Insights into Learning Disabilities, 14(2), 135-153. https://files.eric.ed.gov/fulltext/EJ1164944.pdf
Hattie, J., & Timperley, H. (2007). The power of feedback. Review of Educational Research, 77(1), 81-112. https://doi.org/10.3102/003465430298487
Hattie, J., & Zierer, K. (2019). Visible learning insights. Routledge.
Hays, W. L. (1973). Statistics for the social sciences. Holt, Rinehart & Winston.
Hegarty, M., Mayer, R. E., & Monk, C. A. (1995). Comprehension of arithmetic word problems: A comparison of successful and unsuccessful problem solvers. Journal of Educational Psychology, 87(1), 18-32. https://doi.org/10.1037/0022-0663.87.1.18
Hull, C. L. (1943). Principles of behavior: An introduction to behavior theory. Appleton- Century Crofts.
Ibarra-Sáiz, M. S., Rodríguez-Gómez, G., & Boud, D. (2020). Developing student competence through peer assessment: the role of feedback, self-regulation and evaluative judgement. Higher Education, 137-156. https://doi.org/10.1007/s10734-019-00469-2
Iversen, I. H., & Lattal, K. A. (1991). Experimental analysis of behavior. Elsevier.
Johnson, D. A. (2013). A component analysis of the impact of evaluative and objective feedback on performance. Journal of Organizational Behavior Management, 33(2), 89-103. https://doi.org/10.1080/01608061.2013.785879
Jonassen, D. H. (1997). Instructional design models for well-structured and III-structured problem-solving learning outcomes. Educational Technology Research and Development, 45, 65-94. https://doi.org/10.1007/BF02299613
Keller, F. S., & Schoenfeld, W. N. (1950). Principles of psychology: A systematic text in the science of behavior. Appleton-Century Crofts
Kelley, M. E., Nadler, C. B., Rey, C., Cowie, S., & Podlesnik, C. A. (2017). Noncontingent reinforcement competes with response performance. Journal of the Experimental Analysis of Behavior, 107(3), 343-353. https://doi.org/10.1002/jeab.255
Kim, E., & Pak, S.-J. (2002). Students do not overcome conceptual difficulties after solving 1000 traditional problems. American Journal of Physics, 70(7), 759-765. https://doi.org/10.1119/1.1484151
King, P. E., Young, M. J., & Behnke, R. R. (2000). Public speaking performance improvement as a function of information processing in immediate and delayed feedback interventions. Communication Education, 49(4), 365-374. https://doi.org/10.1080/03634520009379224
Kirk R. (1995). Experimental design: Procedures for the behavioral sciences. 3rd. Pacific Grove, Brooks/Cole.
Kluger, A. N., & DeNisi, A. (1996). The effects of feedback interventions on performance: A historical review, a meta-analysis, and a preliminary feedback intervention theory. Psychological Bulletin, 119(2), 254-284. https://doi.org/10.1037/0033-2909.119.2.254
Kulhavy, R. W., & Stock, W. A. (1989). Feedback in written instruction: The place of response certitude. Educational Psychology Review, 1(4), 279-308. https://doi.org/10.1007/BF01320096
Lei, J. (2010). Quantity versus quality: A new approach to examine the relationship between technology use and student outcomes. British Journal of Educational Technology, 41(3), 455-472. https://doi.org/10.1111/j.1467-8535.2009.00961.x
Lobato, J. (2006). Alternative perspectives on the transfer of learning: History, issues, and challenges for future research. The Journal of the Learning Sciences, 15(4), 431-449. https://doi.org/10.1207/s15327809jls1504_1
Mangiapanello, K. A., & Hemmes, N. S. (2015). An analysis of feedback from a behavior analytic perspective. The Behavior Analyst, 38(1), 51-75. https://doi.org/10.1007/s40614-014-0026-x
Meador, S. K., & Hatfield, D. B. (2010). The Corsini Encyclopedia of Psychology. Wiley Online Library. https://doi.org/10.1002/9780470479216.corpsy0961
Mohamed, A. (2020). Feedback in Computer-Assisted Language Learning: A Meta-Analysis. The Electronic Journal fo English as a Second Language, 24(2). http://www.tesl-ej.org/wordpress/issues/volume24/ej94/ej94a4/
Murphy, P. (2010). Web-based collaborative reading exercises for learners in remote locations: the effects of computer-mediated feedback and interaction via computer-mediated communication. ReCALL, 22(2), 112-134. https://doi.org/10.1017/S0958344010000030
Novick, L. R., & Holyoak, K. J. (1991). Mathematical problem solving by analogy. Journal of Experimental Psychology: Learning, Memory, and Cognition, 17(3), 398-415. https://doi.org/10.1037/0278-7393.17.3.398
Patchan, M. M., & Puranik, C. S. (2016). Using tablet computers to teach preschool children to write letters: Exploring the impact of extrinsic and intrinsic feedback. Computers & Education, 102, 128-137. https://doi.org/10.1016/j.compedu.2016.07.007
Peterson, N. (1982). Feedback is not a new principle of behavior. The Behavior Analyst, 5(1), 101-102. https://doi:10.1007/BF03393144
Pulido, M. A. (2002). Transferencia analógica en la solución de problemas de cuatro términos con un diseño de ensayo múltiple. Revista Mexicana de Psicología, 19(1), 23-34.
Pulido, M. A., Almaraz, D. A., García, D. G., & Martínez, L. M. (2010). Ten years of research on letter string problem solving by Meta-Analogical Transfer. Journal of Behavior, Health & Social Issues, 2(1), 83-89. https://doi:10.5460/jbhsi.v2.i1.09
Pulido, M. A., de la Garma Valenzuela, M., & Vargas, C. P. (2010). Solución de problemas por transferencia analógica: efectos de la disponibilidad del modelo. Revista Intercontinental de Psicología y Educación, 12(1), 157-170. https://www.redalyc.org/articulo.oa?id=80212393009
Pulido, M. A., Hernández, C., Peña, L. M., Ponce, N. M., & Rebolledo, M. (2010). El condicionamiento operante de la solución de problemas de secuencias de letras. Revista Mexicana de Análisis de la Conducta, 36(3), 55-76. https://doi:10.5514/rmac.v36.i3.04
Pulido, M. A., Rosas, É. O., & Piñol, N. L. (2005). La solución de problemas de cuatro términos por transferencia analógica: El efecto de las similitudes superficiales y del tipo de problema. Revista Mexicana de Psicología, 22(2), 433-440. https://www.redalyc.org/articulo.oa?id=243020634007
Reed, S. K., Ernst, G. W., & Banerji, R. (1974). The role of analogy in transfer between similar problem states. Cognitive Psychology, 6(3), 436-450. https://doi.org/10.1016/0010-0285(74)90020-6
Reimers, F., & Chung, C. K. (2016). Enseñanza y aprendizaje en el siglo XXI: metas, políticas educativas y currículo en seis países. Fondo de Cultura Económica.
Rescorla, R. A., & Wagner, A. R. (1972). A Theory of Pavlovian Conditioning: Variations in the Effectiveness of Reinforcement and Nonreinforcement. In A. H. Black, & W. F. Prokasy (Eds.), Classical Conditioning II: Current Research and Theory (pp. 64-99). Appleton- Century-Crofts.
Riper, H., van Straten, A., Keuken, M., Smit, F., Schippers, G., & Cuijpers, P. (2009). Curbing problem drinking with personalized-feedback interventions: a meta-analysis. American Journal of Preventive Medicine, 36(3), 247-255. https://doi.org/10.1016/j.amepre.2008.10.016
Ross, B. H., & Kilbane, M. C. (1997). Effects of principle explanation and superficial similarity on analogical mapping in problem solving. Journal of Experimental Psychology: Learning, Memory, and Cognition, 23(2), 427-440. https://doi.org/10.1037/0278-7393.23.2.427
Ryan, T. P. (2013). Sample size determination and power: John Wiley & Sons.
Sadler, D. R. (1989). Formative assessment and the design of instructional systems. Instructional Science, 18(2), 119-144. https://doi.org/10.1007/BF00117714
Schwartz, D. L., Chase, C. C., Oppezzo, M. A., & Chin, D. B. (2011). Practicing versus inventing with contrasting cases: The effects of telling first on learning and transfer. Journal of Educational Psychology, 103(4), 759-775. https://doi.org/10.1037/a0025140
Shute, V. J. (2008). Focus on formative feedback. Review of Educational Research, 78(1), 153-189. https://doi.org/10.3102/0034654307313795
Sidman, M. (1960). Tactics of scientific research: Evaluating experimental data in psychology. Basic Books.
Skinner, B. F. (1938). The behavior of organisms. Appleton-Century.
Skinner, B. F. (1948). 'Superstition' in the pigeon. Journal of Experimental Psychology, 38(2), 168-172. https://doi.org/10.1037/h0055873
Snyder, L. G., & Snyder, M. J. (2008). Teaching critical thinking and problem solving skills. The Journal of Research in Business Education, 50(2), 90-99. http://dme.childrenshospital.org/wp-content/uploads/2019/02/Optional-_Teaching-Critical-Thinking-and-Problem-Solving-Skills.pdf
Spiliopoulos, L., & Ortmann, A. (2018). The BCD of response time analysis in experimental economics. Experimental Economics, 21, 383–433. https://doi.org/10.1007/s10683-017-9528-1
Staddon, J. E., & Cerutti, D. T. (2003). Operant conditioning. Annual Review of Psychology, 54, 115-144.https://doi.org/10.1146/annurev.psych.54.101601.145124
Thorndike, E. L. (1898). Animal intelligence: an experimental study of the associative processes in animals. Psychological Review Monograph Supplements, 2(4), i-109. https://doi.org/10.1037/h0092987
Thorndike, E. L. (1903). Educational psychology. Lemcke & Buechner. https://doi.org/10.1037/10528-000
Timberlake, W., & Grant, D. L. (1975). Auto-shaping in rats to the presentation of another rat predicting food. Science, 190(4215), 690-692. https://doi.org/10.1126/science.190.4215.690
Toader, E.-A., & Lungu, M.-A. (2015). The impact of elaborated feedback on competency assessment of IT professionals. Informatica Economica, 19(3), 80-88. http://www.revistaie.ase.ro/content/75/07%20-%20Toader,%20Lungu.pdf
U.S. Department of Education, National Center for Education Statistics. The Condition of Education 2003, NCES 2003–067. https://nces.ed.gov/pubs2003/2003067.pdf
Van der Kleij, F. M., Eggen, T. J., Timmers, C. F., & Veldkamp, B. P. (2012). Effects of feedback in a computer-based assessment for learning. Computers & Education, 58(1), 263-272. https://doi.org/10.1016/j.compedu.2011.07.020
Van der Kleij, F. M., Feskens, R. C., & Eggen, T. J. (2015). Effects of feedback in a computer-based learning environment on students’ learning outcomes: A meta-analysis. Review of Educational Research, 85(4), 475-511. https://doi.org/10.3102/0034654314564881
Van der Kleij, F. M., Timmers, C. F., & Eggen, T. J. (2011). The effectiveness of methods for providing written feedback through a computer-based assessment for learning: A systematic review. Cadmo, 21-38. https://doi: 10.3280/CAD2011-001004
Weatherly, N. L., & Malott, R. W. (2008). An analysis of organizational behavior management research in terms of the three-contingency model of performance management. Journal of Organizational Behavior Management, 28(4), 260-285. https://doi.org/10.1080/01608060802454643
Weaver , C. A., & Kintsch, W. (1992). Enhancing students' comprehension of the conceptual structure of algebra word problems. Journal of Educational Psychology, 84(4), 419-428. https://doi.org/10.1037/0022-0663.84.4.419
Winne, P. H., & Butler, D. L. (1994). Student cognition in learning from teaching. In T. Husen & T. Postlewaite (Eds.), International Encyclopedia of Education (2nd ed., pp.5738-5745). Pergamon.
Wisniewski, B., Zierer, K., & Hattie, J. (2020). The power of feedback revisited: a meta-analysis of educational feedback research. Frontiers in Psychology, 10, 3087. https://doi.org/10.3389/fpsyg.2019.03087
Zeiler, M. D. (1972). Superstitious behavior in children: An experimental analysis. Advances in Child Development and Behavior, 7, 1-29. https://doi.org/10.1016/S0065-2407(08)60438-3