Computer or Paper? Comparison of two modes of test administration

Linda Nepivodová
Anotace

Tématem publikace je porovnání testů pokroku znalosti angličtiny, které jsou zadávány univerzitním studentům ve dvou podobách, a to v tradiční písemné formě a formě počítačové. Analýza tří fází projektu Pilot, Study 1 a Study 2 tvoří ústřední část publikace. Hlavní otázka výzkumu spočívá v tom, zda je současná praxe používání počítačové formy testu v tomto kontextu opodstatněná. Ve výzkumu je aplikována konvergentní paralelní smíšená metoda, kde jsou kvantitativní údaje použity k poměření ekvivalence mezi dvěma způsoby zadávání testu, zatímco kvalitativní údaje reprezentované vlastní zpětnou vazbou jednotlivých studentů osvětlují výhody a nevýhody obou forem testu. Publikace přináší také mnoho tipů, jak kvalitně testy připravit, čemu je potřeba věnovat pozornost a čemu se naopak vyhnout.

Více informací

E-kniha (PDF)

ISBN-13 978-80-280-0292-3
Počet stran 175
Rok vydání 2023
Pořadí vydání 1., elektronické
doi https://doi.org/10.5817/CZ.MUNI.M280-0292-2023

Brožovaná vazba

ISBN-13 978-80-280-0291-6
Formát
Počet stran 175
Rok vydání 2023
Pořadí vydání 1.

Obecné informace

Klíčová slova jazykové testování , způsob administrace , testy pokroku , reliabilita , validita
Jazyky Angličtina
Poznámka

Název česky: Počítač nebo papír?. Porovnání dvou forem administrace testu

Reference

Alderson, J. C. (1986). Computers in language testing. Computers in English Language Education and Research, Longman, 99-111.

Alderson, J. C. (2000). Technology in testing: The present and the future. System, 28(4), 593-603. https://doi.org/10.1016/S0346-251X(00)00040-3

Alderson, J. C. et al. (1995). Language test construction and evaluation. New York, USA: Cambridge University Press.

Ambrose, S. A., Bridges, M. W., DiPietro, M., Lovett, M. C., & Norman, M. K. (2010). How learning works: Seven research-based principles for smart teaching. San Francisco, CA: Jossey-Bass.

Anastasi, A. (1988). Psychological testing (6th edition). New York: Macmillan.

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford: Oxford University Press.

Bachman, L.F., & Palmer, A.S. (1996). Language testing in practice: Designing and Developing Useful Language Tests. Oxford: Oxford University Press.

Bachman, L. F., & Palmer, A. S. (2010). Language assessment in practice: Developing language assessments and justifying their use in the real world. Oxford: Oxford University Press.

Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological review, 84(2), 191-215. https://doi.org/10.1037/0033-295X.84.2.191

Barlow, J. P. (1996). A Declaration of the independence of cyberspace. Retrieved from http://www.eff.org/Misc/Publications/John_Perry_Barlow/ barlow_0296. declaration.txt https://doi.org/10.37514/RNT-J.1996.3.6.21

Bates, D., Maechler, M., Bolker, B. & Walker, S. (2015). Fitting linear mixed-effects models using lme4. Journal of Statistical Software, 67(1), 1-48. https://doi.org/10.18637/jss.v067.i01

Beckers, J. J., & Schmidt, H. G. (2003). Computer experience and computer anxiety. Computers in Human Behavior, 19(6), 785-797. https://doi.org/10.1016/S0747-5632(03)00005-0

Bennett, R. E. (2002). Inexorable and inevitable: The continuing story of technology and assessment. The Journal of Technology, Learning and Assessment 1(1), 1-24.

Bennett, R. E. (2011). Formative assessment: A Critical review. Assessment in Education: Principles, Policy and Practice, 18(1): 5-25. https://doi.org/10.1080/0969594X.2010.513678

Bennett, R.E., Braswell, J., Oranje, A., Sandene, B., Kaplan, B., & Yan, F. (2008). Does it matter if I take my mathematics test on computer? A second empirical study of mode effects in NAEP. Journal of Technology, Learning, and Assessment, 6(9), 1-39.

Bennett, S. & Maton, K. (2011). Intellectual field of faith-based religion: Moving on from the idea of 'digital natives'. In Thomas, M. (ed). Deconstructing digital natives: Young people, technology and the new literacies. pp. 169-185. London, UK: Routledge.

Bennett, S., Maton, K. and Kervin, L. (2008) The 'digital natives' debate: A critical review of the evidence. British Journal of Education Technology, 39(5), 775-86. https://doi.org/10.1111/j.1467-8535.2007.00793.x

Black, P.J. & Wiliam, D. (2012). Assessment for learning in the classroom. In Gardner, J. (ed.) Assessment and learning. 2nd ed. pp. 14-44, London: Sage. https://doi.org/10.4135/9781446250808.n2

Bloom, B. S. (1968). Learning for Mastery. Evaluation Comment, 1(2), 1-12.

Bodmann, S. M., & Robinson, D. H. (2004). Speed and performance differences among computer-based and paper-pencil tests. Journal of Educational Computing Research, 31(1), 51-60. https://doi.org/10.2190/GRQQ-YT0F-7LKB-F033

Bridgeman, B., Bejar, I. I., & Friedman, D. (1999). Fairness issues in a computer-based architectural licensure examination. Computers in Human Behavior, 15(3), 419-440. https://doi.org/10.1016/S0747-5632(99)00030-8

Brookhart, S. (2008). How to give effective feedback to your students. Alexandria, VA: Association for Supervision and Curriculum Development.

Broos, A. (2005). Gender and information and communication technologies (ICT) anxiety: Male self-assurance and female hesitation. CyberPsychology & Behavior, 8(1), 21-31. https://doi.org/10.1089/cpb.2005.8.21

Brosnan, M. J. (1998). The impact of psychological gender, gender-related perceptions, significant others, and the introducer of technology upon computer anxiety in students. Journal of Educational Computing Research, 18(1), 63-78. https://doi.org/10.2190/LVHH-EPGB-AE7J-WEV8

Brown, H. D. (2007). Principles of language learning and teaching. White Plains: Pearson Longman.

Brown, H. D., & Abeywickrama, P. (2010). Language assessment: principles and classroom practices. Upper Saddle River, N.J: Pearson Education.

Brown, J. D. (1997). Computers in language testing: Present research and some future directions. Language Learning & Technology, 1(1), 44-59.

Brown, J. D. (2005). Testing in language programs: A comprehensive guide to English language assessment. Upper Saddle River, N.J.: Prentice Hall Regents.

Brown, J. D., & Hudson, T. (2002). Criterion-referenced language testing. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9781139524803

Bunderson, C.V., Inouye, D.K., & Olsen, J.B. (1989). The four generations of computerized educational measurement. In R.L. Linn (Ed.), Educational measurement (3rd ed.), pp. 367-407. London: Collier Macmillan.

Burstein, J., & Chodorow, M. (2010). Progress and new directions in technology for automated essay evaluation. In R. Kaplan (Ed.), The Oxford handbook of applied linguistics (2nd ed.), pp. 529-38. Oxford, England: Oxford University Press. https://doi.org/10.1093/oxfordhb/9780195384253.013.0036

Canale, M. (1983). From communicative competence to communicative language pedagogy. In Richards, J. C., & Schmidt, R. W. (Eds.), Language and Communication, pp. 2-27. London: Longman.

Canale, M. & Swain, M. (1980). Theoretical bases of communicative approaches to second language teaching and testing. Applied Linguistics 1, pp. 1-47. https://doi.org/10.1093/applin/I.1.1

Carless, D. (2007). Learning-oriented assessment: Conceptual bases and practical implications. Innovations in Education and Teaching International, 44(1), 57-66. https://doi.org/10.1080/14703290601081332

Carr, N. T. (2006). Computer-based testing: Prospects for innovative assessment. Calling on CALL: From theory and research to new directions in foreign language teaching, 289-312.

Carr, N. T. (2011). Designing and analyzing language tests. Oxford: Oxford University Press.

Carroll, J. B. and S. Sapon. (1959). Modern language aptitude test (MLAT). New York, NY: The Psychological Corporation.

Chapelle, C. A. (1999). Validity in language assessment. Annual Review of Applied Linguistics, 19, 254-72. https://doi.org/10.1017/S0267190599190135

Chapelle, C. A. (2010). Technology in language testing [video]. Retrieved from http://languagetesting.info/video/main.html

Chapelle, C. A., & Douglas, D. (2006). Assessing language through computer technology. Cambridge, England: Cambridge University Press. https://doi.org/10.1017/CBO9780511733116

Charmaz, K. (2005). Grounded Theory in the 21st Century: Applications for advancing social justice studies. In Denzin, N. K., & Lincoln, Y. S. The SAGE handbook of qualitative research. Thousand Oaks: Sage Publications.

Chien, T. C. (2008). Factors influencing computer anxiety and its impact on e-learning effectiveness: A Review of Literature. Online Submission. http:// files.eric.ed.gov/fulltext/ED501623.pdf

Chomsky, N. (1965). Aspects of the theory of syntax. Cambridge, MA: Massachusetts Institute of Technology Press.

Clariana, R., & Wallace, P. (2002). Paper-based versus computer-based assessment: key factors associated with the test mode effect. British Journal of Educational Technology, 33(5), 593-602. https://doi.org/10.1111/1467-8535.00294

Clarke, M., Shore, A., Rhoades, K., Abrams, L., Miao, J., & Li, J. (2003). Perceived effects of state-mandated testing programs on teaching and learning: Findings from interviews with educators in low-, medium-, and high-stakes states. Boston, MA: Boston College, National Board on Educational Testing and Public Policy. Retrieved from http://files.eric.ed.gov/fulltext/ED474867. pdf

Cohen, S. (1972). Folk devils and moral panics. London: McGibbon & Kee. Creswell, J. W., & Clark, V. L.P. (2011). Designing and conducting mixed methods research. Thousand Oaks: Sage.

Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches. (4th ed.) Los Angeles: Sage.

Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/BF02310555

Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52, 281-302. https://doi.org/10.1037/h0040957

Cronk, B. C., & West, J. L. (2002). Personality research on the Internet: A comparison of Web-based and traditional instruments in take-home and in-class settings. Behavior Research Methods, Instruments, & Computers, 34(2), 177-180. https://doi.org/10.3758/BF03195440

Davey, T. (2011). Practical considerations in computer-based testing. Princeton, NJ: Educational Testing Service.

Davies, A., Brown, A., Elder, C., Hill, K., Lumley, T. & McNamara, T. (1999). Dictionary of language testing. Cambridge: Cambridge University Press.

DiLalla, D. L. (1996). Computerized administration of the multidimensional personality questionnaire. Assessment, 3(4), 365-374. https://doi.org/10.1177/107319119600300401

Dörnyei, Z. (2007). Research methods in applied linguistics: Quantitative, qualitative, and mixed methodologies. Oxford: Oxford University Press.

Douglas, D. (2000). Assessing languages for specific purposes. New York, NY: Cambridge University Press. https://doi.org/10.1017/CBO9780511732911

Douglas, D., & Hegelheimer, V. (2007). Assessing language using computer technology. Annual Review of Applied Linguistics, 27, 115-132. Retrieved from http://hstrik.ruhosting.nl/wordpress/wp-content/uploads/2013/03/Douglas- Hegelheimer-ARoAL-2007.pdf https://doi.org/10.1017/S0267190508070062

Draper, S. W. (2009). Catalytic assessment: understanding how MCQs and EVS can foster deep learning. British Journal of Educational Technology, 40(2), 285-293. https://doi.org/10.1111/j.1467-8535.2008.00920.x

Dudeney, G. Hockly, N & Pegrum, M. (2013). Digital literacies. Malaysia: Pearson. https://doi.org/10.4324/9781315832913

Dunkel, P.A.: 1999, Considerations in developing or using second/foreign language proficiency computer-adaptive tests. Language Learning and Technology 2(2), 77-93.

Farhady, H. (1982). Measures of language proficiency from the learner's perspective. TESOL Quaterly, 16(1). https://doi.org/10.2307/3586562

Farhady, H. (2006). Twenty-five years of living with applied linguistics: Collection of articles. Iran: Rahnama Press.

Farhady, H., and Shakery, S. (2000). Number of options and economy of multiple-choice tests. Foreign Language Teaching Journal, 14 (57).

Fulcher, G. (1999). Computerizing an English language placement test. ELT Journal, 53(4), 289-299. https://doi.org/10.1093/elt/53.4.289

Fulcher, G. (2010). Practical language testing. London: Hodder Education.

Gardner, J.(ed.), (2012). Assessment and learning. Los Angeles, Calif: Sage. https://doi.org/10.4135/9781446250808

Glowacki, M. L., McFadden, A. C., & Price, B. J. (1995). Developing computerized tests for classroom teachers: A pilot study. Paper presented at the Annual Meeting of the Mid-South Educational Research Association, Biloxi, MS. (ERIC Document Reproduction Service No. ED391471). Retrieved from Education Resources Information Center [ERIC] Web site: http://www.eric.ed.gov

Gos, M. W. (1996). Computer anxiety and computer experience: a new look at an old relationship. The Clearing House, 69(5), 271-276. https://doi.org/10.1080/00098655.1996.10114315

Green, A. (2014). Exploring language assessment and testing: Language in Action. Abingdon, Oxon: Routledge. https://doi.org/10.4324/9781315889627

Grier, J. B. (1975). The number of alternatives for optimum test reliability. Journal of Educational Measurement, 12(2), 109-113. https://doi.org/10.1111/j.1745-3984.1975.tb01013.x

Gruba, P. A. (2000). The role of digital video media in second language listening comprehension. PhD thesis, Department of Linguistics and Applied Linguistics, University of Melbourne.

Hargis, C. H. (2003). Grades and grading practices: Obstacles to improving education and to helping at-risk students. (2nd ed.). Springfield, IL: Charles C. Thomas Publisher, Ltd.

Hargreaves, M., Shorrocks-Taylor, D., Swinnerton, B., Tait, K., & Threlfall, J. (2004). Computer or paper? That is the question: does the medium in which assessment questions are presented affect children's performance in mathematics?. Educational Research, 46(1), 29-42. https://doi.org/10.1080/0013188042000178809

Harlen, W. (2012). On the relationship between assessment for formative and summative purposes. In Gardner, J. (2012). Assessment and learning. Los Angeles, Calif: Sage. https://doi.org/10.4135/9781446250808.n6

Hayward, L. (2012). Assessment and learning: The learner's perspective. In Gardner, J. Assessment and learning. Los Angeles, Calif: Sage. https://doi.org/10.4135/9781446250808.n8

Hedge, T. (2000). Teaching and learning in the language classroom. Oxford, UK: Oxford University Press.

Henning, G. (1987). A Guide to Language Testing. Cambridge, MA.: Newbury House.

Howard, G. S. (1986). Computer anxiety and management use of microcomputers.Ann Arbor: UMI Research press.

Hughes, A. (1989, 2013). Testing for language teachers. Cambridge: Cambridge University Press.

Hughes, A., Porter, D. & Weir, C. J. (1988). Validating the ELTS test: A critical review. Cambridge: The British Council and the University of Cambridge Local Examination Syndicate.

Hymes, D. H. (1972). On Communicative competence. In Pride, J. B., & Holmes, J. (eds). Sociolinguistics. pp. 269-293. Harmondsworth, UK: Penguin Books.

Ingram, E. (1977). Basic concepts in testing. In J.P.B. Allen & A. Davies (eds.), Testing and experimental methods. pp. 195-216. Oxford: Oxford University Press.

Jamieson, J. (2005). Trends in computer-based second language assessment. Annual Review of Applied Linguistics, 25, 228-242. https://doi.org/10.1017/S0267190505000127

Johnson, B., & Christensen, L. B. (2008). Educational research: quantitative, qualitative, and mixed approaches (3rd ed.). Thousand Oaks, CA: SAGE Publications, Inc.

Joiner, R., Gavin, J., Brosnan, M., Cromby, J., Gregory, H., Guiller, J., Maras, P., Moon, A. (2013). Comparing first and second generation digital natives' Internet use, Internet anxiety, and Internet identification. Cyberpsychology, Behavior and Social Networking, 16 (7), 549-52. https://doi.org/10.1089/cyber.2012.0526

Kay, R. H. (1993). An exploration of theoretical and practical foundations for assessing attitudes towards computers: the computer attitude measure (CAM). Computers in Human Behavior, 9, 371-386. https://doi.org/10.1016/0747-5632(93)90029-R

Kernan, M. C., & Howard, G. S. (1990). Computer anxiety and computer attitudes: An investigation of construct and predictive validity issues. Educational and Psychological Measurement, 50(3), 681-690. https://doi.org/10.1177/0013164490503026

Kozulin, A., & Vygotskii, L. S. (1986). Thought and language. Cambridge: MIT Press.

Kuznetsova, A., Brockhoff, P.R., & Christensen, R.H.B. (2016). lmerTest: Tests in linear mixed effects models. R package version 2.0-33. Retrieved from https://CRAN.R-project.org/package=lmerTest. https://doi.org/10.18637/jss.v082.i13

Lado, R. (1961). Language testing: The construction and use of foreign language tests. London: Longman.

Lantolf, J., & Poehner, M. (2004). Dynamic assessment of L2 development: Bringing the past into the future. Journal of Applied Linguistics, 1 (1), 49-72. https://doi.org/10.1558/japl.1.1.49.55872

Larson, J. W. (1987). Computerized adaptive language testing: A Spanish placement exam. In K. M. Baily, T. L. Dale, & R. T. Clifford (Eds.), Language testing research. pp. 1-10. Monterey, CA: Defense Language Institute.

Levine, T., & Donitsa-Schmidt, S. (1998). Computer use, confidence, attitudes, and knowledge: A causal analysis. Computers in Human Behavior, 14(1), 125-146. https://doi.org/10.1016/S0747-5632(97)00036-8

Lightstone, K., & Smith, S. M. (2009). Student choice between computer and traditional paper-and-pencil university tests: what predicts preference and performance?. Revue internationale des technologies en pédagogie universitaire/International Journal of Technologies in Higher Education, 6(1), 30-45. https://doi.org/10.7202/039179ar

Lyons, J. (1996). On communicative competence and performance. In Brown, G., Malmkjær, K., & Williams, J.: Performance and competence in second language acquisition. Cambridge: Cambridge University Press.

  1. Mohler and R. Mihalcea. (2009). Text-to-text semantic similarity for automatic short answer grading. In Proceedings of the European Association for Computational Linguistics (EACL 2009), Athens, Greece. https://doi.org/10.3115/1609067.1609130

Maxwell, J. A. (2013). Qualitative research design: An interactive approach. Thousand Oaks, Calif: SAGE Publications.

McAllister, D., & Guidice, R. M. (2012). This is only a test: A machine-graded improvement to the multiple-choice and true-false examination. Teaching in Higher Education, 17(2), 193-207. https://doi.org/10.1080/13562517.2011.611868

McDonald, A. S. (2002). The impact of individual differences on the equivalence of computer-based and paper-and-pencil educational assessments. Computers & Education, 39(3), 299-312. https://doi.org/10.1016/S0360-1315(02)00032-5

McNamara, T. F. (2000). Language testing. Oxford: Oxford University Press.

Mead, A. D., & Drasgow, F. (1993). Equivalence of computerized and paper-and-pencil cognitive ability tests: A meta-analysis. Psychological Bulletin, 114(3), 449-458. https://doi.org/10.1037/0033-2909.114.3.449

Messick, S. (1996). Validity and washback in language testing. Princeton, N.J: Educational Testing Service. https://doi.org/10.1002/j.2333-8504.1996.tb01695.x

Morrow, K. (1979). Communicative language testing: revolution of evolution? In: Brumfit, C.K., Johnson, K. (Eds.), The Communicative Approach to Language Teaching. pp. 143-159, Oxford University Press, Oxford.

Morrow, K. (2012). Comunicative language testing. In Coombe, C. A., In Davidson, P., In O'Sullivan, B., & In Stoynoff, S. The Cambridge guide to second language assessment. pp.140-146, NY: Cambridge University Press.

Nepivodová, L. (2006). On communicative language competence, validity and different modes of administration. [Unpublished MA dissertation], Department of English and American Studies, Masaryk University.

Nickell, G. S., & Pinto, J. N. (1986). The computer attitude scale. Computers in human behavior, 2(4), 301-306. https://doi.org/10.1016/0747-5632(86)90010-5

Noijons, J. (1994). Testing computer assisted language testing: Towards a checklist for CALT. Calico Journal, 12(1), 37-58. https://doi.org/10.1558/cj.v12i1.37-58

Noyes, J. M., & Garland, K. J. (2008). Computer-vs. paper-based tasks: Are they equivalent?. Ergonomics, 51(9), 1352-1375. https://doi.org/10.1080/00140130802170387

Nunan, D. (1992). Research methods in language learning. Cambridge: Cambridge University Press.

Ockey, G. J. (2009). Developments and challenges in the use of computer-based testing for assessing second language ability. The Modern Language Journal, 93, 836-47. https://doi.org/10.1111/j.1540-4781.2009.00976.x

Ogles, B. M., France, C. R., Lunnen, K. M., Bell, T., & Goldfarb, M. (1998). Computerized depression screening and awareness. Community mental health journal, 34(1), 27-38. https://doi.org/10.1023/A:1018760128239

Oller, J. W. (1979). Language tests at school. Harlow, UK: Longman.

Oller, J.W. (ed.), (1983). Issues in language testing research. Rowley, Mass.: Newbury House.

Paek, P. (2005). Recent trends in comparability studies. Pearson Educational Measurement. Retrieved from https://www.researchgate. net/profile/Pamela_Paek/publication/245023911_Recent_Trends_in_ Comparability_Studies_Using_testing_and_assessment_to_promote_learning/ links/00b7d51d5c29b537b5000000.pdf

Palfrey, J. G. & Gasser, U. (2008). Reclaiming an awkward term: What we might learn from 'digital natives'. In Thomas, M. (ed). Deconstructing digital natives: Young people, technology and the new literacies. pp. 186-204, London, UK: Routledge.

Parshall, C. G., & Harmes, J. C. (2014). Improving the quality of innovative item types: Four tasks for design and development. Journal of Applied Testing Technology, 10(1), 1-20.

Parshall, C. G., Harmes, J. C., Davey, T., & Pashley, P. J. (2009). Innovative items for computerized testing. In Elements of adaptive testing (pp. 215-230). Springer New York. https://doi.org/10.1007/978-0-387-85461-8_11

Phelps, R. P. (2011). Teach to the test?. The Wilson Quarterly, 35(4), 38-42. https://doi.org/10.1080/10948007.2011.541723

Plakans, L. (2009). Integrated assessment [video]. Retrieved from http:// languagetesting.info/video/main.html

Poehner, M. E. (2008). Dynamic assessment: A vygotskian approach to understanding and promoting L2 development. Berlin: Springer. https://doi.org/10.1007/978-0-387-75775-9

Pomplun, M., & Custer, M. (2005). The score comparability of computerized and paper-and-pencil formats for K-3 reading tests. Journal of Educational Computing Research, 32(2), 153-166. https://doi.org/10.2190/D2HU-PVAW-BR9Y-J1CL

Powers, D. E. (1999). Test anxiety and test performance: comparing paper-based and computer-adaptive versions of the GRE general test (RR-99-15). Princeton, NJ: Educational Testing Service. https://doi.org/10.1002/j.2333-8504.1999.tb01813.x

Prensky, M. (2001). Digital natives, digital immigrants. On the Horizon, 9(5), 1-6. Retrieved from http://www.marcprensky.com/writing/Prensky%20-%20 Digital%20Natives,%20Digital%20Immigrants%20-%20Part1.pdf. https://doi.org/10.1108/10748120110424816

Prensky, M. (2011). Digital wisdom and homo sapiens digital. In Thomas, M. (ed). Deconstructing digital natives: Young people, technology and the new literacies. pp. 15-29, London, UK: Routledge.

R Core Team (2016). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. Retrieved from https://www.R-project.org/.

Rabinowitz, S., & Brandt, T. (2001). Computer-based assessment: Can it deliver on its promise? Knowledge Brief. Retrieved from http://files.eric.ed.gov/fulltext/ED462447.pdf

Reece, M. J., & Gable, R. K. (1982). The development and validation of a measure of general attitudes toward computers. Educational and Psychological Measurement, 42(3), 913-916. https://doi.org/10.1177/001316448204200327

Rodriguez, M. C. (2005). Three options are optimal for multiple-choice items: a meta-analysis of 80 years of research. Educational Measurement: issues & practice. 24(2), 3-13. https://doi.org/10.1111/j.1745-3992.2005.00006.x

Roever, C. (2001). Web-based language testing. Language Learning & Technology, 5(2), 84-94.

Russell, M. (1999). Testing on computers: a follow-up study comparing performance on computer and on paper. Education Policy Analysis Archives (online). Retrieved from: <http://epaa.asu.edu/epaa/v7n20.html> (3 September 2015). https://doi.org/10.14507/epaa.v7n20.1999

Russell, M., & Haney, W. (1997). Testing writing on computers: An experiment comparing student performance on tests conducted via computer and via paper. Education policy analysis archives, 5(3). https://doi.org/10.14507/epaa.v5n3.1997

Scriven, M. (1967). The methodology of evaluation. In R. W. Tyler, R. M. Gagne, and M. Scriven (Eds.), Perspectives of curriculum evaluation, Volume I, pp. 39-83. Chicago, IL: Rand McNally.

Šeďová, K., Švaříček, R., & Šalamounová, Z. (2012). Komunikace ve školní třídě. Praha: Portál.

Selwyn, N. (1997). Students' attitudes toward computers: Validation of a computer attitude scale for 16-19 education. Computers & Education, 28(1), 35-41. https://doi.org/10.1016/S0360-1315(96)00035-8

Shermis, M. D., & Burstein, J. (2013). Handbook of automated essay evaluation: Current applications and new directions. New York, NY: Routledge. https://doi.org/10.4324/9780203122761

Silverman, D. (2006). Interpreting qualitative data: Methods for analyzing talk, text and interaction. London: Sage Publications.

Smith, B., & Caputi, P. (2007). Cognitive interference model of computer anxiety: Implications for computer-based assessment. Computers in Human Behavior, 23(3), 1481-1498. https://doi.org/10.1016/j.chb.2005.07.001

Soukup, P., & Kocvarová, I. (2016). Velikost a reprezentativita výberového souboru v kvantitativne orientovaném pedagogickém výzkumu 1. Pedagogická orientace, 26(3), 512-536. https://doi.org/10.5817/PedOr2016-3-512

Spolsky, B. (1977). Language Testing: art or science, in Nickel, G. (ed.) Proceedings of the Fourth International Congress of Applied Linguistics, pp. 7-28. Stuttgart: Hochschulverlag.

Stevenson, D. K. (1985). Authenticity, validity and a tea party. Language Testing, 2, 1, 41-47. https://doi.org/10.1177/026553228500200105

Strain-Seymour, E., Way, W. D., & Dolan, R. P. (2009). Strategies and processes for developing innovative items in large-scale assessments. Research Report. Iowa City, IA: Pearson Education.

Stricker, L. J., Wilder, G. Z., & Rock, D. A. (2004). Attitudes about the computer-based test of English as a foreign language. Computers in Human Behavior, 20(1), 37-54. https://doi.org/10.1016/S0747-5632(03)00046-3

Stubbs, M. (1996). Text and corpus analysis: Computer-assisted studies of language and culture. Oxford, OX, UK: Blackwell Publishers.

Suvorov, R., & Hegelheimer, V. (2013). Computer-assisted language testing. The companion to language assessment. Retrieved from http://onlinelibrary. wiley.com/doi/10.1002/9781118411360.wbcla083/full.https://doi.org/10.1002/9781118411360.wbcla083

Švaříček, R., & Šeďová, K. et al. (2007). Kvalitativnívýzkum v pedagogických vědách. Praha: Portal, s.r.o.

Tapscott, D. (1998). Growing up digital. The rise of the net generation. New York: McGraw Hill.

Tapscott, D. (2009). Grown up digital: How the net generation is changing your world. New York: McGraw-Hill.

Tarone, E. (1988). Variation in interlanguage. London: Edward Arnold.

Tavakol, M., & Dennick, R. (2011). Making sense of Cronbach's alpha, 53-55. Retrieved from https://doi.org/10.5116/ijme.4dfb.8dfd

Taylor, C., Jamieson, J., Eignor, D., & Kirsch, I. (1998). The relationship between computer familiarity and performance on computer-based TOEFL test tasks (Research Reports 61). Princeton, NJ: Educational Testing Service. https://doi.org/10.1002/j.2333-8504.1998.tb01757.x

Taylor, C., Kirsch, I., Eignor, D., & Jamieson, J. (1999). Examining the relationship between computer familiarity and performance on computer-based language tasks. Language Learning, 49(2), 219-274. https://doi.org/10.1111/0023-8333.00088

Valette, R. (1967) Modern language testing: A Handbook. New York, NY: Harcourt.

Van, De, Vijver, F. J. R., & Harsveld, M. (1994). The incomplete equivalence of the paper-and-pencil and computerized versions of the General Aptitude Test Battery. Journal of Applied Psychology, 79(6), 852-859. https://doi.org/10.1037/0021-9010.79.6.852

Wang, S., Jiao, H., Young, M. J., Brooks, T., & Olson, J. (2008). Comparability of computer-based and paper-and-pencil testing in K-12 reading assessments: A meta-analysis of testing mode effects. Educational and Psychological Measurement, 68(1), 5-24. https://doi.org/10.1177/0013164407305592

Weir, C. J. (1990). Communicative language testing. New York: Prentice Hall.

Weir, C. J. (2005). Language testing and validation: An evidence-based approach. Basingstoke: Palgrave Macmillan. https://doi.org/10.1057/9780230514577

Weir, C., Yan, J., O'Sullivan, B., & Bax, S. (2007). Does the computer make a difference?: The reaction of candidates to a computer-based versus a traditional hand-written form of the IELTS Writing component: effects and impact. International English Language Testing System (IELTS) Research Reports 2007: Volume 7, 1.

White, D.S. (2008). Not 'natives' and 'immigrants' but 'visitors' and 'residents. TALL blog. Retrieved from http://tallblog.conted.ox.ac.uk/index.php/2008/07/23/not-natives-immigrants-but-visitors-residents/

White, D.S. and Le Cornu, A. (2011). Visitors and residents: A new typology for online engagement. First Monday, 16(9), Retrieved from http://firstmonday.org/article/view/3171/3049. https://doi.org/10.5210/fm.v16i9.3171

Whitley, B. E. (1997). Gender differences in computer-related attitudes and behavior: A meta-analysis. Computers in Human Behavior, 13(1), 1-22. https://doi.org/10.1016/S0747-5632(96)00026-X

Widdowson, H. G. (1983). Learning purpose and language use. Oxford: Oxford University Press.

Williams, J. E., & McCord, D. M. (2006). Equivalence of standard and computerized versions of the Raven Progressive Matrices Test. Computers in Human Behavior, 22(5), 791-800. https://doi.org/10.1016/j.chb.2004.03.005

Winke, P., & Fei, F. (2008). Computer-assisted language assessment. In N. Van Deusen-Scholl & N. H. Hornberger (Eds.), Encyclopedia of language and education (Vol. 4, pp. 353-364). New York, NY: Springer.

Young, B. J. (2000). Gender differences in student attitudes toward computers. Journal of Research on Computing in Education, 33(2), 204-216. https://doi.org/10.1080/08886504.2000.10782310

Zandvliet, D., & Farragher, P. (1997). A comparison of computer-administered and written tests. Journal of Research on Computing in Education, 29(4), 423-438. https://doi.org/10.1080/08886504.1997.10782209

Žitný, P., Halama, P., Jelínek, M. & Květon, P. (2012). Validity of cognitive ability tests - comparison of computerized adaptive testing with paper-and-pencil and computer-based forms of administrations. Studia Psychologica, vol. 54, no. 3, 181-194.

 

Statistiky

Crossref Cited-by pro DOI:10.5817/CZ.MUNI.M280-0292-2023 (1)

1. Emerging Practices for Online Language Assessment, Exams, Evaluation, and Feedback
Linda Nepivodova, Simona Kalova
ISBN 9781668462287  chapter 2,  první strana: 21,  rok: 2023  
https://doi.org/10.4018/978-1-6684-6227-0.ch002


Podobné publikace