The Use and Misuse of Computers in Education: Evidence from a Randomized Experiment in Colombia

|

This page in:

super random sampling or random supersampling? you be the judgeWorld Bank Economist Felipe Barrera-Osorio, working with Leigh Linden of Columbia University, has just published a very useful and rigorous study on the impact of ICT use in Colombia.

The Use and Misuse of Computers in Education: Evidence from a Randomized Experiment in Colombia (PDF) looked at  97 schools and 5,201 children over two years of participation in the Computers for Schools program.

While some readers may immediately latch onto the finding that the program "had little effect on students’ test scores", I found the potential explanation for this lack of positive impact to be even more valuable:

"The main reason for these results seems to be the failure to incorporate the computers into the educational process. Although the program increased the number of computers in the treatment schools and provided training to the teachers on how to use the computers in their classrooms, surveys of both teachers and students suggest that teachers did not incorporate the computers into their curriculum."

This points to a fundamental paradox in many, if not most, large scale roll-outs of computers in schools in developing countries: one of the primary rationales for their purchase and deployment is to bring about improvements in student test scores in core subjects, yet in practice they are typically used for basic 'computer instruction'.

This is the first in what is hoped to be a series of rigorous analytical studies sponsored by the World Bank examining the impact of ICT use in education in various ways.

Note: Public domain image from Wikimedia Commons.

Authors

Michael Trucano

Global Lead for Innovation in Education, Sr. Education & Technology Policy Specialist

Alan Foo
June 10, 2009

"The main reason for these results seems to be the failure to incorporate the computers into the educational process. Although the program increased the number of computers in the treatment schools and provided training to the teachers on how to use the computers in their classrooms, surveys of both teachers and students suggest that teachers did not incorporate the computers into their curriculum." ... and the failure to incorporate is actually the wrong use of technology to be used in Education in mass Education. yes, in the end many schools , including many found in other countries like Malaysia where one O-level student when asked, answered that he never had the chance to use computers in his entire school life. .. the reason? The school lab was/and still is always locked... for lack of contents suitable for schools subjects. They cant be teaching Windows paintbrush year in and out can they? Yet Malaysia spent a lot of money for such contents. What went wrong? Trying to use latest technology for education will face lots of challenges when in real classrooms environment. Trying to use rich men's tools for the poor guys will never work. Alan 

Robin Gupta
September 10, 2009

I think computer education has both good and bad effects. The more we depand on computers the less we use mind. I remember myself being sharp at mathematics in my childhood and now a days i Use computers and i fumble when computers are not there. If i was given computer education in my childhood things would have been different, we just used to mug for exams rather then learn but it was good to get marks and not learn. today computers are doing a good job, when we see africa, we can see it in google earth and see pics. earlier it was text based. Jitendra Jain 

e-okul
January 02, 2010

Yes, in the end many schools, including many found in other countries like Malaysia ,where one O-level student, when asked, answered that he never had the chance to use computers in his entire school life. The reason? The school lab was/and still is always locked ... for lack of contents suitable for schools subjects. They can't be teaching Windows paintbrush year in and out can they? Yet Malaysia spent a lot of money for such contents. What went wrong?Nice article, very helpful. Thanks!!

Anonymous
June 14, 2012

Is there some threshold that must be overcome in order to see an improvement? Apparently, there is no linear advantage, i.e., use a computer a little and see a little improvement-- use it a lot and see a lot.

When a system fails it is because it was not used enough or in the right way. What is the right way? How much must it be used. 100% total immersion?

I think that if a kid can learn the traditional way chances are the kid is likely to be able to learn with computers and if he can not learn the traditional way then chances are he cannot learn with computers.

I have yet to see any proof (and it may be impossible to prove) that computers are better than traditional methods.

It may be a little like saying how much did blackboards and chalk improve education? Computers are just tools. But are they cost effective?

Nobody has answered that question.

Kristen
March 24, 2017

I agree to a certain extent with what you are saying. Computers are merely a tool in aiding learning. In the same breath, however, the world is rapidly changing. Technological advances call for us to keep up with the times. Computers in Education as well as teaching computer education is absolutely necessary in meeting the demands of the world around us. It is of the utmost importance to acquire the necessary skills needed to put yourself out there and with that being said, we need to make use of the tools we have to our disposal. The kids of today are tech savvy and know more about technology than traditional methods. It is therefore important to keep up with these things.