Which One Is Better: Computer-Based or Paper-Based Tests - Essay Example

Which One Is Better: Computer-Based or Paper-Based Tests

Testing has been used for a long time to evaluate learners and assess the performance of different groups of learners. Initially, most of the tests were given based on paper, and the learners had to write their answers on paper sheets and submit them for evaluation. However, since the development of the computer, many tests have been offered using either computer or based on written paper. The first comprehensive analysis of the effectiveness of the use of computers in exams was published in 1992. In the critical review, Dillon examined the available literature that discussed the use of paper-based testing and compared the data with the available publications about the use of computer-based testing methods (Dillon, 1992, pp. 1297–1326). Since the release of Dillon’s findings, many research studies have been carried out to determine the similarities and differences between the two methods of testing and to determine the most effective method and standardize testing. Although earlier studies supported paper-based testing, modern studies have consistently indicated that the computer-based testing is a more efficient way of giving tests.

Essentially, the development of computer applications for use in testing came long after paper-based testing had been established. However, CBT has consistently gained popularity in many nations across the world. The popularity of the CBT is caused by its efficiency and some advantages that the development in computer technology has brought in the world. However, despite the recognition that the computer technology is gradually replacing the paper-based technology, it is also important to understand the history of development and compare the two methods of testing.

Historical Perspective

Research that compares CBTs and PBTs has been carried out for a long period since the days when Dillon published his critical review. However, a closer inspection of earlier research indicates that the earlier researchers based their studies had limited measures of evaluation. In the modern studies, researchers have developed better and more detailed measures for evaluating the two testing methods based on scientific parameters. Also in the earlier research studies, the researchers tested reading speeds, reading accuracy and comprehension. Based on these early measures that had several limitations, early researchers found that the computer-based reading was about 20% slower than paper-based reading. Also, the reading accuracy was described to be lower when using a computer than when either reading or editing on paper. Finally, researchers initially pointed out that the level of comprehension was lower when reading on a computer screen than when reading from paper.

However, the last finding was faulted because the participants who used the computer for the comprehension tests were not offered adequate training. Bugbee (1996, pp. 282-299) observes that many learners, as well as ordinary people, are introduced to the paper-based reading and writing, and only a small proportion is exposed to computers and electronic devices earlier than the paper. Consequently, during the earlier stages of research studies, most people were more comfortable and accustomed to using paper based reading and writing and not using screens and key boards. Essentially, this observation is justified in the modern world of communication where many people, even in the less developed nation have changed to electronic communication. The paper-based communication is gradually being phased out in many areas across the world.

Furthermore, the ratio of computers available to the population was relatively few in the last decades of the twentieth century compared to the present times. For instance, in the 1990s, there was an average of one computer for every thirteen people in the US. In the present times, the number of computers in the world has increased substantially to reduce the computer to population ratio to about two to one. Further, there is a wide variety of electronic devices that can be used for reading and writing unlike in the previous periods when most computers were stationary desktops that were also relatively more expensive. Initially, the most common electronic devices available for testing were desktop computers. However, the modern renovation has increased the range of available devices to include laptop computers, tablets, and smart phones and Kindle readers. Further, developments in the software front and the internet enable many people to link remotely without necessarily sharing a physical location.

Additionally, early exposure to electronic writing instead of the pen and paper based writing has contributed significantly to the rise in the reliance on electronic testing. In modern times, children are exposed to mobile phones, iPads, and other computer devices before they learn how to write using a pen. The continuous decline in the use of letters and written communication has also significantly contributed to the reduction in the use of pen and paper during tests. Essentially, there are many types of tests that are administered. Some tests are international while others are local and customized for particular institutions. For instance, the TOEFL and SAT exams are used to assess the suitability for admission into American universities, but they are administered internationally. The PISA test is also an international test used to evaluate the effectiveness of education systems. In most centers where these exams are given, the candidates have a choice between using the computer versus paper-based system. With time, however, the use of CBTs has increased while the relevance on PBTs continues to decline.

Post-Traditional Research into CBT versus PBT

In the more recent studies activities, the traditional assessment techniques are paired with several more recent studios. Mainly, the traditional testing methods assessed the usefulness of a testing process based on the comprehension, reading speed and reading accuracy. However, since 1994, the focus changed, and the studies began dwelling on the cognitive abilities on top of the traditional; parameters. Further, there was increased focus on the outcomes from both PBTs and CBTs for the same content. The aim was to point out the specific differences or similarities between the two methods. Most papers published after 1992 either found the two testing methods to be similar or favored CBT to PBT. Most computers in the ‘90s used the cathode ray tube that had unique features that distinguished it from the paper when it came to reading. For instance, the lighting or the flicker speed of the cathode ray tube affected the reading speed. In more dark settings, it was easier to read from a screen than on paper. Similarly, in better lit conditions, reading from a well-laminated paper would be easier than reading from a dull screen.

Other research findings used psychosocial terms to explain the perceived differences in the use of CBTs and PBTs. Bugbee (1996) posited that the CBTs had more complex tasks compared to the PBTs. Consequently, many users felt extra fatigue when working with a computer than when writing and reading from paper. Also, computer tasks are more technical. Scrolling requires skills while typing and editing also require the used to be trained and experienced in the tasks. Further, the computers in the traditional days were slow and thus, would take some time before shifting from one task to another and thus the user was unnecessarily delayed in the execution of a task. Paper based reading and writing were thus perceived to be faster since all candidates had to do was to flip the paper and carry on with the successive tasks.

Modern Research

Many studies have been conducted in the recent times comparing PBTs and CBTs using scientific methods. In one research study, the outcome indicated that there is no statistically significant difference between CBTs and PBTs based on the NASA-TLXnad memory retrieval assessments. However, the researchers also concurred with the earlier findings that CBT was relatively more complicated and caused additional stress to the candidates. More recent research studies use standardized IQ tests to assess the effectiveness of each testing method. Although these testing methods have existed for a long time, their use has been enhanced by the increased number of computers in use and the preference for distance learning by many students. Similarly, the increased access to the internet led to many exams and learning modules being carried out online. In the modern times, therefore, there are many factors that favor CBTs than PBTs.

Advantages of Computer Based Testing

The increased reliance on computers use in testing is for several reasons. Firstly, the computer screen is more dynamic allows for the accommodation of many features during a presentation. The test can easily be customized based on the examiner’s and the reader’s needs. Consequently, the same content can be delivered using different speeds and complexities based on the user needs. Further, the computer graphics allow for a real-time change in the presentation form of a test according to individual preferences. Essentially, the essence of a trial is based on the interaction between a candidate and the examiner. In a CBT, the candidate can interact in real time with the examiner unlike in the PBT. This is particularly the case when the exam is administered online using the internet. In such cases, any issues with the content or delivery can be communicated between the examiner and the candidate and sorted out in a quicker way than when an exam is paper based. Apart from reducing time wastage, the real-time interaction also reduces the waste of materials. In PBTs, any major errors in the content require a reprinting or issuance of fresh material whereas in CBTs it could be as simple as hitting the backspace and entering the right content into the computer. The use of CBTs also can allow for the use of dynamic testing content where the computer chooses the next task based on how a candidate performed in the previous task. In PBT, the examination tasks are static and cannot be varied once the paper is printed. Additional testing methods can also be used in the CBT such as reaction time and typing speed which are used to assess the perceptual time.

Secondly, a CBT can be used by a higher population of individuals than a PBT. This is because, in a CBT, the tasks are stored in the virtual memory of the computer, unlike the PBT where the tasks are printed on the paper surface. Consequently, multiple users can be provided with separate personalized accounts on the same computer and allowed to sit for their tests at different times. On the contrary, each PBT can only be given to a single individual, and the location can only be occupied by the same person. Although PBTs also allow for multiple users to use the same examination center at different times, they are harder to administer because the candidates could carry the exam materials and share with other candidates who have not yet sat for the test. The papers are also cumbersome to print, transport, score and return to the candidates. A CBT on the other hand only requires the individual to save their tasks either online or locally in a computer. Another cannot access the information saved by a person thus creating a higher level of exam confidentiality.

Furthermore, CBTs can be given from multiple locations. For instance, timed tests can be taken from any location since the time constriction limits the use of additional reading materials. Further, in some tests, once a task is disposed of, it is impossible to retrieve or retake it. Such tests improve the efficiency of testing. These tests can also be customized for real-time scoring where the individual receives the results after undertaking the task unlike in the paper-based testing where the individual has to wait for some time before receiving the results of their performance. Essentially, CBTs also accommodate a more diverse population due to the possibility of customizing them based on individual needs. For instance, the disabled people can be offered either more time or tasks that are specifically customized to their needs. Such customization would be difficult if the test is given on paper. CBTs also allow examiners to increase the scope of test parameters as the computer can be used to score additional features shown by an individual such as processing time and typing speeds.

In many cases, the network testing is offered as multiple choice questions that are timed to limit the opportunity of seeking solutions from other additional sources. Moving from one is relatively easier and orderly, unlike the PBT where an individual can keep oscillating back and forth between questions thus wasting a lot of time. The timing is displayed on the screen and once the allocated period elapses, the task automatically closes and saves itself. The CBT is thus more accurate to time, unlike the PBT where the timing can sometimes depend on the discretion of the examiner. Further, all the tests are available at the same time for all the individuals unless there is a rare technical problem. Consequently, the exam can be considered as a standardized measure of intelligence. PBTs sometime waste a lot of time since the candidates have to go physically to the examination center despite possible challenges in unclear direction and transport challenges.

Thirdly, CBTs are relatively more standardized than PBTs. Essentially, this means that a CBT is offered at the same time and in a similar format for all individuals undertaking a task. The standardization was advantageous for several reasons. First, the same task can be offered for a limitless number of individuals. For instance, the PISA test is a standard measure of writing, reading, comprehension, arithmetic, and science among many nations of the world. The PISA test is also used to assess the effectiveness of the education systems and policies adopted in different nations. The use of CBT in PISA enables the examiners to provide the same test materials in different languages, for different age groups and different personalities at the same time. A paper based system would be difficult to use in an international setting due to logistic challenges. Further, if an international test were prepared and printed from different locations, there would arise challenges in ensuring that the test is standardized for all users.

The fourth advantage is that the CBT allow for the use of online scoring. As indicated earlier, the tests can either be customized for real-time scoring or the use of online resources after submission. In some tests, the learners are given a task and allowed a prior before submission. Some of these tasks require further research either offline or online. All tasks can, however, be scored online after submission. The online scoring is also accompanied by an easier interaction between the examiner and the candidate and faster transmission of the results.

Online scoring also enables the examiner to assess specific information regarding specific tasks. For instance, the average time spent on a particular task can be readily determined. The total time spent in undertaking the test is also easily accessible when CBT is used. The PBT can allow for the assessment of the total time spent in taking the test, but it cannot be used to assess the time devoted to individual tasks. The time devoted to a task can further be scored against the complexity of the task to evaluate the processing speed and IQ of an individual. The method also reduces the amount of human error in scoring since the process is automated and tamper-proof. In some international tests like the TOEFL needed for admission to American universities, the user’s results are sent directly to the relevant institution thus decreasing the chances of tampering with the results. The user is, however, allowed to bring the results for personal uses and future reference. A paper based test can be lost in the mail during the process of transmission from the candidate to the examiner or the results lists as they are transmitted back to the learner. The CBT is, thus more secure and more confidential. Many PBTs are scored by selected examiners. Human factors can easily affect the accuracy of the scoring method especially when one individual deals with too many manuscripts in a short period. Fatigue has been previously blamed for inaccurate scoring that affects the integrity of a given test.

Finally, the CBT system has been attributed to a higher amount and quality of compositions. Online tests are more diverse than paper-based ones. In many cases, some tests that were offered previously have been recycled and offered to a different batch of learners. Such recycled tasks decrease the integrity of the-the test since some learners could have previously accessed the test tasks.

Essentially, computers are more accurate in determining repetitive tasks than humans. PBTs are set by humans who rely on individual discretion to determine the appropriate tasks to include in a test. Human memory is limited to determining repetitive tasks while the computer is more accurate. Further, research shows that CBTs offer more content than PBTs. The computer can vary the complexity of tasks based on an assessment of the individual’s performance in a previous task. In such situations, the computer also decides if an individual should proceed to the next section, repeat the previous task or to discontinue the test. In PBTs determining the suitability of an individual to proceed with a successive task is both laborious and takes a long time. The previous section has to be scored manually first. Consequently, many PBTs provide the individual with the whole range of tasks and then the qualification is done after scoring. This system wastes resources and time for both the candidate and the examiner.

Furthermore, the quality of the tests given using computers varies from the quality of the tests using papers. The paper-based tests are not easy to adjust as compared to the computer based ones. Further, a wide range of tasks can be offered on the computer for a relatively short time. This is because the tasks are uploaded and accessible immediately while PBTs have to be transported to a physical venue. The CBTs also allow the test to be administered in a wide range of location thus accommodating more individuals and increasing the ability to customize the tasks to individual needs.

Conversely, CBTs can also be considered relatively cheaper to set and administer. When using a computer, once the test is uploaded, it can be accessed by many people. The PBTs, however, consume a lot of time to prepare, print, transport to the centers and dispatch for scoring. The results also need to be sent either via mail or any other appropriate courier. Essentially, papers are bulky and require more space to store for future reference. They can also be easily lost due to human error or misfortunes . Papers are easily damaged by mishandling, fire, water, insects, and rodents. In many situations, the examiners prefer to store the test papers for a period just in case there arises a complaint regarding the particular test. In such cases, the test paper is simply retrieved, and scoring can be repeated to address the complaint. Storing a lot of papers requires both space and human resources thus incurring extra cost .

Furthermore, retrieving papers from a storage facility is both cumbersome and could lead to damage. One appropriate way of dealing with the storage problem is to return the manuscripts to the individual learners after scoring. However, this action also creates a logistical problem especially in situations where scoring is done after the students break for holidays or they complete their courses. Finally, it is hard to provide backup copies for PBTs. The only reasonable backup method would be to make copies which are expensive and increases the amount of paper to handle. Finally, paper processing is considered unfriendly to the environment because most paper if processed from trees. As the world rising focuses on activities that reduce global warming, there is the need to plant more trees and cut down relatively fewer ones. Trees help in absorbing the excess carbon dioxide in the air and thus either reserve or contain global warming. Primarily, the most paper used in test activities is not recycled or reused thus more trees have e to be cut to supply more paper. Paper processing thus becomes a substantial threat to environmental conservation . Additionally, the transport needed for PBTs require the use of commercial transportation that uses fossil fuels and emits poisonous gases to the environment.

On the contrary, CBTs are scored and stored in the computer memory thus reducing the need for bulky storage space. Further, the information stored in a computer can be retrieved more efficiently than the papers stored in shelves and filing cabinets. The information is also easier to sort out. Computers have multiple functions that can be used to arrange the information contained in them for easier processing, access and retrieval. The computers are also relatively safer because they allow for the creation of backup files in case the original one is lost or damaged. The development and increased access to the Internet allow users to store their information offsite just in case the computer system is damaged. Backups can be creators on external hard discs or stored offsite and online in the cloud. Similarly, there is no limit to the number of backup copies that can be made for an individual file. CBTs can thus be considered relatively safer than PBTs .

Disadvantages of PBTs

In the previous section, the relative advantages of CBTs were discussed and compared to the PBT systems. However, even the CBT system has several disadvantages that can make it inappropriate for use in some situations. The primary concern for the use of CBT is the ability to use computers. For its efficient use, CBT requires that the concerned individual possesses computer proficiency skills. The level of computer proficiency also varies with the particular task to be undertaken in the test. It can change from the possession of typing skills to the need to understand more complex commands and programs. Consequently, some users become uncomfortable using the computer, especially during complex test tasks. For instance, Hensley (2015) found that many individuals are more comfortable doing paper-based mathematics tests compared to comprehension. In the study, the authors realized that many people complained that inputting mathematical functions on the computer were more complex than when doing the same on the paper. However, in comprehension and other written tasks, there was no real difference in the medium preference by different individuals. Consequently, the authors concluded that there was a need to differentiate the particular functions when assessing the individual choice for examination medium.

One major disadvantage of CBT is the difficulty to ensure the integrity of the test and the individuals undertaking it. In many CBTs, the individuals are located in diverse locations, and it is hard to ascertain that the correct person is undertaking the tasks. Essentially, this problem has been a major challenge for many institutions that offer online and distance learning programs. Some institutions only allow the use of online resources for the dissemination of curriculum content, assignments, and continuous assessments . Such institutions then require the learner to physically present themselves at a designated examination center for the final exams. This system can inconvenience many people especially individuals who prefer distance learning because they are located far from the institution. The CBTs can also create problems when individuals are not well prepared to undertake the exercise. There are many situations where some learners submit the tests before they have completed all tasks. Such learners have also been known to make a double submission when they retake the test after mistakenly presenting the previous version. Double submissions create big problems during scoring. The test also lacks adequate control because many activities are carried out at the same time from different locations thus making it relatively more difficult to follow what each is doing .

Secondly, computer hardware and software are prone to technical and mechanical failures. For instance, computer systems can be damaged by a power surge, fire, or moisture. In such situations, the individuals taking the test are greatly inconvenienced especially if the problem occurs and affects only a proportion of the population undertaking the test. Similarly, software crashes have been recorded during CBTs and these cause the individual to be unable to complete the tes t. In some cases, some people may be forced to restart their computers several times during the trial thus leading to time wastage. Mostly, CBTs require relatively longer than PBTs.

Similarly, computers can have unforeseen problems like some functional keys that can is only noticed during the test. Also, apart from the technical issues, the computers might have different configurations that create disadvantages for some individuals. For instance, the computer layout, lighting, and processing speed can greatly affect the rate at which an individual handles a particular taste . In situations where the tests are timed, a slow computer can lead to failure despite adequate preparation and ability to handle the specific tasks thus creating a disadvantage for time individuals. Online based tests are also affected by the proxy and browser settings. In some cases, the computer security settings could prevent the device from accessing the internet or from downloading some content.

Another disadvantage is that the computer screen affects the individuals visually after an extended period of use. Essentially, it is more tiring to work on a computer when to compare to working on paper. Further, the computer’s high memory allows for the dissemination of a higher number of tasks per unit time than when dealing with paper. Consequently, people undertaking computer tests experience a higher rate of fatigue than those working using paper and pen.

Further, when operating a computer screen, it becomes relatively harder to shift between pages when compared to someone working on paper. In some cases, the context may be lost in the process of moving from one screen to the next. This greatly affects the editing power of the individual working on a computer . However, there are people who prefer to do their editing on the computer than on a paper due to the ease of deleting unwanted parts and inserting additional information. Doing the same on paper can make the presentation appear untidy. However, there are also individuals who find it easier to go through the work on paper than on computer screen. Such individuals have been known to first print their work, edit with a pencil and then input the corrections into the computer. Further, the work in an open page on the computer can easily be lost or misplaced if it has not been saved. These situations occur when the individual becomes so engorged on the task at hand that they forget to save their work. In some cases, computers without adequate power backup can go off when there is a power interruption and lead to the loss of all or part of the unsaved work .

Finally, there is great concern that the use of computers can lead to the loss of confidentiality especially when a single machine is shared by many individuals. In some research studies, the respondents to online surveys can take advantage of the absence of physical meeting and give inaccurate information. The problem raises several ethical issues especially when one deliberately provides false information and it is used to make decisions that affect people or businesses. The increased access to the internet and the proliferation of social media causes many people to want to present a particular social profile to improve their social image and desirability. The deliberate provision of false information, especially in the online surveys, can cause significant damage in clinical studies where an effective intervention could be rejected due to false information. In some cases, people and institutional reputations have beaten ruined after the confidential information is shared online. The greatest risk for breach of confidentiality is due to unauthorized access to private information by hackers who then use the same to extort money or release it to public out of malice .

The disadvantages can, however, be addressed if proper measures are put in place to ensure the success of CBTs. Unlike PBTs, CBTs have increasingly grown in popularity due to globalization, the desire for standardization of examinations, and the proliferation of distance learning. The risk of lost confidentiality can be addressed by issuing unique personal codes for each user. On personal computers, the users must install security passwords like passwords to prevent unauthorized access . Further, antivirus softwares can prevent the installation of malicious softwares in the computer and online platforms. further, people should avoid sharing private information on public platforms to prevent its use against them.

However, the difference between the two mediums can be attributed to personal preference and not necesssarily on any substantial difference in tehir effectivenesss. There are people who prefer to use CBT due to its convenience when it comes to submission and scoring. Other people prefer to use PBTs due to ease in processing the information and editting. However, unlike the PBTs, CBT use has grown in popularity over time. The increased use of CBTs can be attributed to several factors. First, many advanced instituions require the submission of all test tasks in a single database for easier processing and scoring. These innstituions also desire to portray professionalism in their activities by requiring that all tasks should be accompanied by an originality report to ensure academic integrity. In a PBT, it would be difficult to ascertain the originality of the written work since most plagiarism detection programs compare the content with the information contained online.

Conclusion

In the paper, the use of CBTs was disucussed and compared with the use of PBTs. Several advantages were identified that make it more appropriate to use CBTs than PBT. In the first advantage, it was identified that computers enable a high number of individuals in different location to undertake the same task. Further, CBT enables the examiners to design an online scoring method that enables the test to be scored in real time unlike in the paper based method where the transcripts have to be taken to a scoring center before results can be given. Essentially, the paper based testing method has several disadvantages that make it less desirable for use in many situations. The storage and atrnsport is both bulky and expensive. Further, the tests can only be done in specific physical locations. In a CBT, the most important factor is the access to a computer and internet. A CBT can be done from any location especially if it is offered online. however, CBTs also have disadvantages when the user is not computer proficients. Computers also can be affected by many technical and mechanical problems thus affecting the outcome of the exam. Furthermore, there is a recurrennt problem of double submissions of test by some individuals. However, in consideration of all the factors, the CBT seems to be a better medium for adminstering exams. Essentially, more instituions should be encouraged to adopt CBTs and not rely on PBTs as it reduces the likelihood of cheating in nexams and increases the confidence and delivery of exam results.