Servicios Personalizados
Revista
Articulo
Indicadores
Compartir
Journal of Human Growth and Development
versión impresa ISSN 0104-1282
Rev. bras. crescimento desenvolv. hum. vol.24 no.3 São Paulo 2014
ORIGINAL RESEARCH
Validity of Software for measurement of total reaction time with simple stimulus -TRT_S2012
Tânia Brusque CrocettaI, II; Ricardo Luís VianaII, III; Douglas Eric SilvaII, III; Carlos Bandeira de Mello MonteiroI, IV; Claudia ArabI, II; Alexandro AndradeII, V
ILaboratório de Delineamento de Estudos e Escrita Científica, Departamento de Saúde da Coletividade, Faculdade de Medicina do ABC
IILaboratório de Psicologia do Esporte e do Exercício, Centro de Ciências da Saúde e do Esporte, Universidade do Estado de Santa Catarina
IIIEspecialistas em programação Java
IVEscola de Artes, Ciências e Humanidades da Universidade de São Paulo
VPrograma de Pós-graduação Strictu Sensu em Ciências do Movimento Humano
ABSTRACT
OBJECTIVE: Determine the validity of the TRT_S2012 software in to assess the total reaction time (TRT) with a simple visual stimulus (TRTSimple) and mental fatigue from TRT (TRTFatigue).
METHODS: Three types of validation were applied: a) concurrent, for determining the correlation between the TRT_S2012 Software and Vienna Test System (VTS), b) content of a sample of adults, and c)mechanical, using a robot that performs a mechanic motion to respond to a light stimulus.The study included 216 young adults, college students aged 17 - 45 years (x = 24.0 ± 6.0) and a robot. Descriptive and inferential statistics were used for performance on TRT obtained by young adults and robot in two software.
RESULTS: The intra-class correlation in the adults TRT showed strong correlation between VTS and TRTSimple (R = .72). Identification of the proposed initial stimulus in TRTFatigue presented intermediate correlation with VTS (R = .56) and the final stimulus presented low correlation with VTS (R=.35).The robot TRT showed standard deviation ranging .5 ms (on average) between the highest and lowest.The standard error of the mean ranged from .23 to .28 and the distributions were homogeneous between 8.2 to 9.7%.
CONCLUSION: The results confirmed the validity of the software TRT_S2012. It is a reliable cognitive test that can be applied to young adults for measuring the TRT with simple visual stimuli and for evaluating the influence of mental fatigue from the TRT. however, the delays caused by the computer resources used should be considered and measured with a resource like the robot. We conclude that the TRT_S2012 software is valid for assessing the TRT and cognitive fatigue in healthy adults.
Key words: reaction time, mental fatigue, software.
INTRODUCTION
The diagnosis, treatment, and prevention of disease, illness, injury, and other physical and mental impairments in humans are conventionally regarded as health care and the term provider extends far beyond1 and the use of simple measures for health care and rehabilitation has a great value and interest to researchers.
The simple reaction time is a measure of how quickly a person performs a uniform response to a specific stimulus, and has clinical relevance in relation to function and health2.
The registration of reaction time (RT) provides a more refined research on neuropsychological functioning than simple measurement of the number of correct and wrong answers, as it is a highly sensitive variable3.
The RT is probably the most widely used behavioral measure in units of time (usually in milliseconds), and has played an important role in research in psychology and related fields4. The main areas of application for studies of RT are clinical and health psychology, personnel psychology, sports psychology, and educational psychology5.
Considering the importance of using tests with RT tasks, Crocetta et al.6 presented the software TRT_S2012 and proposed its use in any computer configuration, using the key board to record the response to the stimulus. Cronbach's alpha for the total reaction time test was α = 0.84 and evaluating the mental fatigue from the TRT presented internal consistency of α = 0.62 to identify the initial stimulus and α = 0.87 to identify the end of the stimulus.
Working on tasks that require great cognitive effort for a considerable time often leads to mental fatigue that can affect performance on task execution. It is important to prevent or treat the errors related to mental fatigue and understand their nature and specific effects on behavior7. The validation of this test in the TRT_S2012 software can benefit several areas of research.
Building a robot similar to that proposed by Neath et al.8, Crocetta et al.9 validated the measurements obtained by the robot called Emboici Robot: 46.95 ms (±6.04) at 1200 measures of TRT. The purpose of this robot was to react by pressing a button when a light stimulus was identified by a photodiode. The Emboici Robot can be used to assess the accuracy of measurement time in a test of TRT.
In this study it was assumed that the TRT involves identification of the stimulus, interpretation, and preparation of the response and effective motor action10, 11. The validation process has not been exhausted; on the contrary, it assumes continuity and should be repeated several times for the same instrument12, and as with any new tool, it is important to directly compare the neuropsy-chological test results with existing tools that are already used to help understand the properties of the new tests and their comparability with conventional tests13.
Thus, the objective of this study was to validate the software TRT_S2012 to measure total reaction time to visual stimuli and to assess the influence of mental fatigue from the TRT.
METHODS
The research approved by the Ethics and Human Research Committee (Protocol n° 63411/2012 and 102178).
Participants
Participants in the study comprised 216 young adult volunteers. They were university undergra-duate and postgraduate students aged between 17 and 45 (x = 24.0 ± 6.0) including 99 men (45.8%) with a mean age of 25.5 (± 7.0) and 117 women (54.2%) with a mean ageof 22.7 (± 4.7). These volunteers were recruited by e-mail sent to students at a university campus in Florianopolis, SC, Brazil. All signed an Informed Consent.
A robot called Emboici Robot (Figure 1) also took part in the study with performance in TRT_S2012 software and the Vienna Test System (VTS).
Instruments
Each participant completed the following tests: 1) Total Reaction Time (TRT) with simple visual stimulus (TRTSimple), 2) evaluation of the influence of mental fatigue from TRT (TRTFatigue) - these two tests are offered by TRT_S2012 - and 3) the Simple Reaction Time test with a yellow stimulus on the VTS.
TRT_S2012 Software. The software was developed and validated by Crocetta et al.6 in a sample of 76 healthy adults. The Software (Figure 1a) proposes the tests: TRTSimple and TRTFatigue.
The TRTSimple test consisted the appearance of a yellow square (configurable) in the center of the monitor predefined time intervals (ranging from 1.5 to 6.5 ms - these intervals were identical in both software) and when the stimulus, the participant should respond as quickly as possible by pressing the space bar on the computer keyboard.
The TRTFatigue test consisted in monitoring the bar in yellow color displacement, in a computer screen, from left to right, where the participant should respond as quickly as possible by pressing the space bar on the keyboard when the appearance of color (configurable) and keep the space bar pressing watching the displacement of the bar yellow stimulus until it disappeared, then when the space bar should be released. Two TRTs were identified: TRTiFatigue to press the space bar and TRTfFatigue upon release.
The software was parameterized with five executions for familiarization, 28 executions for TRTSimple (same number of executions proposed by VTS) and 14 executions for TRTFatigue.
Vienna Test System (VTS). The VTS is composed of a battery of psychometric tests (Figure 1b) where the TRT simple visual stimulus test (S9 Simple Reaction Yellow) presents reliability with Cronbach's alpha = 0.96114 and records the time of the reaction in milliseconds (ms). The participant should respond "as quickly and accurately as possible" to the visual stimulus (the appearance of a yellow circle in the center of the monitor) by pressing a black button on the response panel that accompanies the VTS5. The VTS consists of five familiarization executions and 28 to compose the battery implementation of TRT (these numbers cannot be changed).
Equipments
Emboici Robot. Constructed and validated by Crocetta et al.9, this robot is composed of a photodiode that detects the change of brightness on the monitor (color stimulus generated by the software), triggering a digital servo motor that pushes a button (the space bar of the computer keyboard or the response panel button). This set is managed by an Arduino board (Figure 1-D). Crocetta et al.9 reported that the TRT obtained by Emboici Robot (time elapsed between the identification of the stimulus and the pressing of a button) was 46.95 ms (± 6.04) after analysis of 1,200 measures. This runtime of Emboici Robot was the benchmark for comparison with the time recorded on the software TRT_S2012 and VTS.
The TRT_S2012 software was parameterized to generate 99 executions for the TRTSimple test, which consisted of completing a square in the center of the monitor with red color on Day 1 and with a yellow color on Day 2 and Day 3. These executions were repeated 13 times on Day 1, 11 times on Day 2, and 12 times on Day 3, generating 1287, 1089, and 1188 measurements for each day, respectively. The VTS did not allow the number of executions in each test (28) to be changed, so the test was repeated 27 times, resulting in 756 measures. The measurements were recorded by the software TRT_S2012 and VTS and exported to IBM® SPSS® 20.0. statistical software for analysis as described below.
Computer. All tests were performed on a Dell notebook computer with an Intel® Core 2 Duo T5800 2.00 GHz (external clock of 200 MHz) with 2 Gb of RAM and Enterprise Windows 7 Professional 32-bit, Service Pack 1 operating system. The equipment was formatted and Windows was installed from CD in the basic way without any additional configuration or upgrade, to reduce the influence of other software running on the operating system.
The Java virtual machine (JVM) required for the implementation of TRT_S2012 software was version 7, update 21 (build 1.7.0_21-b11).
The stimuli were generated on a 19-inch LCD monitor with a resolution of 1440×900 pixels and a refresh rate of 60 Hz (Mobile Intel Graphics Adapter 965 Express Chipset Family 384 Mb). An Intel graphic chipset GL960/GM965 Graphics Controller 0 (GPU speed of 500MHz) was used. The pixel fill rate of 4000 Mpixels/s describes how many pixels the card can process in a second, which determines how fast the image can be composed15. The monitor was connected to the VGA output of the laptop and the projection was activated only on this display.
The response to the stimulus was generated by a Logitech USB Keyboard K120 (delay:1; repetition frequency: 31) when the test was applied using the TRT_S2012 software and by the response panel when applied using VTS.
Procedures
Procedures for collecting the TRT with young adults. All tests were performed in a room reserved for the presence of only the participant and a researcher and applied in a single session. The sequence of execution tests was varied among the participants, and the sequence for each participant was annotated with the abbreviations T for TRTSimple, F for TRTFatigue, and V for VTS; therefore, the sequences were TFV, FTV, VTF, or VFT.
Procedures for collection of the TRT with Emboici Robot. All tests were performed in a reserved area and all executions of Emboici Robot were videotaped. On Day 1, the TRT was collected using first TRT_S2012 and then VTS. On Day 2 and Day 3, the TRT was collected using only TRT_S2012. The photodiode was attached to the computer monitor with tape at the position where the change of the stimulus occurred (yellow circle for VTS and red/yellow square for TRT_S2012) (Figure 1a - C and Figure 1b - C).
The Emboici Robot was positioned in the middle of the keyboard space bar for collection in TRT_S2012 and in the middle of the black key response panel in VTS to the facilitate press (Figure 1a-F and Figure 1b-G). After color calibration and positioning of the press, the Emboici Robot made a movement back of three degrees and waited for the change of the stimulus. When the parameterized color was show on the monitor, the arm made a movement of three degrees, causing the button to be pressed. The time between the sending of the stimulus and the pressing of the space bar or button was stored by the respective software and composed the TRT measures. Measurements were performed with TRT_S2012 on three different days, providing 1287, 1089, and 1188 measurements, making a total of 3,564, while 756 executions were performed with the VTS in just one day.
Data processing
TRT of young adults. Scores of the same participant in the VTS and TRT_S2012 software were compared for concurrent validity.
Measures of TRT (milliseconds) and accuracy (percentage of responses which were correct) were generated for each test.
Performance values for TRT above 1,000 ms were considered extreme and those below 100 ms were considered anticipations. Both were excluded from the analyses and accounted for 0.2% of the total of 18,144 measures of TRT; where as a method of filtering and elimination of outliers is considered very conservative if it rejects less than 5% of cases4,16. The TRT measures were examined to identify normality. The TRT performances for all the tests were normally distributed and the coefficient of intra-class correlation (ICC) was calculated using the IBM® program SPSS® version 20.0.
The TRT measures and precision were calculated for each individual test. These values were then transformed into a common metric by calculating a individual in all the tests using the equation:
The precision measurements of all tests are presented as percentages and are not normally distributed. To make these data regular, arcsine-square transformation was performed.
The ICC was calculated between the TRTSimple and VTS and between each measure of TRTFatigue and the VTS. ICC values near to 1 were interpreted as indicating greater agreement between the measurements of TRT_S2012 and VTS.
Descriptive statistics (means, standard deviations, and minimum and maximum values) and 95% confidence intervals were calculated for the measurements of TRT and precision. Cronbach's alpha was also calculated for the TRT.
TRT Treatment of robot Emboici Robot. The mechanical and functional validity was assessed through descriptive analysis of TRT obtained by the robot in both software. 756 measures TRT were used with VTS and 3,564 with TRT_S2012 totaling 4,320 TRT measures. Three measures of TRT were invalidated in the VTS (were not recorded by the software), representing 0.4% of 756 measurements.
RESULTS
Descriptive statistics on the performance of young adults TRT tests proposed by software TRT_S2012 and Vienna Test System (VTS) are described in Table 1.
The mean TRT were faster in tests with simple visual stimuli (TRTSimple and TRTVienna) and slower in the evaluation of the influence of mental fatigue from TRT (TRTiFatigue and TRTfFatigue). Young adults showed perform better in the test proposed by the VTS. The Cronbach alpha for TRT above 0.74 indicate the reliability of the measurements obtained.
Performance on TRTSimple showed high positive correlation with TRTVienna (R = 0.72). The performance TRTiFatigue showed intermediate correlation (R = 0.56) and performance in TRTfFatigue low correlation with TRTVienna (R = 0.35). Performance accuracy of the Software TRT_S2012 not correlated with the VTS (Table 2).
The performance with Emboici Robot in the TRT simple visual test in TRT_S2012 software and VTS with the descriptive statistics are shown in Table 3.
There was big difference in performance with the Emboici Robot in TRT_S2012 and VTS software compared with their performance (running average of 46.95 ms at 1,200 (SD = 6.04) measures TRT) reported by Crocetta et al9. Furthermore, the TRT recorded at TRT_S2012 Software was higher than the VTS only when the stimulus color was yellow. The standard deviations in all measures were very similar ranging 0.5 between higher and lower. The standard error of average ranged from 0.23 to 0.28 indicating good precision for all measurements. The distributions were homogeneous between 8.2 to 9.7%.
To check whether there were differences between TRT measured by two software the Mann-Whitney test was applied where differences were observed statistically significant between VTS and TRT_S2012 software with p = 0.000 for the stimulus red (Z = -7.54) or yellow (Z = -23.42 and Z = -24.33 for day 2 and Day 3, respectively). The same occurred when applying the Kolmogorov-Smirnov test for TRT_S2012Software and VTS (Table 4). These same tests were applied to verify whether these differences are also observed in measures of TRT considering only TRT_S2012 software on three different days where it was observed that the TRT distribution is the same when the test is only applied with the same color yellow stimulus (day 2 and Day 3).
Where as the mean, median and mode were approximately equal and showed that the asymmetry value between -1 and 1, it can be assumed that the distribution was very close to normal17 and considering also the robustness of the statistical tests that ignore the possible non-normality of the TRT, were parametric tests shown in Table 5.
Comparing the results of the evaluations presented in Table 5, it rejects it null hypothesis of equality between the measurements of both software, the performance Emboici robot in Software TRT_S2012 showed significantly different times when compared to the VTS, being lower when the color was red stimulus and greater when the stimulus color was yellow (same color between the software). The TRT average in the evaluation with the red stimulus TRT_S2012 was 83.7 ms and in the VTS average was 86.5 ms.
Also, rejects the null hypothesis of equality of measures of Emboici Robot performance in TRT_S2012 Software when the color stimulus was different (yellow and red), but accept the null hypothesis of equality when the colors were equal (yellow). The TRT average in red color was 83.7 ms and in yellow color were 97.0 ms and 97.3 ms for day 2 and Day 3, respectively.
DISCUSSION
This study aimed to validate the Software TRT_S2012 to measure the simple reaction time with visual stimuli, searching the concurrent validity between TRT_S2012 and Vienna Test System (VTS) software, content validity by TRT young adults, and the mechanical and functional validity by Emboici Robot performance compared to the VTS and TRT_S2012 software.
Little is known about the reliability of computerized tests to evaluate mental fatigue from the TRT because it was not found any software with a similar proposal.The results of this study seem to indicate that the test proposed by Software TRT_S2012 is reliable when administered to young adults.
This makes the software indicated for TRT_S2012 tests of mental fatigue, especially in activities where there is a risk of damage caused by fatigue. The results also suggest that in young adults, the performance measures in total reaction time (TRT) are more reliable than measures of accuracy response. This may have occurred because the accuracy of the participants' performance was near perfect in both tests as proposed by the Software TRT_S2012 and Vienna Test System.
Several authors have developed software with tests of single or choice reaction time (RT) presenting their validation18,19. The importance of testing with RT stimulate some authors to propose in struments more affordable for clinical application, validating with other software20 or a RT Electronic Tester21.
In young adults the performances in TRT with simple visual stimuli were highly correlated, where as with the evaluation test of mental fatigue correlation was intermediate to the initial stimulus and very little with the final stimulus. One explanation for this is that the test of simple visual stimulus with TRT in both software evaluates the same cognitive processes, while similarity in the implementation of the evaluation of mental fatigue test from TRT occurs exactly with the identification of the initial stimulus when to press the button space. As for the identification of the final stimulus, the key must be released. These results may also suggest that the measures obtained in the evaluation test mental fatigue are more sensitive to the effects of mental fatigue than tests conventional. Other comparative studies on the clinical utility of the test fatigue evaluation may help clarify these differences.
Another analysis which may be performed on the difference in reaction time TRTSimple between the test and the differences relate TRTFatigue scale stimulus presentation between the two measure- ment methods. The appearance of color change to TRTFatigue is performed on a gradual scale. This results in a small visual angle. Especially in identifying the stimulus end. This test makes the correct identification of stimuli is much more difficult than the TRTSimple test.
Al though estimates of reliability of the intra-class correlation coefficient ICC > 0.90 was ideal, this seems to be an unrealistic point of reference for a test evaluation of something as complex as the processing speed of the brain for prolonged periods of time20 as proposed in the assessment of mental fatigue test from TRT.
Reliability was considered appropriate because the lowest Cronbach's alpha was above 0.74. Maroco and Garcia-Marques22 claim that the more high are the covariances (or correlations between items, represented by alpha Cronbach), the greater the homogeneity of the items and with greater consistency than measure the same dimension or the teoretical construct. So, as these coefficients approached 1 (0.93, 0.83 and 0.74 respectively for TRTSimple, TRTiFatigue and TRTfFatigue), meaning that more consistent and therefore more reliable the instrument. The Cronbach's alpha for the VTS coefficient of 0.94 confirms by Schuhfried and Prieler14.
The average data in Table 1 indicate that young adults respond quickly and generate few errors in tests of psychomotor function. However, they respond more slowly and generate more errors in the evaluation mental fatigue test. This effect is further exacerbated when in a learning test more complex13. Thus, the onset of mental fatigue can be studied by analyzing the progressive change in the processing efficiency information as a result of sustained mental activities23.
In the study of Schellekens et al.24, to investigate the hypothesis that longmental demands of work are reflected negatively on the implemen-tation of attention tasks, only the number of errors was significantly higher at the end of the task more difficult. In the present study, the lowest accuracy was appointed to the identification of the final evaluation of mental fatigue test.
The same effect was observed for Lorist et al.25, to examine the mental fatigue effects in specific cognitive processes involved in the control planning and preparation of future activities, where with increasing mental fatigue, processes for the preparation seemed less adequate, and the number of errors increased.
1 '
In Table 5 we observe significant differences in the same TRT "day 1" with changes only the color of the stimulus from yellow to red.Were homogeneous TRTs around the mean, in both the TRT in yellow as red color. The significant difference is precisely the fact that small differences in measurement are important when data vary only by changing the mounting the color on the monitor, but this could only be identified because the TRT were resulting behavior of the robot.
Ohyanagi and Sengoku26 presented a solution to measure the accuracy in reaction time, the SMART, and can be used on any computer that has a USB port. The authors conclude that SMART is a simple and practical solution to TRT measure, especially in clinical applications due to its stability, accuracy, size, cost and ease of use.
A very similar solution like Emboici Robot was proposed by Neath et al.8, where a photodetector identifies the screen changes in luminance, and when this occurs,a relay is activated which, in turn, activated a solenoid, which positioned on thekeyboard, pressed a key. The authors conclude that the TRT collected can detect as little as 5-10ms difference, and this determines what types of research should or should not use certain systems.
More important to consider is the difference of more than 13 ms (on average) found when using the same software TRT_S2012 just changing the color of stimulus (red to yellow). Despite the advantages of continuous lighting and low electromagnetic emission of a LCD (liquid crystal display), these monitors have problems with time and accurate presentation of color, milliseconds apart (sometimes even 10ms)27. Where as the refresh rate determines the speed at which an image is displayed on an LCD monitor, and usually starts at 60Hz in modern monitors, that means it can take up to 16.6 ms for certain color appears in an LCD monitor coupledwith the fact that the update time of a pixel for an new pixel is usually 5ms28. This makes us look with concern for the difference shown in the colorchange of the stimulus, suggesting that new tests can be conducted to determine differences in paramete-rization of other colors, as well as other types of monitors, keyboards and operational systems.
There is a difference between the reaction times measured with the computer, as verified with the use of the robot in two different software and this difference should be considered when designing paradigms study of leveraging technology current computers.
Reinforces the need to carefully evaluate the computational resources used (operating system, software programming, computer, keyboard and monitor),particularly when necessary to compare with diverse populations or with different stimuli such as the color, for example, taking care to evaluate the impact of each featureand using a reliable measuring equipment as robot Emboici Robot can help to identify possible differences in resources employed.
The Emboici Robot may vary, allowing the use of different components for use in different research and to meet different needs. It is possible replace the photosensor,the Arduino board, the digital servo motor and the rod itself pressing. A digital servo motor with higher power can give more speed to the arm movement and more strength at the timeof press, but these changes require new validation measures.
As for the tests proposed by Software TRT_S2012 can affirm that the sustained mental effort can negatively affect the well-being and health by activating physiological systems linked to stress reactions. Therefore, the clear identification of mental fatigue from the TRT can be a useful tool for several studies. Therefore,the TRT_S2012Software is ideal for use in investigations on mental fatigue, in addition to simple TRT tests commonly used to monitor the recovery or to determine the severity of cognitive impairment or mental fatigue.
Our results confirm the feasibility of using time measurement reaction with useof computer and keyboard for neurocognitive assessment. Measurements are reliableand valid and current computer technology does not increase significantly the measurement error.
It is worth noting that the comparison of the performances obtained in different configurations of software and hardware must be accompanied by verification of delays caused by this set, and that this is only possible by use of a device developed specifi- cally for this purpose with the robot Emboici Robot.
CONCLUSION
Taken together, the results of this study indicate that TRT_S2012 software is reliable and valid test when given to young adults. Moreover, the performances obtained in the TRT_S2012 software correlates highly with the proposed Vienna Test System (VTS) test, which confirms that can use the computer keyboard with the same reliability of an accessory as the outer response panel of the VTS.
Acknowledgments
UNIEDU Post graduate Program, Santa Catarina.
REFERENCES
1. Atrash K, Carpentier R. The evolving role of public health in the delivery of health care. Revista brasileira de crescimento e desenvolvimento humano. 2012;22:396-399. [ Links ]
2. Eckner JT, Richardson JK, Kim H, Lipps DB, Ashton-Miller JA. A Novel Clinical Test of Recognition Reaction Time in Healthy Adults. Psychological Assessment. Mar 2012; 24(1): 249-254. [ Links ]
3. Charchat H, Nitrini R, Caramelli P, Sameshima K. Investigação de Marcadores Clínicos dos Estágios Iniciais da Doença de Alzheimer com Testes Neuropsicológicos Computadorizados. Psicologia: Reflexão e Crítica. 2001;14: 305-316. [ Links ]
4. Baayen RH. Analyzing Reaction Times. International Journal of Psychological Research. 2010;3(2):12-28. [ Links ]
5. Vogt T, Schneider S, Abeln V, Anneken V, Struder HK. Exercise, mood and cognitive performance in intellectual disability-A neurophysiological approach. Behavioural Brain Research. Jan 2012;226(2):473-480. [ Links ]
6. Crocetta TB, Viana RL, Silva DE, Andrade A. Validação preliminar do Software TRT_S2012 para medição do Tempo de Reação Total: Estudo piloto [Preliminar validation of TRT_S2012 Software for measuring Total Reaction Time: A Pilot Study]; 2013 (Submitted):11. [ Links ]
7. Van der Linden D, Frese M, Meijman TF. Mental fatigue and the control of cognitive processes: effects on perseveration and planning. Acta Psychologica. 2003;113(1):45-65. [ Links ]
8. Neath I, Earle A, Hallett D, Surprenant AM. Response time accuracy in Apple Macintosh computers. Behavior Research Methods. Jun 2011;43(2):353-362. [ Links ]
9. Crocetta TB, Kroich T, Thiesen AC, Borges L, Borges Junior NG, Abreu LCd, et al. A Robot for Verifying the Precision of Total Reaction Time Measurement; Motriz. 2014 (ahead of print):16. [ Links ]
10. Zwierko T, Osinski W, Lubinski W, Czepita D, Florkiewicz B. Speed of Visual Sensorimotor Processes and Conductivity of Visual Pathway in Volleyball Players. Journal of Human Kinetics. Mar 2010;23:21-27. [ Links ]
11. Ishihara M, Imanaka K, Mori S. Lateralized effects of target location on reaction times when preparing for manual aiming at a visual target. Human Movement Science. 2002;21(5-6): 563-582. [ Links ]
12. Raymundo VP. Construção e validação de instrumentos: um desafio para a psicolinguística. Letras de Hoje. 2009;44(3):86-93. [ Links ]
13. Collie A, Maruff P, Makdissi M, McCrory P, McStephen M, Darby D. CogSport: Reliability cognitive tests used in and correlation with conventional postconcussion medical evaluations. Clinical Journal of Sport Medicine. Jan 2003;13(1):28-32. [ Links ]
14. Schuhfried G, Prieler J. Manual Vienna Test System - Teste de Reacções Simples e de Escolha [Vienna Test System Manual - Reaction Time]. In: 29.00 V, ed. Mödling: Dr. G. Schuhfried Ges.m.b.H.; 2005:44. [ Links ]
15. Amoroso D. Como funcionam e como escolher uma placa de vídeo para você. http://www.tecmundo.com.br/artigos-imprimir.asp?c=1632. Accessed 27 jun.2013, 2013. [ Links ]
16. Lachaud CM, Renaud O. A tutorial for analyzing human reaction times: How to filter data, manage missing values, and choose a statistical model. Applied Psycholinguistics. Apr 2011;32(2):389-416. [ Links ]
17. Leech NL, Barrett KC, Morgan GA. SPSS for Intermediate Statistics: Use and Interpretation. 2. ed. ed. Mahwah, New Jersey, London: Lawrence Erlbaum Associates, Publishers; 2005. [ Links ]
18. Deary IJ, Liewald D, Nissan J. A free, easy-to-use, computer-based simple and four-choice reaction time programme: The Deary-Liewald reaction time task. Behavior Research Methods. Mar 2011;43(1):258-268. [ Links ]
19. Spruyt A, Clarysse J, Vansteenwegen D, Baeyens F, Hermans D. Affect 4.0 A Free Software Package for Implementing Psychological and Psychophysiological Experiments. Experimental Psychology. 2010;57(1):36-45. [ Links ]
20. Eckner JT, Kutcher JS, Richardson JK. Between-Seasons Test-Retest Reliability of Clinically Measured Reaction Time in National Collegiate Athletic Association Division I Athletes. Journal of Athletic Training. Jul-Aug 2011;46(4): 409-414. [ Links ]
21. Mercer VS, Hankins CC, Spinks AJ, Tedder DD. Reliability and Validity of a Clinical Test of Reaction Time in Older Adults. Journal of Geriatric Physical Therapy. 2009;32(3): 103-110. [ Links ]
22. Maroco J, Garcia-Marques T. Qual a fiabilidade do alfa de Cronbach? Questões antigas e soluções modernas? Laboratório de Psicologia. 2006;4(1):65-90. [ Links ]
23. Meijman TF. Mental fatigue and the efficiency of information processing in relation to work times. International Journal of Industrial Ergonomics. Jul 1997;20(1):31-38. [ Links ]
24. Schellekens JMH, Sijtsma GJ, Vegter E, Meijman TF. Immediate and delayed after-effects of long lasting mentally demanding work. Biological Psychology. May 2000;53(1):37-56. [ Links ]
25. Lorist MM, Klein M, Nieuwenhuis S, De Jong R, Mulder G, Meijman TF. Mental fatigue and task control: Planning and preparation. Psycho-physiology. Sep 2000;37(5):614-625. [ Links ]
26. Ohyanagi T, Sengoku Y. A solution for measuring accurate reaction time to visual stimuli realized with a programmable microcontroller. Behavior Research Methods. Feb 2010;42(1). [ Links ]
27. Wang P, Nikolic D. An LCD monitor with sufficiently precise timing for research in vision. Frontiers in Human Neuroscience. Aug 2011;5. [ Links ]
28. Boyaci O, Forte A, Baset SA, Schulzrinne H, Ieee. vDelay: A Tool to Measure Capture-to-Display Latency and Frame Rate. 2009 11th Ieee International Symposium on Multimedia (Ism 2009). 2009:194-200. [ Links ]
Manuscript submitted Jun 05 2014
Accepted for publication Oct 28 2014
Corresponding author: tania.crocetta@udesc.br