JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Dentistry Section DOI : 10.7860/JCDR/2018/34353.11734
Year : 2018 | Month : Jul | Volume : 12 | Issue : 7 Full Version Page : ZC06 - ZC10

Effect of Different Lighting Conditions on Proximal Caries Detection in Dental School Settings

Mohammed Alsaati1, Thomas Deahl2, Marcel Noujeim3

1 Clinical Instructor, Department of Dental, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA.
2 Assistant Professor, Department of Comprehensive Dentistry, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA.
3 Professor, Department of Comprehensive Dentistry, University of Texas Health Science Center at San Antonio, San Antonio, Texas, USA.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Mohammed Alsaati, 7703 Floydcurl Drive, San Antonio, Texas, USA.
E-mail: alsaati@liva.uthscsa.edu
Abstract

Introduction

Environmental factors, including ambient light, play an important role in caries detection. Dental private practices and dental school clinics are exposed to extraneous light from fluorescent fixtures, operative unit lights and/or windows. In previous studies, visual fatigue and impaired diagnostic accuracy are found to be associated with the viewing conditions.

Aim

The study aims to evaluate and compare dental students’ performance at detecting proximal caries on intraoral digital radiographs, under different ambient light conditions.

Materials and Methods

Eight randomly chosen senior dental students and a dentist evaluated intraoral digital images of 32 extracted teeth mounted in 12 quadrants. Almost half of the teeth were carious as confirmed by histology. The illuminance measuring unit (Lux) was used to measure the light conditions at luminous flux per unit area. Raters viewed the images in ambient light conditions i.e., dim light settings (Less than 50 Lux) and in bright light settings (more than 800 Lux). Images were viewed with the same calibrated monitor. All other viewing conditions were controlled. Raters stated their certainty of caries presence on a 5-point scale. Sensitivity, specificity and Receiver Operating Characteristic (ROC) curve was calculated for all observations and for both light settings.

Results

Raters performed at a higher specificity under dim light conditions (p<0.05). ROC analysis showed that the overall performance under dim light environment was better than the bright light environment (0.745 vs. 0.710), which was statistically significant (p<0.05).

Conclusion

The results support reducing ambient light levels to rule out caries, as there is a significantly higher specificity and performance in a dim light environment compared to bright one.

Keywords

Introduction

One of the main challenges of dental radiographic interpretation is optimising viewing environment for the observer. Ideal viewing conditions include optimum ambient light [1]. Bright ambient lighting might have an effect similar to glare that impairs ability to detect minor contrast changes such as small carious lesions. This occurs because the contrast acuity of the eye declines as ambient lighting increases. Conversely, very dark room setting causes pupils to dilate; this can excessively degrade the visual perception due to optical aberrations [2].

Radiographic detection of early proximal caries is one of the most difficult and frequent daily tasks in dentistry [3]. A study by Welander U et al., found that extraneous light and improper masking of radiographs reduced the amount of information available to the viewer [4]. Dentists often do not agree on the presence or absence of carious lesions when interpreting the same radiograph, particularly when the lesions are limited to enamel. Yet, radiographs are necessary for caries diagnosis. Caries are viewed on radiographic images as subtle changes of contrast densities on the proximal surfaces [5].

The medical field has established guidelines for ambient light in interpreting radiographs. The American Association of Physicists in Medicine and the American College of Radiology have provided national guidelines regarding acceptable illuminance levels (24-40 Lux) in the room used for radiographic interpretation and grey scale calibration [6,7]. Lux is the SI unit of illuminance and luminous emittance, measuring luminous flux per unit area. This is used as a measure of the intensity, as perceived by the human eye, of light that hits or passes through a surface [8].

There are different opinions when it comes to evaluating lighting conditions’ effects on caries detection. Some previous studies have concluded that when using calibrated monitors, ambient light levels do not affect radiographic caries detection. However, the observers in these studies were experienced dentists [9,10]. Another study by Pakkala T et al., concluded that a high setting monitor display and room luminance did not affect the overall accuracy of radiographic caries detection [11]. Other studies have shown that faint objects such as early carious lesions on dental radiographs are more easily discernible when the ambient light is reduced to levels less than 50 Lux [12,13].

Lighting conditions and magnification play an important role in the diagnostic quality of the radiographs and detection of carious lesions. Hence, the most important variable is the observer [14]. One study suggested that the observer’s experience might influence interpretation of early diagnosis of early periapical pathosis [15]. Experience of observers and their ability to use software to adjust brightness and contrast are as important as the lighting conditions themselves [16]. However, several studies have concluded that intra-observer and interobserver correlations for diagnosis of carious lesions vary [17,18].

Recent studies have focused on experienced dentists in caries detection. However, little attention has been given to students. To our knowledge, only one study, done by Kutcher MJ et al., compared clinicians’ performance with students’ on caries detection. This study showed comparable results between clinicians and students, but also showed high inconsistency in students’ abilities to detect caries compared to experienced clinicians [19]. The study suggested that the diagnostic ability could be improved by hooding laptops in bright clinical environments.

Objective of present study is to measure the effect of ambient light settings on the students’ ability to interpret digital radiographs, in order to enhance their educational experience.

Materials and Methods

This cross-sectional study lasted for approximately 90 days from the Institutional Review Board approval. The study was exempt, declared as non regulated research by UTHSCSA Institutional Review Board (HSC20160644H).

Viewing Conditions: Two different lighting conditions were used in this study: dim and bright environments. The dim environment was the clinic of dental radiology reading and interpretation area (<50 Lux). The bright environment was the faculty station in the student clinical operatory (>800 Lux). A photometer (Extech Instruments, Model LT300, Boston, Massachusetts) was used to measure room luminance. The photometer was placed in front of the screen display with the light sensor facing the reader, in a setting similar to the Pakkala T et al., study [11]. Pre study reading was done throughout the day in order to evaluate luminance variability. The average reading was less than 50 Lux in dim environment and more than 800 Lux in bright environment. Light measurements in each environment for caries detection are presented in [Table/Fig-1].

Average reading of room lighting for each rater in dim/bright conditions.

Room settingAverage display Lux readings
Dim condition49.2 Lux±12
Bright condition860 Lux±70

Images were viewed using the same monitor in both environments, a Dell U2412M 24” (Dell Computer Co. Round Rock, TX). The monitor was calibrated manually using Society of Motion Picture and Television Engineers (SMPTE) test and TG18 Quality Control from American Association of Medical Physicists (AAMP). The raters viewed the images in a black background, they were not allowed to adjust the brightness or contrast settings with either software or hardware control.

Diagnostic Materials: Due to time constraints, only 32 extracted maxillary and mandibular posterior teeth, some with natural dental caries, was used. The teeth were mounted in quadrants in their anatomical location and secured by periphery dental wax. Three to five teeth were placed in each quadrant. XDR size no.2 CMOS digital sensor (XDR radiology Los Angeles, CA, USA) was used to capture the 12 images. The radiographs were acquired using Planmeca intraoral dental X-ray (Planmeca USA Roselle, IL, USA) at 63 kVp/8 mA/0.08 s, according to manufacturer’s exposure settings. The beam was perpendicular to crown of the teeth. Teeth were then placed parallel to the image sensor to simulate bitewing intraoral radiographs. Images were saved in an uncompressed Tagged Image File Format (TIFF). When the images were viewed for the second time, they were randomised and flipped to avoid recall bias. After image acquisition was completed, the teeth were sectioned and examined microscopically and the presence or absence of caries was recorded and used as gold standard. A microscopic study conducted by a faculty member from the Histology department at University of Texas Health Science Center at San Antonio (UTHSCSA) confirmed almost 50% of the surfaces evaluated were carious.

Data Collection: Due to time limitations to researcher and potential participants, the total number of participants were restricted to nine. Eight randomly chosen senior dental students from UTHSCSA Dental School were recruited as raters. Recruiting was based on selecting every third student in the alphabetical order.

Inclusion criteria were students who are seniors. Exclusion criteria were students with health conditions that affect visibility. A dentist with two years of clinical experience was chosen as a comparison rater. Inclusion criteria were availability for the duration of the study and a minimum of two years of clinical experience.

Viewing instructions were given to each rater regarding what to look for and how to report their confidence on proximal caries presence or absence. Raters were instructed to avoid treatment consideration. The confidence scale used was: 1) Decay is definitely present; 2) Decay is probably present; 3) Rater is unable to decide; 4) Decay is probably not present; and 5) Decay is definitely not present. Each rater viewed the images in both environments, the dim and bright light settings. Sessions were separated by approximately one week to avoid recall bias. Raters were told that the sessions were divided into two due to eye fatigue and their time contribution from clinic. Sessions were conducted during clinical hours to simulate normal clinical settings. Total number of participants remained nine when study was concluded.

Statistical Analysis

Observer ratings were analysed in several different ways. One method was to review the ratings of each observer, looking for scores of “high confidence” (a rating of 1 when caries was actually present, or a rating of 5 when caries was actually absent) vs. scores of “low confidence” (a rating of 3), and to compare how many of these occurred in the two different environments. A second, more traditional method of analysis is the ROC. An ROC curve is a graphical plot that illustrates the diagnostic ability of a binary classifier system as its discrimination threshold is varied. It is created by plotting the True Positive Rate (TPR) against the False Positive Rate (FPR) at various threshold settings. This method involved calculating sensitivity (the rate of correctly identifying teeth with a carious lesion) and specificity (the rate of correctly identifying teeth without caries), plotting a ROC curve, and calculating the Area under the Curve (AUC).

In the tables presented in this paper, a rating was deemed to agree with the actual status of caries present if it was a 1 or 2, and ratings of 3, 4, or 5 were considered to be in agreement with an actual status of caries absent.

Diagnostic performance was expressed in terms of area under ROC curve, which is a useful graphical tool for comparing raters and imaging methods. The sensitivity of a rater is plotted against the FPR (1-specificity) for each level of rating. A program code developed by Kate Nambiar, *Simple ROC plots with ggplot2 (http://www.r-bloggers.com/simple-roc-plots-with-ggplot2-part-1/, March 21, 2012)* was modified to calculate sensitivity, specificity, and FPR for each rater and lighting condition, as well as to prepare ROC curves, calculate the AUC of each, and determine confidence intervals for AUC. The confidence intervals for AUC are based on the calculation of standard error for a ROC curve, as derived by Hanley JA and McNeil BJ [20].

As a final method of analysis, Cohen’s Kappa was calculated to measure intra-rater agreement in the two environments [21]. For data analysis, the R software for statistical computing was used for all analysis calculations.

Results

Participants in the study were eight senior dental students and a dentist as mentioned above. As for the students, there were 65 potentially eligible considering the inclusion and exclusion criterions. Eight students were examined and confirmed for eligibility using a random selection method. As for the students’ demographics: 50% were males and 50% were females, 100% single, 100% less than 30-year-old and 100% US nationality. All students had a similar clinical experience; took and passed the radiographic interpretation courses (theoretical and clinical). The dentist participant in the study was chosen among 12 other potentially eligible candidates based on the inclusion criterion of availability throughout the study duration. The dentist was a male, US nationality and single. His clinical background will remain disclosed for the reasons of confidentiality.

When caries were absent, there was a high degree of confidence among the students in identifying the absence, especially under dim lighting conditions. Six of the students felt high confidence at least two-thirds of the time, e.g., a rating of 1 for at least 32 surfaces, in the dim environment, and five students had high confidence at least two-thirds of the time in the bright environment. Three students expressed high confidence at least eight times more under dim lighting than they did under bright lighting, which is a significant statistical difference. The other five students and the dentist expressed high confidence for about an equal number of times under both conditions. There was little difference in low confidence scores among all of the observers when caries were absent [Table/Fig-2].

Number of high and low confidence ratings, caries absent (n=48 surfaces).

Confidence ratingsS01S02S03S04S05S06S07S08DTotal
High confidence, dim lighting373828373432283911284
High confidence, bright lighting384216*3920*3420*3616261*
Low confidence, dim lighting44402050524
Low confidence, bright lighting30613040724

* Statistically significant fewer ratings compared to dim conditions, at the 0.05 significance level


When caries was present, there were fewer instances of high confidence among the raters, with only one rater (student 7) expressing high confidence for more than half the surfaces, and only in the bright environment. Student 7 is also the only one to show a difference in confidence between lighting environments. Again, there was little difference in low confidence scores in either lighting condition, but the dentist expressed low confidence more frequently than any of the students when caries was present [Table/Fig-3].

Number of high and low confidence ratings, caries present (n=42 surfaces).

Confidence ratingsS01S02S03S04S05S06S07S08DTotal
High confidence, dim lighting1691714141414164118
High confidence, bright lighting1661316111523*202122
Low confidence, dim lighting436142501136
Low confidence, bright lighting50533020826

* Statistically significant more ratings compared to dim conditions, at the 0.05 significance level


ROC analysis showed that when all students were counted together, the AUC value for performance in “dim” was 0.745, vs. the “bright” performance of 0.710, which was statistically significant (at the 0.05 level of significance). ROC analysis for the dentist’s performance was 0.703 for both “dim” and “bright” environments [Table/Fig-4].

ROC.

Sensitivity was slightly higher for student performances in “dim” vs. “bright”. One student had a significantly higher sensitivity value under “dim” than “bright”: 0.429 compared to 0.262 [Table/Fig-5,6]. Another student had a statistically higher value in the “bright” vs. “dim”: 0.810 and 0.643. Yet, there were no significant differences in sensitivity values when all students were considered together. As for specificity, two students (students 7 and 8) had a significant higher value in “dim” vs. “bright”: student 7 (0.854 and 0.688) and student 8 (0.875 and 0.750). When all students were considered together, the specificity was greater for “dim”, which was statistically significant (at the 0.05 level of significance).

Results by rater, by lighting condition.

RaterSensitivity1 (true positive rate)Specificity1 (1-false positive rate)AUC with 95% CI (Area under ROC curve)
LightingDimBrightDimBrightDimBright
S010.5240.4520.8750.8540.719 (0.667-0.772)0.701 (0.647-0.754)
S020.4290.262*0.9380.9380.681 (0.626-0.735)0.612 (0.554-0.669)*
S030.6900.6190.7500.7710.785 (0.738-0.832)0.696 (0.642-0.750)*
S040.5000.5480.8540.8750.726 (0.675-0.778)0.750 (0.700-0.800)
S050.6430.5950.8130.7920.749 (0.698-0.799)0.693 (0.639-0.747)*
S060.5480.5240.8540.8330.736 (0.684-0.787)0.750 (0.700-0.800)
S070.6430.810*0.854.688*0.772 (0.723-0.820)0.781 (0.733-0.828)
S080.6190.6900.8750.750*0.806 (0.761-0.851)0.731 (0.680-0.783)*
All Students Combined0.5740.5630.8520.813*0.745 (0.727-0.763)0.710 (0.691-0.728)*
Dentist0.4050.4290.8540.8750.703 (0.650-0.756)0.703 (0.650-0.756)

1 Sensitivity and specificity based on rating of 1 or 2 indicating presence of caries, and rating of 3, 4, or 5 indicating absence of caries.

* Value for bright conditions is statistically different than for dim conditions, for this reader, at the 0.05 level of significance


Intrarater reliability scores, using Cohen’s kappa: dim vs. bright conditions.

RaterObserved agreementκ (95% XI)
S010.8650.692 (0.514-0.870)
S020.8920.666 (0.460-0.872)
S030.9440.887 (0.780-0.995)
S040.9180.812 (0.679-0.945)
S050.8630.718 (0.563-0.873)
S060.9090.798 (0.664-0.931)
S070.8400.684 (0.519-0.848)
S080.8330.658 (0.500-0.816)
Dentist0.9370.854 (0.715-0.992)

Each rater was compared across both environments, with a score of 1 or 2 under “dim” agreeing with a score of 1 or 2 under bright conditions, or similarly a score of 4 or 5 under dim conditions agreeing with a score of 4 or 5 under “bright”. A score of 3 under either environment, caused that tooth surface, to be ignored. Calculation of confidence intervals for Kappa were done as described by Charles Zaiontz on blog, http://www.real-statistics.com/reliability/cohens-kappa/.

Kappa values are presented in [Table/Fig-5]. Based on Landis & Koch, Biometrics 1977 classification, a Kappa score of 0.61 to 0.80 can be interpreted as “substantial agreement” (which was achieved by six students), and a Kappa score of 0.81 or higher can be interpreted as “almost perfect agreement” (two students and the dentist).

Discussion

Carious lesions vary in depth from incipient to cavitated. Not every caries is radiographically detectible. Lesions confined to enamel are not evident radiographically until approximately 30% to 40% demineralisation has occurred [22]. This explains the overall low sensitivity scores in caries detection, which is similar to previous studies [11,23]. In the present study caries depth ranged from shallow enamel to deep dentinal. The purpose of this study was to determine whether there is a difference in caries detection between dim and bright environment. The mean student results yielded slightly higher sensitivity in dim environment compared to bright (0.574, 0.563), but it was not statistically significant.

In the present study, when histology confirmed absence of caries, the raters’ mean score reported a high degree of confidence in ruling out caries in dim light conditions, which was statistically significant in students’ performance (at 0.05 significant level).

Hellén-Halme K et al., study supported present findings; the detection of detail caries is easier in dim light conditions than in bright conditions [13]. However, when display monitors are adjusted to optimal brightness, there was no effect of lightning conditions on enamel caries detection.

As per the guidelines for illuminance levels in radiographic interpretation clinics, the dim light in our study was set to (>50 Lux) [6,7]. In studies the illuminance level was between 25 and 40 lux [24,25]. The two studies confirmed that specific adjustment to displaying monitors can improve the presentation of dental radiographic dental images.

A previous study found that there was no difference between ambient light levels in the ability to detect carious lesions in digital radiographs if the monitor is calibrated in accordance with the surrounding light level [9]. In that study, the AUC for the raters’ performance were 0.723 and 0.732 in dim versus bright environment. In our study, students’ performance was 0.745 and 0.710 in dim versus bright environment.

Kutcher MJ et al., studied raters including dental students [19]. This study had higher specificity than present study, but found no significant difference in specificity in low and high ambient light (1.00, 0.98). In the present study, students had significantly higher specificity in the dim environment compared to the bright environment (0.852, 0.813). To clarify, students were better able to diagnose absence of the disease in a dim environment. Kutcher MJ et al., reported mean AUC in dental students’ performance in “bright” was higher than in “dim” (0.79 and 0.85) [19]. This differed from our results, as mean AUC for students’ performance was 0.745 in “dim” and 0.710 in the “bright”. Again, these results were statistically significant (at 0.05 level of significance). Kutcher MJ et al., environment was 10 and 940 Lux, and the monitors used were laptop screens. In our study, “dim” were averaged 50 Lux and “bright” were averaged 860 Lux and we used calibrated desktop monitors.

Monitors used in present study were manually calibrated using TG18 quality control from the AAMP similar to previous studies [10]. Often, practicing dentists are not aware of these factors and the ability to adjust the contrast and brightness in their monitors that are set most of the times to default settings. This makes it harder to evaluate lower contrast images under bright ambient light conditions. However, the Digital Imaging and Communication in Medicine standard (DICOM)-calibrated consumer grade display was found suitable for detecting anatomical structures and pathology in panoramic radiographs under ambient light conditions (510 Lux) [26].

Many studies have covered the same idea of ambient light conditions and its effect on interpretation and diagnostic accuracy. Present study is unique because it is the most recent in the field, it combines all the recent studies supporting and opposing the hypothesis, alongside providing significant statistical findings in comparison between inexperienced raters and an experienced one.

Limitation

One limitation of the study was that anatomic but dry phantom was used for caries detection. That might affect the usefulness of an intraoral radiographic image. Another limitation was the difficulty of adjusting the room Lux on day to day basis due to different weather conditions.

The findings of the study can be implied in future studies with relation to factors affecting radiographical readings. The statistical results can set the basic stone to an in depth investigation of students’ learning curve, speed and quality in radiographic interpretations. Finally, the methods used to determine cavity existence in different light conditions can be further applied to examine and evaluate lesions, odontogenic pathologies and cone beam CT scans.

Conclusion

The results of present study support reducing ambient light for ruling out caries, as there is significantly higher specificity in dim settings compared to bright settings. Diagnostic efficacy measured by ROC demonstrates significant improvement in students’ performance when dim light settings are in place. Therefore, in order to rule out caries, it is advisable to view images in dim conditions.

Study recommendations: a) monitor calibration every 3 to 6 months; b) dental staff and faculty awareness of the ambient light effect when interpreting dental radiographs; and c) dental students must adhere to the American Association of Physicists in Medicine and the American College of Radiology Standards for lightning conditions, as this will enhance their radiographs interpretation abilities.

* Statistically significant fewer ratings compared to dim conditions, at the 0.05 significance level* Statistically significant more ratings compared to dim conditions, at the 0.05 significance level1 Sensitivity and specificity based on rating of 1 or 2 indicating presence of caries, and rating of 3, 4, or 5 indicating absence of caries.* Value for bright conditions is statistically different than for dim conditions, for this reader, at the 0.05 level of significance

References

[1]White SC, Pharoah MJ, Oral radiology: principles and interpretation 2013 Dec LouisMosby:256  [Google Scholar]

[2]Inbar D, Sohval AR, The digital film viewer: A novel technology for optimizing film-based radiology Journal of digital imaging 1998 11(1):192-97.10.1007/BF031683029735467  [Google Scholar]  [CrossRef]  [PubMed]

[3]Rindal DB, Gordan VV, Litaker MS, Bader JD, Fellows JL, Qvist V, Methods dentists use to diagnose primary caries lesions prior to restorative treatment: findings from The Dental PBRN Journal of Dentistry 2010 38(12):1027-32.10.1016/j.jdent.2010.09.00320884316  [Google Scholar]  [CrossRef]  [PubMed]

[4]Welander U, McDavid WD, Higgins NM, Morris CR, The effect of viewing conditions on the perceptibility of radiographic details Oral Surgery, Oral Medicine and Oral Pathology 1983 56(6):651-54.10.1016/0030-4220(83)90084-1  [Google Scholar]  [CrossRef]

[5]White SC, Pharoah MJ, Oral radiology: principles and interpretation 2013 Dec LouisMosby:258-274.  [Google Scholar]

[6]Samei E, Badano A, Chakraborty D, Compton K, Cornelius C, Corrigan K, Assessment of display performance for medical imaging systems: executive summary of AAPM TG18 report Phys Med 2005 32:1205-25.10.1118/1.186115915895604  [Google Scholar]  [CrossRef]  [PubMed]

[7]American College of Radiology (ACR). ACR technical standard for electronic practice of medical imaging. 2012 [revised 2012; cited 2013 February 7]. Available from: gm.acr.orgSecondaryMainMenuCategories/quality_safety/guidelines/med_phys/electronic_practice.aspx  [Google Scholar]

[8]National Institute of Standards and Technology. SI Derived Units- Lux. 2008 [cited 2017 Jan 11]. Available from https://www.nist.gov/sites/default/files/documents/pml/div684/fcdc/sp811.pdf  [Google Scholar]

[9]Hellén-Halme K, Lith A, Carious lesions: diagnostic accuracy using pre-calibrated monitor in various ambient light levels: an in vitro study Dentomaxillofacial Radiology 2013 42(8):2013007110.1259/dmfr.2013007123775926  [Google Scholar]  [CrossRef]  [PubMed]

[10]Hellen-Halme K, Nilsson M, Peterson A, Effect of monitors on approximal carious detection in digital radiographs: standard versus precalibrated DICOM part 14 displays: an in vitro study Dentomaxillofacial Radiology 2009 107(5):716-20.Available at https://www.ncbi.nlm.nih.gov/pubmed/1920121910.1016/j.tripleo.2008.12.01119201219  [Google Scholar]  [CrossRef]  [PubMed]

[11]Pakkala T, Kuusela L, Ekholm M, Wenzel A, Haiter-Neto F, Kortesiemi M, Effect of varying displays and room luminance on caries diagnostic accuracy in digital dental radiographs Caries Res 2012 46(6):568-74.10.1159/00034121822947623  [Google Scholar]  [CrossRef]  [PubMed]

[12]Hellén-Halme K, Nilsson M, Petersson A, Digital radiography in general dental practice: a field study Dentomaxillofacial Radiology 2007 36(5):249-55.Available at http://www.birpublications.org/doi/full/10.1259/dmfr/9512549410.1259/dmfr/9512549417586850  [Google Scholar]  [CrossRef]  [PubMed]

[13]Hellén-Halme K, Petersson A, Warfvinge G, Nilsson M, Effect of ambient light and monitor brightness and contrast settings on the detection of approximal caries in digital radiographs: an in vitro study Dentomaxillofacial Radiology 2008 37(7):380-84.10.1259/dmfr/2603891318812599  [Google Scholar]  [CrossRef]  [PubMed]

[14]Arnold LV, The radiographic detection of initial carious lesions on the proximal surfaces of teeth: Part II. The influence of viewing conditions Oral Surgery, Oral Medicine, Oral Pathology 1987 64(2):232-40.10.1016/0030-4220(87)90096-X  [Google Scholar]  [CrossRef]

[15]Patel N, Rushton VE, Macfarlane TV, Horner K, The influence of viewing conditions on radiological diagnosis of periapical inflammation Br Dent J 2000 189(1):40-42.10.1038/sj.bdj.480059610967823  [Google Scholar]  [CrossRef]  [PubMed]

[16]Cederberg RA, Frederiksen NL, Benson BW, Shulman JD, Influence of the digital image display monitor on observer performance Dentomaxillofacial Radiology 1999 28(4):203-07.10.1038/sj.dmfr.460044110455382  [Google Scholar]  [CrossRef]  [PubMed]

[17]Grondahl HG, Hollender L, Osvald O, Quality and quantity of dental x-ray examinations: a comparative study in a five-year interval Dentomaxillofacial Radiology 1980 9(2):70-72.10.1259/dmfr.1980.00146946024  [Google Scholar]  [CrossRef]  [PubMed]

[18]Wenzel A, Digital radiography and caries diagnosis Dentomaxillofacial Radiology 1998 27(1):3-11.10.1038/sj.dmfr.46003219482015  [Google Scholar]  [CrossRef]  [PubMed]

[19]Kutcher MJ, Kalathingal S, Ludlow JB, Abreu M, Platin E, The effect of lighting conditions on caries interpretation with a laptop computer in a clinical setting Oral Surg Oral Med Oral Pathol Oral Radiol Endod 2006 102(4):537-43.10.1016/j.tripleo.2005.11.00416997122  [Google Scholar]  [CrossRef]  [PubMed]

[20]Hanley JA, McNeil BJ, The meaning and use of the area under a Receiver Operating Characteristic (ROC) curve Radiology 1982 143(1):29-36.10.1148/radiology.143.1.70637477063747  [Google Scholar]  [CrossRef]  [PubMed]

[21]Cohen J, A coefficient of agreement for nominal scales Educational and psychological measurement 1960 20(1):37-46.10.1177/001316446002000104  [Google Scholar]  [CrossRef]

[22]White SC, Pharoah MJ, Oral radiology: principles and interpretation 2013 Dec LouisMosby:269-80.  [Google Scholar]

[23]Bottenberg P, Jacquet W, Stachniss V, Wellnitz J, Schulte AG, Detection of cavitated or non-cavitated approximal enamel caries lesions using CMOS and CCD digital X-ray sensors and conventional D and F-speed films at different exposure conditions American journal of dentistry 2011 24(2):74-78.  [Google Scholar]

[24]Mcilgorm DJ, Lawinski C, Ng S, McNulty JP, Could standardizing “commercial off-the-shelf”(COTS) monitors to the DICOM part 14: GSDF improve the presentation of dental images? A visual grading characteristics analysis Dentomaxillofacial Radiology 2013 42(9):2013012110.1259/dmfr.2013012123990526  [Google Scholar]  [CrossRef]  [PubMed]

[25]McIlgorm DJ, McNulty JP, DICOM part 14: GSDF-calibrated medical grade monitor vs a DICOM part 14: GSDF-calibrated “commercial off-the-shelf”(COTS) monitor for viewing 8-bit dental images Dentomaxillofacial Radiology 2014 44(3):2014014810.1259/dmfr.2014014825421807  [Google Scholar]  [CrossRef]  [PubMed]

[26]Kallio-Pulkkinen S, Haapea M, Liukkonen E, Huumonen S, Tervonen O, Nieminen MT, Comparison between DICOM-calibrated and uncalibrated consumer grade and 6-MP displays under different lighting conditions in panoramic radiography Dentomaxillofacial Radiology 2015 44(5):2014036510.1259/dmfr.2014036525564888  [Google Scholar]  [CrossRef]  [PubMed]