JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Psychiatry Section DOI : 10.7860/JCDR/2015/11974.6438
Year : 2015 | Month : Sep | Volume : 9 | Issue : 9 Full Version Page : VC07 - VC10

Development of Screening Questionnaire for Detection of Alcohol Dependence

Shubh Mohan Singh1, Ashish Bhalla2, Om Prakash Giri3, Siddharth Sarkar4

1 Assistant Professor, Department of Psychiatry, Postgraduate Institute of Medical Education and Research, Chandigarh, India.
2 Additional Professor, Department of Internal Medicine, Postgraduate Institute of Medical Education and Research, Chandigarh, India.
3 Psychiatric Social Worker, Department of Psychiatry, Drug Deaddiction and Treatment Centre, Postgraduate Institute of Medical Education and Research, Chandigarh, India.
4 Senior Resident, Department of Psychiatry, Jawaharlal Institute of Postgraduate Medical Education and Research, Pondicherry, India.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Shubh Mohan Singh, Assistant Professor, Department of Psychiatry, Postgraduate Institute of Medical Education and Research, Chandigarh-160012, India.
E-mail: shubhmohan@gmail.com
Abstract

Introduction

Alcohol dependence (AD) is a major reason for morbidity and visits to emergency medical settings. However, the detection of AD is often difficult or overlooked. This study aimed to develop a brief screening questionnaire in Hindi language for detection of AD in an emergency medical setting.

Materials and Methods

The authors in consultation devised a set of questions related to AD in the Hindi language requiring binary yes/no type of response. These questions were guided by clinical experience, nosological criteria and previously published screening questionnaires. After initial piloting, these questions were administered by the treating doctors to 100 consenting adult patients presenting with possible AD in the emergency medical services of a tertiary care hospital in North India. A diagnosis of AD was arrived at by administering Mini-International Neuropsychiatric Interview separately. Identification of the most discriminant combinations of items for the detection of AD were based on the chi-square test and binary logistic regression analyses. The final version of the questionnaire was then externally validated on another cohort of patients.

Results

Based on the analyses, we retained 5 items in the final version of the questionnaire. Sensitivity and specificity values for cut-off scores were calculated. Subsequent external validation revealed satisfactory psychometric properties of the questionnaire.

Conclusion

The questionnaire represents a simple and brief clinician-administered instrument for screening of AD in an emergency medical setting.

Keywords

Introduction

The consumption and acceptability of alcohol in Indian society is increasing [1]. This is reflected in a growing contribution of alcohol to illness and morbidity in both routine and emergency surgical and medical settings [26]. Thus it is important that alcohol use disorders (AUD) be recognized in health care settings. One way of quick detection is by the use of screening questionnaires. There are numerous screening questionnaires for detection of AUD such as the well known CAGE (an acronym for Cut down, Annoyed, Guilty feelings and Eye opener) [7], Fast alcohol screening test (FAST) [8], Alcohol use disorders identification test (AUDIT) [9] and others [10]. There is also ample evidence to suggest that screening for AUD is useful and important [11]. However, it is often difficult to administer these instruments in a busy emergency setting because of paucity of time, attitude of the health-care professional, length of time required in administration of the instrument, lack of awareness or unavailability of relevant instruments [12]. Moreover, these instruments have been developed for use in western cultures and the idioms and language used are often not applicable in an Indian context. Some of the instruments used also depend on the quantification of alcohol consumed which may not be relevant to our context given the wide variety of alcohol available locally [13]. Another issue in this area is that of terminology and severity of AUD that the screening questionnaire is designed for. These terminologies range from hazardous and harmful alcohol use to alcohol dependence syndrome (AD) [14,15]. Therefore, there is a need for a simple, culturally sensitive, vernacular screening questionnaire for detection of AUD in an Indian emergency setting.

This paper describes the development of a screening questionnaire in the Hindi language for detection of AD for use by doctors in an emergency setting. We have decided to restrict ourselves to the diagnosis of AD as these patients have demonstrable behavioural, social, or health consequences of alcohol use and are in imminent danger of adverse consequences such as complicated withdrawal [16]. As mentioned above, we have designed the questionnaire to be simple, brief and based on behavioural and physiological aspects of alcohol dependence instead of the quantification of alcohol consumed. This questionnaire is designed to screen for presence of the diagnosis of AD or mental and behavioural disorders due to use of alcohol, dependence syndrome, currently using the substance (F10.24) as per the ICD-10 [15].

Materials and Methods

This study was conducted in the Postgraduate Institute of Medical Education and Research (PGIMER), Chandigarh and was approved by the institute ethics committee. All participants provided written informed consent. The study was conducted from May 2013 to July 2013.

The items of the questionnaire were derived by consultation among the authors. The items were derived by clinical experience, diagnostic criteria of nosological systems and also relevant questions framed in other screening questionnaires. However, all items were designed in Hindi language to begin with and not just translated from the above sources. All items had a possible yes/no binary response to minimize ambiguity and confusion. A scoring system by which a ‘no’ response is marked as 0 and a ‘yes’ response is marked as 1 was decided upon. An initial questionnaire of 29 items was arrived at. The authors agreed that the items in the questionnaire tapped into the formal nosological diagnostic criteria for AD and also other behavioural and cognitive markers that have earlier been described in other such instruments. This was then piloted in 10 participants to check for language, ease of administration, understanding and responding. Thereafter, a questionnaire with 29 items was arrived at, which was administered among the participants of the study. The other instruments used were the socio-demographic profile sheet for the socio-demographic profiles. The Mini-International Neuropsychiatric Interview (MINI) [17] was used to arrive at a formal diagnosis of AD as per ICD-10.

The participants of the study comprised of patients admitted to the medical emergency services of PGIMER. A purposive method of sampling was employed. The inclusion criteria were that the patients needed to have consumed alcohol in some form in the previous year. The exclusion criteria were refusal to participate in the study or inability to understand and answer the questions due to any organic brain condition. Other than the administration of the questionnaire, no other intervention was done and treatment was carried out as usual.

The study was conducted in two phases. In the first stage, the socio-demographic data of the patients were recorded. All the participants were then administered the 29 item-questionnaire by the doctor on duty in the emergency. Thereafter, all participants were administered the MINI by a psychiatrist to arrive at or rule out a diagnosis of AD. The psychiatrist was blind to the results of the earlier assessment.

The statistical methods followed in arriving at the final set of questions are described below. For each item on the questionnaire, a Chi-square test (χ2) was performed to compare the proportion of ‘yes’ responses between the AD and the non-AD groups. The items that differentiated the two groups significantly were then examined for redundancies. This was done by classifying the questions as per the domains of the diagnostic criteria as described in the ICD-10 and other behavioural and cognitive markers as described in other screening instruments. Wherever items were deemed to be similar in content, the one item most predictive of a ‘yes’ response with the AD status as the dependent variable was arrived at using a binary logistic regression analysis. The items arrived at were then included in a binary logistic regression analysis to decide the items most discriminative of AD and not-AD (NAD) status.

Sensitivity and specificity values and Youden Index (Sensitivity+ Specificity-100) [18] for various cut-off points for the total score of the final version of the questionnaire were then calculated. The corresponding Cronbach’s alpha and Area under curve (AUC) using the Receiver Operating Characteristics test were also calculated.

In the second stage, the questionnaire developed earlier was administered to a subsequent cohort of consenting patients with inclusion and exclusion criteria similar to those described above. This was done to externally validate our findings [19]. The questionnaire was administered by the doctors on duty in the emergency. In addition these doctors were asked how easy and how clinically relevant they considered the administration to be. A formal diagnosis using MINI was later done by the psychiatrist who was blind to the findings of the initial administration.

The data were analysed using the Statistical Package for Social Sciences (SPSS) software for Windows [20].

Results

A total of 100 participants were recruited into the first stage of the study. In keeping with the usual trend as regards AD in this part of the country, all the participants were males. [Table/Fig-1] presents the socio-demographic profile of the participants. There were no significant differences amongst the AD and not AD groups.

Socio-demographic details of the participants in the first stage of the study

nMean age in years (SD)BackgroundEducation in years (SD)
RuralUrban
AD6447.17 (12.03)29359.86 (3.70)
Not AD3644.44 (11.86)15218.69 (3.88)
p=0.69*p=0.72**p=0.64*

*=Independent samples t-test, **=Pearson’s Chi-square, p significant if <0.05


For each item, a χ2 test was performed to compare the yes response between the AD and NAD groups. Out of 29 items, 4 items did not significantly differentiate between the AD and NAD groups. These were then excluded from the subsequent analysis. Subsequent stepwise binary logistic regression analyses revealed 5 items to be the most predictive of AD status. The sensitivity and specificity values for different cut-off scores of the 5-item scale are presented in [Table/Fig-2]. The Cronbach’s alpha was found to be 0.62 reflecting a relationship but lack of redundancy between the items [21]. The AUC was 0.90 (0.84-0.96 95% Confidence Interval) which indicates a good ability to differentiate AD from NAD subjects [22].

Sensitivity and specificity values (in percentages) and Youden Index at different cut-off scores of the 5-item questionnaire

Cut-off scoreSensitivitySpecificityYouden Index
110019.419.4
295.352.848.1
378.188.967
456.398.254.5
529.710029.7

The results shown in [Table/Fig-2] suggest that a score of ≥3 would indicate a positive screen for the diagnosis of AD. The positive predictive value for a diagnosis of AD with a score of ≥ 3 on the 5-item questionnaire was found to be 92.59 (81.25-97.60 95% Confidence Interval) and the negative predictive value was 69.56 (54.07-81.80 95% Confidence Interval). The probability of a false positive was found to be 7.40 (2.39-18.74 95% Confidence Interval).

Socio-demographic and clinical details of patients included in the second stage of the study

nMean age in years (SD)BackgroundEducation in years (SD)Ques-tion-naire Score <3Questionnaire Score ≥3
RuralUrban
AD6450.23 (13.02)273710.60 (2.61)658
Not AD4745.08 (15.55)212610.63 (3.19)461
p=0.06*p=0.84**p=0.31*p<0.05**

*=Independent samples t-test, **=Pearson’s Chi-square, p significant if <0.05


The subsequent external validation was carried out on 111 consenting patients. All of them were male. The socio-demographic and clinical data of the participants is presented in [Table/Fig-3]. The sensitivity and specificity values for a diagnosis of AD (at a score of ≥3 on the questionnaire) were found to be 90.62 (80.05-96.13 95% Confidence Interval) and 97.87 (87.28-99.88 95% Confidence Interval) respectively. The positive predictive value at the same cut-off score was 98.35 (89.70-99.91 95% Confidence Interval) and the negative predictive value was 88.46 (75.87-95.22 95% Confidence Interval). The AUC with a diagnosis of AD (at a score of≥3 on the questionnaire) in this cohort was found to be 0.94 (0.89-0.99 95% Confidence Interval). The Cronbach’s alpha value of the final version of the questionnaire in this stage of the study was found to be 0.80.

None of the patients found any difficulty in answering the questionnaire. The doctors considered the administration of the questionnaire easy and relevant to clinical history taking and decision making for the management of AD.

Discussion

AUD and AD are important contributors to morbidity and mortality all over the world and India is no exception. This contribution to morbidity and mortality is not only due to the direct toxic effects of alcohol use but also indirectly from the contribution of alcohol use in complicating and aggravating other physical and mental diseases. The contribution of alcohol use to economic and social upheaval and avoidable trauma is also well-known [23]. In such a scenario, the detection of AUD and AD become important [11]. Screening instruments either involve biochemical tests or questionnaires [10]. Questionnaires have been popular for their obvious ease of administration, non-invasive nature and brevity as compared to biochemical markers. They have also been found to be useful when compared to clinical impressions, or quantity-frequency measures [10]. However, the use of questionnaires is not without caveats. Firstly and most importantly, there is an issue of terminology in ‘what’ actually is being detected. Different instruments have been designed to detect different conditions such as moderate drinking, hazardous drinking, at-risk drinking, harmful drinking, AD, alcohol abuse [10]. All these are specific entities and are not synonymous. For instance, harmful drinking represents a totally different set of issues and challenges as compared to established AD. Therefore, questionnaires are not necessarily interchangeable as per requirement. Clinical variables such as demographic parameters and current versus life-time diagnosis significantly influence the accuracy of screening questionnaires [10]. To further complicate matters, many of these questionnaires are dependent on measures or quantities of alcohol imbibed. While this may be applicable in settings where alcohol content is standardized, in a country such as India where alcohol content may depend largely on the source such as Indian made foreign liquor versus country liquor versus home-brewed and sometimes illicit liquor, the problem is obvious [13]. Finally, all these questionnaires have been designed and developed in the western world with that population in mind. Our cultural patterns and attitudes with respect to alcohol consumption differ significantly from the former. Therefore many items in these questionnaires may not be culturally sensitive to the Indian population. Indian research in this area has been scarce. Screening questionnaires have been used primarily in the community settings for epidemiological purposes [24]. In hospital settings, some studies regarding the utility of pre-existing questionnaires have been done with mixed results [25]. Screening questionnaires have also been used in some other studies where diagnosis or epidemiology was not the primary focus [26]. AUDIT is available in a Hindi translation but has 10 items and may not be suitable for a busy emergency setting [14]. It is clear that more research is needed in this field.

To the best of our knowledge, the development of this questionnaire is the first attempt to develop a vernacular instrument for the screening of AD in an emergency medical setting in India.

The health care setting in general and the emergency in particular represents peculiar challenges and opportunities in the management of patients with AD or conditions that are brought about or aggravated by AD [11]. The barriers to effective screening include not just paucity of time and attitudinal issues but also the availability of culturally relevant, brief instruments that can be rapidly and easily administered. Another confounding factor is also the various terminologies regarding the AUD that are used in these questionnaires. Therefore, in the development of this questionnaire we tried to include items that were deemed to be brief, easily understandable, and relevant to the socio-cultural context. We used a purposive sampling method as we wanted to develop a questionnaire that can be used in patients where initial history taking suggests that AD may be present and missing the diagnosis may be detrimental to the patient. We also decided to screen for AD as defined in ICD-10 rather than abuse or hazardous drinking because of the different terminologies involved. The detection of AD in an emergency setting is important. This is because patients with AD often have various co-morbid conditions that can cause them to visit the emergency medical services. Often, AD can be missed in such patients. Advice or interventions that could be instituted to manage AD are thus not initiated leading to an aggravation in the comorbid conditions. Another important aspect of the detection of AD is the prevention of Delirium Tremens and other complicated alcohol withdrawal syndromes (DT) [27]. Though we did not study the ability of this questionnaire for prediction of DT, we believe that this questionnaire can be useful when taken in association with other known risk factors for DT [27]. In any case, a positive screen for AD should enable a clinician to pre-empt and anticipate DT.

Our study population was comprised entirely of males who generally present with alcohol related problems in the North of India. This may be different from other parts of the country or in other parts of the world where the problem of AD is a lot more widespread among both sexes. However, we believe that our study group is fairly representative of the local situation. Most of the patients were in the 5th and 6th decades of life and presented with medical emergencies of various descriptions. Though we did not gather data regarding the progression of alcohol use in these subjects, the mean ages indicate that those who had AD were in the 5th and 6th decades of life and were in all likelihood abusing alcohol for long durations. The years of education indicate that the subjects would have been intellectually sophisticated enough to understand and respond to the questionnaire appropriately. Our experience in administering the questionnaire indicated an ease in administration and understanding of the items. Our findings suggest that AD as defined in ICD-10 is a heterogeneous condition. Therefore, any screening questionnaire is likely to require items that tap into physiological, cognitive and behavioural aspects of AD.

In our study population, the parameters of tolerance to the effects of alcohol, the inability to control the intake of alcohol, the phenomenon of withdrawal to the effects of alcohol, morning drinking and the report of friends and family members disapproval of the level of alcohol use and advise of reduction or cessation of drinking were the most significant predictors of an AD status. Our findings suggest that in our study group, the physiological effects of AD were more important than cognitions such as anger at being told to cut down or guilt as enumerated in the CAGE questionnaire. This may reflect the fact that physiological effects being easily and reliably demonstrable may be more commonly accepted than the cognitive aspects which are more likely to be disregarded or may be prone to falsification for social reasons. The inability to cut down or control drinking is a behavioural correlate of AD. As such, it is easily observable and is thus not prone to falsification. This may come about due to uncontrollable craving and a genuine lack of control over drinking behaviour. Morning drinking is reflective of impaired control over craving or the drinking for relief of withdrawal symptoms. It is also easily observable and difficult to conceal. The disapproval of family members and friends to current levels of drinking also indicate the degree of social, occupational dysfunction or use despite obvious adverse consequences. Thus we believe that the items in the questionnaire tap into easily verifiable and observable physiological, behavioural and consequential aspects of AD. Our experience in the administration of this questionnaire also suggests that the items are less prone to be responded to untruthfully. This is because many respondents would be uncomfortable in accepting that they have been neglectful of family and occupational responsibilities, or accepting up to their own cognitions of guilt or anger. Also, many respondents would be more comfortable accepting physiological aspects of tolerance and withdrawal to alcohol in AD. This also holds true for the inability to control the use of alcohol and the disapproval of friends and family members. Secondly, as these attributes are observable by others as well, they are less likely to be reported falsely.

The stage of external validation of the questionnaire reveals that the instrument performed better than the results extrapolated from the initial item selection stage would indicate. This is probably because the fewer number of items meant that the questionnaire could be answered with more accuracy and redundancies were removed. Owing to the fluid nature of emergency services, test-retest and inter-rater reliabilities could not be attempted and calculated. This will remain as a limitation of the study. We also could not formally test the instrument for divergent validity. However, clinical experience suggests that the scores derived are unlikely to correlate with any other clinical measure.

Conclusion

To conclude, our instrument has the following advantages over pre-existing questionnaires. It is designed to provide a current rather than a life-time diagnosis of AD using easily remembered and administered items that have a yes/no answer format that reduces ambiguity and enhances ease of scoring. Therefore, the questionnaire is meant to be used in a particular setting for screening of a particular diagnosis and we believe this will enhance the accuracy of diagnosis. The questionnaire has been designed from inception to be useful in an Indian emergency medical setting where the need for such an instrument is most felt rather than being a translation of another questionnaire designed with another type of population in mind. Finally the items in the questionnaire are in Hindi language and can be used as such rather than sometimes inaccurately mentally translating items in other questionnaires.

However, we would like to stress that the study group comprised of subjects who had presented to the emergency medical services and thus any direct extrapolation to populations attending deaddiction services is premature. It is also pertinent to note that this questionnaire screens only for a possible diagnosis of AD and not abuse or harmful use or hazardous drinking. Hence, it reflects the findings in a group of subjects with possibly more severe alcohol problems.

The final questionnaire that was derived is presented in [Appendix-1].

*=Independent samples t-test, **=Pearson’s Chi-square, p significant if <0.05*=Independent samples t-test, **=Pearson’s Chi-square, p significant if <0.05

References

[1]Prasad R, Alcohol use on the rise in India Lancet 2009 373(9657):17-8.  [Google Scholar]

[2]Das A, Gjerde H, Gopalan SS, Normann PT, Alcohol, drugs, and road traffic crashes in India: a systematic review Traffic Inj Prev 2012 13(6):544-53.  [Google Scholar]

[3]Sarin SK, Bhatt A, Malhotra V, Sachdev G, Jiloha RC, Munjal GC, Pattern of alcohol-related liver disease in dependent alcoholics: the Indian dimension Br J Addict 1988 83(3):279-84.  [Google Scholar]

[4]Gupta R, Singh P, Verma S, Garg D, Standardized Assessment of Depressive Disorders: a replicated study from northern India Acta Psychiatr Scand 1991 84(4):310-12.  [Google Scholar]

[5]Singh SM, Sharma A, The prevalence and correlates of guilt in depression: a study from North India Asian J Psychiatry 2013 6(6):622-23.  [Google Scholar]

[6]Avasthi A, Varma SC, Kulhara P, Nehra R, Grover S, Sharma S, Diagnosis of common mental disorders by using PRIME-MD Patient Health Questionnaire Indian J Med Res 2008 127(2):159-64.  [Google Scholar]

[7]Ewing JA, Detecting alcoholism. The CAGE questionnaire JAMA 1984 252(14):1905-07.  [Google Scholar]

[8]Hodgson R, Alwyn T, John B, Thom B, Smith A, The FAST Alcohol Screening Test Alcohol Alcohol Oxf Oxfs 2002 37(1):61-66.  [Google Scholar]

[9]Bush K, Kivlahan DR, McDonell MB, Fihn SD, Bradley KA, The AUDIT alcohol consumption questions (AUDIT-C): an effective brief screening test for problem drinking. Ambulatory Care Quality Improvement Project (ACQUIP). Alcohol Use Disorders Identification Test Arch Intern Med 1998 158(16):1789-95.  [Google Scholar]

[10]Fiellin DA, Reid MC, O’Connor PG, Screening for alcohol problems in primary care: a systematic review Arch Intern Med 2000 160(13):1977-89.  [Google Scholar]

[11]Forsythe M, Lee GA, The evidence for implementing alcohol screening and intervention in the emergency department - time to act Int Emerg Nurs 2012 20(3):167-72.  [Google Scholar]

[12]D’Onofrio G, Bernstein E, Bernstein J, Woolard RH, Brewer PA, Craig SA, Patients with alcohol problems in the emergency department, part 1: improving detection. SAEM Substance Abuse Task Force. Society for Academic Emergency Medicine Acad Emerg Med Off J Soc Acad Emerg Med 1998 5(12):1200-09.  [Google Scholar]

[13]Nayak MB, Kerr W, Greenfield TK, Pillai A, Not all drinks are created equal: implications for alcohol assessment in India Alcohol Alcohol Oxf Oxfs 2008 43(6):713-18.  [Google Scholar]

[14]Saunders JB, Aasland OG, Babor TF, de la Fuente JR, Grant M, Development of the Alcohol Use Disorders Identification Test (AUDIT): WHO Collaborative Project on Early Detection of Persons with Harmful Alcohol Consumption–II Addict Abingdon Engl 1993 88(6):791-804.  [Google Scholar]

[15]World Health Organization. The ICD-10 classification of mental and behavioural disorders: clinical descriptions and diagnostic guidelines. Geneva: World Health Organization; 1992  [Google Scholar]

[16]Foy A, Kay J, The incidence of alcohol-related problems and the risk of alcohol withdrawal in a general hospital population Drug Alcohol Rev 1995 14(1):49-54.  [Google Scholar]

[17]Sheehan DV, Lecrubier Y, Sheehan KH, Amorim P, Janavs J, Weiller E, The Mini-International Neuropsychiatric Interview (M.I.N.I.): the development and validation of a structured diagnostic psychiatric interview for DSM-IV and ICD-10 J Clin Psychiatry 1998 59(Suppl 20):22-33;quiz.:34-57.  [Google Scholar]

[18]Akobeng AK, Understanding diagnostic tests 3: Receiver operating characteristic curves Acta Paediatr (Oslo Nor 1992) 2007 96(5):644-47.  [Google Scholar]

[19]Bleeker SE, Moll HA, Steyerberg EW, Donders ART, Derksen-Lubsen G, Grobbee DE, External validation is necessary in prediction research: a clinical example J Clin Epidemiol 2003 56(9):826-32.  [Google Scholar]

[20]SPSS Inc. SPSS for Windows. Chicago; 2009  [Google Scholar]

[21]Sijtsma K, On the Use, the Misuse, and the Very Limited Usefulness of Cronbach’s Alpha Psychometrika 2009 74(1):107-20.  [Google Scholar]

[22]Zweig MH, Campbell G, Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine Clin Chem 1993 39(4):561-77.  [Google Scholar]

[23]Murray CJ, Lopez AD, Global mortality, disability, and the contribution of risk factors: Global Burden of Disease Study The Lancet 1997 349(9063):1436-42.  [Google Scholar]

[24]Murthy P, Manjunatha N, Subodh BN, Chand PK, Benegal V, Substance use and addiction research in India Indian J Psychiatry 2010 52(Suppl 1):S189-99.  [Google Scholar]

[25]Chaudhury S, Das S, Ukil B, Psychological assessment of alcoholism in males Indian J Psychiatry 2006 48(2):114  [Google Scholar]

[26]Nadkarni A, Bhat B, Ebrahim S, Patel V, The course and outcome of alcohol use disorders in men in Goa: A population- based follow-up study Indian J Psychiatry 2013 55(4):376  [Google Scholar]

[27]Saitz R, Introduction to alcohol withdrawal Alcohol Health Res World 1998 22(1):5-12.  [Google Scholar]