JCDR - Register at Journal of Clinical and Diagnostic Research
Journal of Clinical and Diagnostic Research, ISSN - 0973 - 709X
Paediatrics Section DOI : 10.7860/JCDR/2014/8243.4527
Year : 2014 | Month : Jul | Volume : 8 | Issue : 7 Full Version Page : PC01 - PC09

An Exploratory Survey for Understanding Perceptions, Knowledge and Educational Needs of General Practitioners (GSs) Regarding Autistic Disorders in New South Wales (NSW), Australia

Pankaj Garg1, David Lillystone2, David Dossetor3, Carolyn Kefford4, Shanley Chong5

1 Community Paediatric Registrar, Hornsby Ku-Ring Gai Hospital and Hornsby Community Health Centre, HORNSBY, NSW.
2 Senior Community Paediatrician, Palmerston Road, Hornsby Hospital, Hornsby, NSW, Australia.
3 Senior Child Psychiatrist, The Children Hospital at Westmead, NSW.
4 Senior Academic General Practitioner, Hornsby Hospital, Hornsby, NSW.
5 Biostatistician, Centre for Research Evidence and Management, South West Sydney LHD, NSW, Australia.


NAME, ADDRESS, E-MAIL ID OF THE CORRESPONDING AUTHOR: Dr. Pankaj Garg, Department of Community Paediatrics, Liverpool Hospital, Liverpool, NSW 2170 Australia
Phone: +61 421358094,
E-mail: Pankaj.garg1@yahoo.com
Abstract

Aim: A survey was conducted to ascertain General Practitioners (GPs’) perceptions, knowledge and educational needs regarding autistic disorders in childhood.

Methods: A concurrent mixed method approach was used for data collection and analysis. Exploratory factor analysis (EFA) of the data was done and groups were compared using appropriate statistical tests.

Results: There was more response from female GPs, Australian medical graduates and those with an interest in mental and /or child health. Variability was noted in how GPs perceived their competence and knowledge of autistic disorders. About 60% correctly believed that an early-individualised treatment programme was evidence based. Knowledge was inversely related to the number of years in practice and enhanced by personal involvement with children of these disorders and awareness of community resources. Parallel analysis of knowledge scale revealed a “general knowledge” dimension loading items helpful for early identification and referral and a “surveillance” dimension helpful for ongoing involvement of GPs for management of children with ASDs.

Conclusions: Although further development and refinement of knowledge questionnaire using these dimensions for primary care physicians are needed these are relevant target areas for education.

Keywords

Introduction

Early identification of Autism Spectrum Disorders (ASDs) is vital as it facilitates the process of referral to specialist services and lead to early individualised intervention for children with these disorders [1]. Primary health care (PHC) providers such as General Practitioners (GPs) provide a gateway to specialist services [2]. In Australia, GPs are the primary paediatric providers and an average of 4.7 per 100 of their encounters are for providing immunization to children [3]. This places them at a unique position to screen children for early identification of ASDs. However, this could be a challenge due to structural barriers such as resources and reimbursement for extra time for consultation, diversity of clientele, diagnostic uncertainties for these disorders and a lack of consensus on the best screening strategy [48]. Professional organizations like the American Academy of Paediatrics (AAP) and Royal Australian College of General Practitioners (RACGP) emphasize the need to identify early signs of autism by primary care providers [911]. The two commonly suggested strategies include either the use of standardized developmental screening tools for well childcare visits or a red flag approach for five early signs of ASDs [10, 12]. The other challenges for GPs are the unclear reasons for the increasing prevalence of these disorders and the recent changes in the diagnostic categories of pervasive developmental disorders (PDDs) in Diagnostic and Statistical Manual of Mental Disorders, Fifth Edition (DSM-5)-V [5,1317].

This rapidly changing and uncertain landscape of ASDs creates a dilemma for PHC providers. Qualitative research from Australia and North America points to hesitancy of GPs to refer early as a factor contributing to a delay in diagnosis of children with autistic disorders [1820]. There is paucity of published literature on the importance of these disorders to GPs in Australia. Specifically the gaps in the literature include:

1. How often do GPs see children with autistic disorders and consider the diagnosis within their practices? (i.e., the relevance of autistic disorder to GPs)

2. What perceptions do GPs have about their ability (confidence and competence) to manage these disorders? What are their perceptions about the services, their beliefs in prescribing psychotropic medications and how aware are they of community resources in their region?

3. What knowledge (i.e. factual awareness of early signs, diagnostic features and management) of the condition do GPs have and what are their educational needs?

In order to explore the above research questions we conducted a survey of GPs in the state of New South Wales (NSW) in Australia. We felt challenged as to which terminology (PDDs, ASDs, Autism or Autistic disorder) to use in the survey. We preferred to use the term “Autistic Disorder” as it is known that GPs are more likely to consider the classical diagnostic concepts of autism, which correspond to the Autistic Disorder category of DSM-IV-TR [21].

Methods

The study was approved by the Northern Sydney Central Coast Area Health Service (NSCCAHS) Ethics Committee (Protocol Number, HREC-1102-076 M).

Sample Selection

There are several demographic variations for GPs in NSW based on the region and type of practice (e.g. solo versus larger practices, availability of practice nurses) and country of primary medical qualifications [22]. As a general rule of thumb, obtaining a representative sample from heterogeneous populations requires a minimum of 100 subjects for major groups (e.g. region of practice, gender) and 20 to 50 subjects for minor subgroups (e.g. such as GPs with specific areas of interest) [23]. Anticipating a response rate of 25-30 % from previous surveys done with GPs in NSW, 1185 questionnaires were posted. A simple random sample selection method from the health provider’s directory of the Northern Sydney District Health Network was used. This directory maintains the database of GPs across the state and was last updated in the year 2009-2010. Thus, the final sample frame consisted of 734 GPs from the urban/metropolitan regions, 237 from the regional areas and 214 from the rural/remote areas of NSW.

Design and Pre-Testing of the Questionnaire

The most commonly used instrument for evaluating knowledge of health professionals regarding ASDs was developed in 1987 [24]. It contained 22 Likert scale questions on beliefs regarding ASDs and 18 descriptors of behavior, intellect and symptomatology associated with these disorders. It was felt by the authors that this scale may not be sufficient for evaluating knowledge of primary care physicians due to rapid changes in the understanding of ASDs in the last two decades. Further factors unique to GPs such as the time constraints, diverse nature of practices cutting across disciplines of medicine and care provision across life span need to be considered. This suggested that questionnaires which capture not only the knowledge but also the relevance of these disorders to GPs may be more suitable. Factors such as the time constraints may be the reason why recent studies with GPs have used knowledge questionnaires using true/ false questions [25, 26]. For the purpose of understanding the broad research questions of the current study a brief questionnaire was developed (available on request from the author). The aim was to capture both qualitative and quantitative information with an emphasis on quantitative data.

Section A collected demographic information on age, years of practice, number of clinical sessions worked, country of primary medical qualification, region of practice and any areas of special interests.

Section B was designed to measure the “relevance”, “perceptions” of GPs as well as understand perceived educational needs and referral choices for children with autistic disorders. The items of the perceptions and relevance scale were scored on a linear scale to achieve a composite score (score range 1-10 and 2-12 for perceptions and relevance scales respectively). An example of how this was done is that question 1 of the relevance scale was scored from 0-4 and questions two and three from 1-4. This provided an opportunity to explore the potential relationship between knowledge, perceptions and relevance scores.

Section C contained 14 true/false type knowledge questions identified from the recent literature on ASDs. The questions were chosen to include domains of knowledge likely to be relevant to GPs. Refinement of the wordings of questions was done based on discussions during the pre-test phase. An “unsure/don’t know” response option was not given in the questionnaire to avoid skewing of the results towards negative [27]. A score of 11 out of 14 questions was taken as a cut-off criterion for knowledge scale. This was based on the T-scores where 75% was equivalent to 11 out of 14 questions. Similar cut-off has been used in an earlier study in Singapore [25]. We also confirmed the high cut-off point of 11 for the knowledge score using the k-means cluster analysis (k = 2) with the nearest centroid-sorting method [28, 29]. This derived two statistical group’s one forming the high cluster (i.e. those with the highest centroid value) and the other forming low cluster (i.e. those with the lowest centroid value).

Test-Retest Reliability and Clinical Usefulness

Pre-testing of the questionnaire was done on a purposive sample of 15 GPs. These GPs were requested to return the questionnaire twice within a period of two weeks. Out of them, 10 returned the questionnaire twice and seven achieved above cut-off score at both time points. Intra-class correlation coefficient for the paired GPs at two points was 0.59, which is fair [30]. Further no significant differences were evident in the mean total scores using paired t- test [Mean difference (MD) -0.1, Standard error of MD 0.45, p-value =0.8].

An “Ease Of Use (EOU)” questionnaire with Likert type responses was used to evaluate simplicity and usefulness of the questionnaire to GPs [31]. All GPs participating in the pretest phase found the questionnaire simple and easy to use so no major changes were made to the questionnaire.

Data Collection and Analysis

An information sheet, a personalised request letter, an anonymous questionnaire (coded to avoid duplication of GPs who had already participated in pretest phase) and a self-addressed reply paid envelope was posted in June 2011. An educational resource on ASDs was offered as an incentive for participation [32]. Reminders were sent within four weeks of the first posting. Administrative general practice divisions of NSW were contacted to further encourage participation.

Four hundred seven (34.3%) of surveys were returned out of which, 191 (16.1%) were completed while 216 (18.2%) unfilled questionnaires were returned mostly due to outdated addresses. This was not surprising as there is known inequality of provider continuity with GPs in Australia [33]. It was not possible to determine how non-respondents differed from respondents, because the lists comprising the sample frame did not contain descriptive data.

After data collection, internal consistency of the subscales of the questionnaire was checked using Cronbach alpha while the conceptual constructs of relevance, perceptions and knowledge scale were tested using Exploratory Factor Analysis (EFA).

Internal Consistency

The Cronbach alpha for knowledge and Relevance scale was 0.47 and 0.57 respectively. There was poor internal consistency among items of perceptions scale reflecting the highly subjective nature of this scale. Although the Cronbach alpha scores obtained were sub-optimal [30], similar Cronbach scores have been obtained in many other studies using true/false questions [34, 35].

Factor Analysis

Principal axis factoring with an oblique rotation method (Promax) was used [36]. The sample size was appropriate to run an EFA (Kaiser-Meyer-Olkin measure >0.5). Items which loaded into extracted factors with coefficients of more than 0.3 were generally considered except where clinical relevance was evident for variables loading with coefficients between 0.1-0.3. Factor analysis was done using IBM SPSS Statistics for Windows, Version 21.0. Armonk, NY. In order to overcome the potential problems of factor analysis of binary responses of knowledge scale such as non-normal distribution of responses, an optimal implementation of parallel analysis was done using computer program “FACTOR” [37]. This program uses a polychoric correlation matrix suitable for binary variables and overcomes the problem of over-extraction of dimensions in EFA. The results were further verified using SPSS syntax for Parallel analysis [38].

Quantitative Analysis

We explored the association of baseline variables with knowledge score by treating it both as categorical variable (>11 vs. ≤11 correct responses) and continuous variable. For baseline variables continuous data was used whenever available except number of children with autism under care and new diagnosis of autism under care as data for these variables was only collected categorically. Baseline data of perceptions scale was coded for analysis as elaborated earlier.

Chi-square tests were used to explore the associations between knowledge scores as a binary variable and baseline categorical variables. Non-parametric methods were used to compare continuous dependent variable (knowledge scores as continuous variable) and baseline categorical variables. Univariate linear regression was used to examine the relationship between knowledge scores as continuous variable and baseline continuous variables. Pearson correlation coefficients were used to explore strength of relationship between significant baseline variables with knowledge score and between perceptions and relevance scores with knowledge score.

To analyse potential predictors for knowledge scores, variables (age, years in practice, new diagnosis of autism every year, self-perceived competence for ASD, awareness of community resources and perception of services) with p-value <0.25 in univariate analyses were included in a multivariate linear regression model. Due to the left skewed distribution of knowledge score, a power of two transformations was performed and distribution for transformed knowledge score was checked with normality plot of residuals.

Analyses were performed using SAS version 9.2 (SAS Institute. SAS: statistical software. 9.1 ed. Cary, North Carolina. SAS Institute, 2003).

Qualitative Analysis

Perspectives of GPs regarding their self-perceived educational needs, use of medications in children with autistic disorders and other comments made by them were explored using thematic analysis of the qualitative data. Coding of the qualitative data was done by reading sentences for recurring words and then by identifying patterns for themes [39]. Interpretations of qualitative findings were made to integrate results obtained from the quantitative data.

Results

A total of 191 (16.1%) completed questionnaires were analysed. Five GPs did not attempt any questions of the knowledge scale, while two attempted less than five questions (excluded from univariate and multivariate analysis). The proportions of GPs achieving correct answers to questions are shown in [Table/Fig-1]. Majority of GPs achieved satisfactory responses to these questions except failing to recognize the age of onset cut-off criteria in DSM-IV-TR. The baseline demographic characteristics of the participating GPs as compared to GPs in NSW and Australia are highlighted in [Table/Fig-2]. The sample obtained in the study was representative with regards to age and region of practice of GPs in NSW. However, more female GPs (not significant, p=0.06) and graduates from Australian medical schools (77%) responded [Table/Fig-2]. Twenty-five (13%) participants with primary medical qualification from a non-English speaking region responded [Indian subcontinent (13), Singapore (4), Hong Kong (1), South America (3), Middle eastern region (3), Eastern Europe (1)]. Similarly, more GPs with an interest in mental and/or child health responded (38% of respondents).

Proportion of GPs with correct responses to questions

QuestionN (%)a
Diagnosis can be made solely on parental report of child’s development/behaviour at home162(87.1)
DSM IV criterion includes abnormal functioning/delay in three areas with onset after 3 yearsb 36(19.3)
Evidence based treatment is an early individualized education based program112(60.2)
MMR vaccine should be deferred in suspected Autistic disorders171(91.9)
Visual cues should be discouraged to improve verbal communication135(72.5)
Change in prevalence of Autistic disorder in school aged children compared to pre-schoolers140(75.3)
Prevalence of ASDs in preschoolers in Australia125(67.9)
Toddlers with autism often have suspected deafness and speech delay165 (89.6)
The diagnosis can be made in a language impaired child157 (84.4)
Boys should be explored for a possibility of Fragile X syndrome126 (68.4)
M-CHAT is a useful screening tool166 (92.4)
IQ status of children with ASDs
Role of medications in children with ASDs176 (95.6)
Risk of ASDs in siblings is increased 20 to 40 fold137 (74.5)

a186 GPs completed the knowledge scale, Missing response to questions on knowledge scale were taken as wrong bThe wording of DSM IV criteria was changed to “onset after 3 years” instead of “onset prior to age 3 years


Characteristics of respondents as compared to characteristics of GPs in NSW and Australia

CharacteristicSurvey respondents N (%)aNSWb 2010-2011 N(%), p-valueAustraliab 2010-2011 N(%), p-value
Number191865427639
Gender95(49.7)5134(59.3), 0.0716357(59.9), 0.06
Male96(50.3)3520(40.7)11282(40.1)
Female
Age proportion48 (25.7)2543 (29.3), 0.79144(33), 0.4
30-4662 (33.1)2520 (29.1), 0.68375(30.3), 0.7
47-5577 (41.2)3591 (41.6), 0.9710120(36.7), 0.5
>55
Place of graduation Australia Overseas145 (77.1) 43 (22.9)5507(63.6), 0.001c* 3147(36.4), 0.0917686(63.9), 0.001 c* 9953 (36.1), 0.1
Place of practice Metropolitan Inner Regional Rural(Outer regional)/Remote125(65.8) 39(20.5) 26(13.7)6351(73.3), 0.07 1820(21.1), 0.9 483 (5.6), 0.218645(67.5), 0.7 5461 (19.7), 0.9 3533 (12.8), 0.9

a Some characteristics (variables) have less than 191 responses b GP Practice workforce statistics accessed from the Australian Government, Department of health and ageing website and includes GP registrars in training. The total number includes those GPs providing at least one claim for Medicare health service (public funded health insurance scheme for Australian citizens and residents),p- values are calculated in comparison to survey respondents c Statistically significant using Chi-square test for comparison of proportions


Univariate Analysis

Overall, 62% GPs achieved above cut-off score (≥11 correct answers) in the knowledge scale. More GPs with primary medical qualification from Australia achieved above cut-off score (64.4% vs. 48.8%, Chi-square test, p =0.04) [Table/Fig-3]. Other demographic characteristics were not different between GPs achieving above cut-off versus those achieving below cut-off.

Association between GPs characteristics with proportion achieving above cut-off scores

Characteristica<11 n=69≥11 n=115Statistical test
Age yrs
Median56.552.0Kruskal Wallis, p-value=0.01*
Gender, n (%)
Female Male30 (33.7)59 (66.3)χ2 test, p-value=0.28
40(42.1)55 (57.1)
Years in practice
Median29.525.0Kruskal Wallis, p-value=0.01*
Country of primary qualification
Australia Others51 (35.6)92(64.4)χ2 test, p-value=0.04*
21 (51.2)20(48.8)
Primary region of practice
Rural/remote Urban/metropolitan Regional9(34.6)17 (63.4)χ2 test, p-value=0.66
49 (40.8)71(59.2)
15 (38.4)23 (62.6)
Number clinical sessions
Median8.07.25Kruskal Wallis, p-value=0.93
Specific field of Interest
None Mental health/Pediatrics Others23(34.8)43 (65.2)χ2 test, p-value=0.30
21 (41.1)30 (58.9)
30(44.7)37 (55.3)

a Knowledge score available for 184 participants


There was a significant inverse relationship between age and years of practice with knowledge score using linear regression analysis [Table/Fig-4].This relationship was significant using Pearson coefficients as well (Pearson correlation coefficients -0.24, p-value<0.0001 and -0.25, p-value=0.001, respectively). There was a difference in knowledge score between GPs perceiving themselves to be competent in screening for autistic disorders (p=0.1, not significant) and those reporting awareness of community resources (p=0.005) [Table/Fig-5].

Relationship between characteristics of GPs and knowledge scores

CharacteristicNaUnivariate analysis
Coefficient95% CIp-value
Age191-1.04-1.60- -0.50<0.001*
Gender
Female955.44-5.07-15.950.31
Male961
Years in practice-1.16-1.72- - 0.60<0.001*
Country of primary qualification
Australia1457.47-5.54-20.470.26
Others431
Primary region of practice
Rural/remote269.89-8.55-28.340.29
Urban/metropolitan1251.95-11.47-15.370.78
Regional391
Number clinical sessions4.79-5.0-14.570.34
Specific field of Interest
None703.97-8.62-16.560.54
Mental health/Paediatrics520.54-12.39-13.470.94
Others691

a Participants for whom knowledge score (available from 184) or information on characteristic was not available were considered missing data *significant


Relationship between relevance and perceptions items with knowledge score

Relevance ItemsNaUnivariate analysis
Coefficient95% CIp-value
Autism under care
1-276-8.43-22.80-5.940.25
>2 - <567-2.86-17.27-11.550.70
≥5341
New Autism Diagnosis per year
<5160-16.13-31.27- -0.990.04*
≥5221
Number of children per week-0.02-0.32-0.280.89
Perceptions items
Self-perceived as confident/competent
Developmental disorders in general
Confident and competent231
Competent but not very confident754.49–11.95-20.920.59
Not confident or competent79-6.84-23.28-9.590.41
Screening for autistic disorders
Yes529.54-1.89-20.960.10
No/somewhat1231
Awareness of community resources
Yes10314.894.47 – 25.310.005*
No771
Perception of services
Good/adequate609.10-8.04-26.240.30
Inadequate10617.801.89-33.710.03*
Unsure/left blank251
Prescribe medications
With support of Specialist1362.26–1.84-16.350.75
On own initiative21-1.66-18.22-14.900.84
Unsure/left blank341

a Participants for whom knowledge score(available from 184) or information on characteristic was not available were considered missing data


A weak but significant relationship existed between overall perception and relevance scores with knowledge scores [Pearson correlation coefficients 0.24 (p=0.001) and 0.15 (p=0.04) respectively].

Multivariate Regression Model

A multivariable regression analysis (variables with p<0.25 on univariate analysis were entered into this model) showed awareness of community resources as a significant factor affecting knowledge score (11.97, 95% CI 1.07-22.88, p=0.03).

Pattern of Medication use

Twenty one GPs (10.9%) reported using psychotropic medications on their own initiative. Out of these 11 reported prescribing risperidone and olanzapine along with other psychotropic medications (three also used mood stabilizers, two reported using clonidine, four used antidepressants and seven used stimulants). Ten reported prescribing Selective Serotonin Reuptake Inhibitors (SSRIs) antidepressants only.

Factor Analysis

A combined EFA of all the relevance, perceptions and knowledge items (true/false question) confirmed these to be separate constructs and a total of 10 factors were extracted accounting for 60% of the variance. Subsequently EFA was run for these three constructs separately.

For the knowledge scale six factors loaded 10 questions to account for 59% of the variance (eigen value >1.0). These factors were identified as the relevant sub-domains of knowledge for GPs and included “clinical suspicion”, “screening and referral”, “diagnostic criteria” “investigations”, “counselling” and “surveillance”. Factor covariance matrix showed strong correlation between the six factors (0.57-2.12). Parallel analysis using Factor program extracted four factors out of which three were group factors. Thus a final bi-factor solution emerged and included one factor which represented general questions on prevalence, risk factors, screening, investigation, counselling and referral and we called this dimension as “General Knowledge” regarding ASDs, while the other factor loaded questions on medications, change in the prevalence of ASDs in school going children compared to toddlers and IQ status of children with ASDs. This factor was called “Surveillance” [Table/Fig-6].

EFA and parallel analysis to understand the construct of knowledge scale as relevant to GPs

Knowledge Scale
FactorClinical constructaQuestions loadedbCoefficientc% variance explained
1General Knowledge regarding autistic disorders (Prevalence, risk factors, Screening, Investigation, counselling and referral)A diagnosis of Autistic Disorder can be made in a language impaired child.0.6535.4
Toddlers with Autistic Disorders often have suspected deafness and delayed speech development.0.48
Modified Checklist for Autism in Toddlers (M-CHAT) is a useful screening tool0.44
Boys with Autistic Disorder should be explored for a possibility of Fragile X syndrome0.83
MMR vaccine should not be deferred in toddlers suspected to have Autistic Disorders0.45
The evidence based treatment is an early individualized educational based program.0.37
Prevalence of ASDs in preschoolers0.25
Risk of ASDs in siblings0.25
Use of visual cues should be encouraged in ASDs0.23
2SurveillancedIntellectual disability (IQ)status in children with Autistic Disorders0.7219.8
The role of medications in managing challenging behaviours in children with Autistic Disorders0.93
Change in prevalence of Autistic Disorders in school aged children versus preschoolers0.61

a Initial EFA extracted six factors but parallel analysis smoothed the results and highlighted two main sub-domains of knowledge regarding autistic disorder as theoretically most relevant to GPs, b Questions presented in this Table are slightly modified statements of the questions asked in the original survey, c Only questions loading into factors with coefficients >0.2 were selected for this scale, Q 3 and Q5 were rogue items, d Items on this dimension need further development


For the perceptions scale four factors with Eigen value >1.0 were loaded and explained more than 62 % variance. Out of four, three were group factors. These factors loaded items of confidence of GPs for autistic disorders into one, GPs belief in prescribing medications and their awareness of community resources into second [Table/Fig-7]. Correlation was evident for these factors (0.3-1.8). Parallel analysis confirmed this scale to be a single construct.

Exploratory factor analysis (EFA) to understand the constructs of relevance and perceptions scale

Relevance scale
FactorClinical constructItems loadedCoefficienta%variance explained
1Relevance of autistic disorders to GPsAutism in care0.6447
New diagnosis made/year0.65
Perceptions scale
1Self-Perceived ConfidenceConfidence/competence screening autistic disorder0.5924.4
Confidence/competence diagnosis autistic disorder0.57
Confidence managing behaviour associated with autistic disorder0.61
2Self-Belief in prescribing medications, community resourcesPrescribe medications in autistic disorders0.7837.8
Prescribe on recommendation of specialist0.61
Awareness of services0.61

a Questions loading onto factors with coefficients >0.3 were selected, Factor covariance matrix showed correlation of factors of perceptions scale, Parallel analysis confirmed perceptions scale to be a single construct


For the relevance scale one factor was extracted on which two items (autism under care and new autism diagnosis/year loaded and accounted for almost 50% of variation with Eigen value of 1.4 [Table/Fig-7].

Emerging Model of Knowledge Construct

EFA revealed knowledge scale as bi-dimensional and the potential influences of perceptions and relevance items on this. Qualitative analysis of comments made by GPs supported this model. A wide range of sources were reported as a source of knowledge for these disorders. Some stated gaining knowledge from their personal experiences from interactions with parents and specialist diagnostic teams (allied health professionals, paediatricians, psychiatrists) while others cited children in their extended family members to be a source of knowledge. Some reported self-directed readings of articles pertaining to ASDs in primary care while others cited attendance at paediatric specific educational programs such as Diploma in Child Health as main sources of information. Some GPs also reported websites of local community resources and schools and programs providing early interventions for children with ASDs as a valuable source of knowledge. A model to understand the knowledge and educational needs of GPs regarding autistic disorders emerged from qualitative and quantitative data and is highlighted in [Table/Fig-8].

Emerging model to understand the nature of knowledge of GPs for autistic disorders

Educational Needs

The main themes identified for education from qualitative data are highlighted in the following quotes of GPs:

Screening/Diagnosis

“Clues to alert to the diagnosis, co-morbidities, ongoing management issues, interactive workshops using case studies”

“(features of) Asperger’s syndrome, less severe ends of spectrum, diagnosis what to look for.....”

Referral Pathways/Services/Resources

“Need to know at a very basic level, recognition and referral pathways locally”

Psychopharmacology Knowledge/Competence

“Don’t have good understanding of medications used in children with these disorders...”

“I am concerned when to cease, interactions, inappropriate use, school management, continued substance abuse, adequate adult person supervision, and cluster usage groups”

Uncertainty in diagnosis and evidence (aetiology, medications)

“Like other community health professionals wonder whether it is a behavioural problem or a biochemical one, single parents seem overrepresented amongst the few patients I have had exposure to”

“I feel there is a huge discrepancy amongst paediatricians and psychiatrists in what they will prescribe”

Role of GPs

Some GPs lamented their only role for passive utilisation for completing forms for the families. This is highlighted in the following quote by a GP practicing for 19 years in a regional area of NSW.

“Children tend to be picked up in play groups, see community/developmental paediatricians, then circulate through range of resources......Many patients actually bypass the GP and come back to us to complete forms”

Perceptions Regarding Health System Factors

Some GPs from rural areas commented on the lack of adequate services in their regions. Inadequate services were also cited for school aged children and adolescents with ASDs. Many GPs reported waiting times to access diagnostic and early intervention services to be a major issue. This was often reported by parents to their GPs.

Only few GPs reported early childhood centres and nurses as important resources for families and health professionals. Some GPs reported lack of clarity of pathways to access new funding programs rolled out for children with disabilities and ASDs by the federal government.

Discussion

We evaluated the relevance, perceptions, knowledge and educational needs of 2.2% of GPs in the state of NSW using a pre-tested questionnaire. The complex multidimensional nature of knowledge of ASDs and the likely influence of perceptions and relevant items was noted from the qualitative comments made by GPs of their interactions with parents and extended family members with children with ASDs as a source of knowledge. These interactions are a tacit source of knowledge acquisition and are often influenced by personal beliefs of families and practitioners. The subjective knowledge acquired from such sources is often difficult to separate from objective knowledge [40].

A theoretical model of knowledge of ASDs for GPs emerged from the data and involved both subjective and objective sources [Table/Fig-8]. This model gains support from an insightful ethnographic study with GPs in the UK, where “knowledge in practice” was shown as a social construct and knowledge acquisition by GPs was informed by their own and colleague’s experiences, their interactions with opinion leaders and patients and other tacit sources of knowledge [41].

This emerging model adds to the existing body of literature on knowledge of primary care practitioners regarding ASDs, which has mostly focused on objective knowledge testing often not taking into account GPs own beliefs, relevance and interest in these disorders [20, 25, 42]. The study thus enhances our understanding of knowledge of GPs using the known selectors of knowledge viz. subjective, inter-subjective and objective domains [40]. This model is similar to the nature of knowledge in other disciplines such as social work [43] and helps in reinforcing the importance of considering context bound information such as practitioners with interest and greater awareness of these disorders in service delivery of children with ASDs [44].

Currently increasing awareness of these disorders and establishing clear pathways for management is the envisioned strategy for service delivery of children with ASDs [45, 46]. The study reinforced that this is appropriate and is likely to be associated with greater knowledge of GPs. In addition the study also emphasises two primary target areas for education of GPs. These include the “general knowledge” dimension relevant for early suspicion and referral and a “surveillance” dimension is important for expanding the role of GPs. This dimension needs to developed further to include items for surveillance for co-morbid medical conditions(such as sleeping difficulties, anxiety, depression), ongoing support to families in managing schooling options, monitoring of changing abilities, medications and ongoing management of challenging emotional and behavioural disturbance associated with ASDs. This model also suggests need for future research for developing specific educational models for ASDs acknowledging previous experiences of practitioners [47].

Although, the relevance of autistic disorders to responding GPs was evident in the present study, variability was demonstrated amongst their knowledge of these disorders. GPs with an interest and knowledge of ASDs responded more. These findings are consistent with studies done in the UK [48] and Canada [49], where an increased “interest and concern” of practitioner accounted for a large proportion of variance in their ability to identify psychiatric illness. Similarly more response from female GPs in the present study is consistent with their ability to be better at delivering preventative activities [50, 51]. Due to small number of responses from practitioners of culturally diverse backgrounds and with primary medical qualifications from developing countries it is difficult to make conclusions on the impact of this factor on knowledge. This is important to research in future studies as there are known gaps in the knowledge of health staff from developing countries in the field of developmental milestones due to more focus on topical diseases of interest [25, 52, 53]. Pham et al., has shown Canadian and local medical graduates to deliver better preventative health care to Medicaid beneficiaries in North America [54]. However, contrary findings have been shown in a survey of GPs in Victoria (Australia) where practitioners receiving basic medical qualifications outside Australia reported more involvement in child public health issues [51]. Rahbar et al., have highlighted in a survey of 348 GPs from Pakistan that only 44.6% had even heard of autism [42].

Lian et al., in a survey of 48 GPs from Singapore has shown their knowledge of autism as less than ideal and some myths to be believed as true [25]. In their study only about one-third achieved cut-off criteria for knowledge items, this is significantly less than 62 % in the present study using the same criteria. In the present study about 8% of GPs reported that Measles, Mumps, Rubella (MMR) vaccine should be withheld in children suspected with ASDs. Although, there were no differences in the knowledge scores for this small subgroup of GPs, this is somewhat concerning as epidemiological studies have not shown such an association [55]. Falagas in a systematic review of literature highlighted conflicting information provided by health professionals as a factor for suboptimal compliance to vaccinations in children in developed countries [56].

In present survey some GPs reported that the diagnosis of autistic disorders could be established by parental report alone. This highlights a gap in their knowledge as maladaptive behaviours associated with these disorders are often pervasive in nature and occur across settings. Thus, educational programs for GPs should stress the need to gather information from other sources such as pre-schools, extended family members and playgroups to validate carers concerns.

Education regarding knowledge of screening tools and early signs of these disorders was perceived as a priority by GPs in present survey. Some GPs (5%) reported using screening tools for autistic disorders within their practices. This finding is similar to 8% screening reported for ASDs in a survey of 255 primary general pediatric providers in Delaware and Milwaukee, North America [8]. The main reasons reported for sub-optimal screening in this study were lack of familiarity with tools, referral made to the specialist or inability to devote enough time for screening. A point that is unclear from this study is the basis on which the primary pediatric providers provided referral to the specialist. It would have been useful to know whether screening for early signs and red flags of these disorders were used to screen children for autism. This is currently considered to be the best screening approach for ASDs in primary care. Chawarska et al., have identified children failing to adopt anticipatory postures such as reaching out to be picked up, less visual attention to social stimuli, smiling in response to others, vocalization and object exploration as early signs of autism [57]. Fillipek and colleagues [10] have identified five red flags mandating immediate referral for further investigations (a) Does not babble or coo by 12 months of age, (b) Does not gesture (point, wave, grasp, etc.) by 12 months of age (c) Does not say single words by 16 months of age (d) Does not say two-word phrases on his or her own (rather than just repeating what someone says to him or her by 24 months of age and (e) Has any loss of any language or social skill at any age.

In NSW routine developmental surveillance is recommended using Parents Evaluation of Developmental Screening (PEDS) tool, which is present in the personal health record of children (commonly referred to as “Blue Book”). This is a broad parent based screening tool and can help in the early identification of ASDs. In a study of 427 children between 18 and 59 months performance patterns on PEDS have been shown to reduce over-referrals for further screening using autism specific tool [58]. In NSW training for PEDS is currently limited to child and family health nurses due to lack of consensus among educators and administrative reasons. This is not an optimal situation as only about a quarter of children more than one year are regularly seen by early childhood nurses in NSW (NSW Ministry of Health 2012). Thus, educational programs for GPs should include training in primary developmental screening tools. Also the utility and effectiveness of autism specific screening tools such as Modified Checklist for Autism in Toddlers (M-CHAT) and Social Communication Questionnaire (SCQ) in primary care settings has to be emphasised [59]. Due to large diverse backgrounds of GPs, cultural beliefs of health professionals for developmental screening need to be recognized and explored further [6062].Collaborative models of care for supporting delivery of preventative activities using screening tools by primary providers also need further exploration [63].

The other identified issue for education was regarding evidence for early intervention models. In present study uncertainty was reflected in the views of GPs regarding efficacy of early intervention. This is critical as current evidence suggests an early-individualized intervention program as the best practice for management of these children [1, 64, 65]. In a systematic review of controlled studies, Lovaas-based approaches, early intensive behavioral intervention variants and the Early Start Denver Model (ESDM) have been shown to improve cognitive performance, language skills, and adaptive behavior skills in young children with ASDs [1]. A recent uncontrolled study has also demonstrated community dissemination of the ESDM using a group-based intervention as effective [66].

The other perceived area of education was psychotropic prescribing for children with autistic disorders particularly evidence base regarding indications and the best practice for surveillance. Most GPs expressed concerns about the overuse of psychotropic medications in children in the present study. This is a valid concern as population based studies have shown inappropriate use of psychotropic medications [67,68]. Fremont and colleagues have highlighted prescribing behaviours of family physicians and pediatricians for psychotropic medications in children [69]. Pediatricians were reported to be more comfortable in prescribing stimulants, atomoxetine and alpha-2 adrenergic agonists while family physicians were more comfortable prescribing antidepressant medications. Similar prescribing pattern is reported by GPs in the present study. The role of psychopharmacology in children with ASDs is well documented now. A number of studies have shown that psychotropic medications in ASDs are often used to target co-morbid symptoms and maladaptive behaviors such as aggression, self-injury, repetitive mannerisms (e.g., perseveration, obsessions, compulsions, and stereotypic movements), mood lability, irritability, anxiety, hyperactivity, inattention, destructive and disruptive patterns [7074]. In an internet based national database of 5181 children (sample consisting of 49% older children 6-11 years, 83% male and 39% with one or more co-morbidity), 35.3% used at least one psychotropic medication [75].

Age of GPs and years of practice were noted to have an inverse relationship with knowledge regarding ASDs. There are three likely explanations for this observation. Firstly, there is an increasing recognition and prevalence of these disorders in the last two decades [13]. Secondly, there is an increased focus on learning disabilities and developmental problems in undergraduate medical curriculum [76]. Thirdly, it is known from studies in North America and Netherlands that factual knowledge not used after five to ten years of certification becomes redundant for daily practice [77, 78].

Awareness of community resources and greater knowledge of ASDs was positively associated with self-perceived competence in developmental disorders. This is supported by studies where self-confidence has been shown to be a related construct with learning abilities of an individual [79].

Limitations/Strengths of the Study

The response rate of present survey is low. This is not unusual for surveys done with GPs and family physicians worldwide. An earlier study done in Australia have highlighted time constraints, increased paper work load, multiple surveys, low priority for an individual GPs practice and lack of reimbursement as main reasons for low response rates [80].

The representativeness and generalisability of findings are limited and results from present study should be interpreted with caution. Although some of the baseline characteristics of GPs in our sample look deviant [Table/Fig-2], rural and regional practitioners from different age groups were represented. We did not use weighting methodologies to overcome the problem of non-response bias in our study as only a weak relationship has been shown to exist between non-response rate and non-response bias [81]. Also as no information was available on the characteristics of non-respondents who received the survey versus those who didn’t (due to outdated addresses) meant that weighting was an inappropriate strategy.

True/false questions were used in the study, which have a lower sensitivity and specificity (due to 50% chance of guessing) compared to clinical vignettes, and multiple choice questions for knowledge assessment [8284]. This was also evident in the present study from explicit comments made by GPs on the questionnaires acknowledging that they guessed some of the responses rather than being certain of the correct answer [79]. However, this is a frequent strategy used in a number of previous studies with GPs where time constraints are an important issue [25, 34, 77, 85].

Strength of our study is that we highlighted the educational needs of GPs using objective knowledge testing and used qualitative data to explain findings. This gave insights into GPs understanding and experiences with children of these disorders.

We performed an EFA to understand the validity of brief true/false knowledge questionnaires to GPs. A bi-dimensional construct of knowledge and the likely influences of items of perceptions scales reflected the complexity of these constructs, necessitating further refinement using confirmatory factor analysis. The items of the “surveillance” dimension of knowledge scale need further development and testing. Also convergent validity of knowledge scale using true/false questions with Stone’s autism survey scale [24] need to be established.

Some of the factors such as the potential impact of the type of practice setting on relevance and knowledge were not explored in the current study. The average age at which GPs considered diagnosis of ASDs within their practices was also not specifically explored.

Conclusions and Implications for Further Research

A significant proportion of GPs consider a diagnosis of autistic disorder within their diverse clinical practices in NSW. Variability in knowledge regarding autistic disorders is affected by a complex set of factors. Age, an increased interest in ASDs, country of qualification, awareness of community resources, and self-perceived confidence in these disorders appear to be relevant. Awareness of community resources emerged as an independent factor influencing knowledge in the present study. There is a need for education in the dimensions of general knowledge focused on early identification and referral (early signs and utilisation of screening tools for autistic disorders, emphasis on importance of early intervention) and further expansion of role in ongoing surveillance activities such as psychopharmacology and outcomes. This is important as current evidence shows that delay in identification and early intervention of children with ASDs lead to poorer outcomes later in life such as placement in special education settings, residence in group home settings, poorer mental health outcomes, employment status and other related co-morbidities such as epilepsy and mortality. Further validation studies using larger sample sizes are needed to test the knowledge model highlighted in the study.

A lack of published literature on child health surveillance at primary care in Australia was noted. A larger multi-site, multi-partners “Watch Me Grow” study is currently underway in NSW. This study has both qualitative and quantitative arms and is exploring perspectives of primary care providers such as GPs, child and family health nurses, practice nurses and users (parents) regarding surveillance for developmental disorders in different contexts. A large cohort of children from newborns to 18 months is prospectively enrolled in this study to understand factors affecting developmental surveillance. Future research should also explore data from national and state surveys and Medicare claims for items specific to child health surveillance and ASDs. In depth case studies of different setting general practices for factors affecting delivery of child health surveillance activities will increase our theoretical understanding for service delivery for children with autistic disorders in primary care.

a186 GPs completed the knowledge scale, Missing response to questions on knowledge scale were taken as wrong bThe wording of DSM IV criteria was changed to “onset after 3 years” instead of “onset prior to age 3 yearsa Some characteristics (variables) have less than 191 responses b GP Practice workforce statistics accessed from the Australian Government, Department of health and ageing website and includes GP registrars in training. The total number includes those GPs providing at least one claim for Medicare health service (public funded health insurance scheme for Australian citizens and residents),p- values are calculated in comparison to survey respondents c Statistically significant using Chi-square test for comparison of proportions

References

[1]Warren Z, McPheeters ML, Sathe N, Foss-Feig JH, Glasser A, Veenstra-VanderWeele J, A systematic review of early intensive intervention for autism spectrum disorders Pediatrics 2011 127:e1303-e11.  [Google Scholar]

[2]Zwaigenbaum L, Bryson S, Lord C, Rogers S, Carter A, Carver L, Clinical assessment and management of toddlers with suspected autism spectrum disorder: insights from studies of high-risk infants Pediatrics 2009 123:1383-91.  [Google Scholar]

[3]Britt Miller GC, Charles J, Henderson J, Valenti L, Harrison C, A decade of Australian general practice activity2002–03 to 2011–12. General practice series no. 32 2012 SydneySydney University Press  [Google Scholar]

[4]Dossetor DR, Responding to diagnostic uncertainties of autistic spectrum disorders: Facing the challenges Journal of Paediatrics and Child Health 2005 41:405-06.  [Google Scholar]

[5]Williams K, Tuck M, Helmer M, Bartak L, Mellis C, Peat JK, Diagnostic labelling of autism spectrum disorders in NSW Journal of Paediatrics and Child Health 2008 44:108-13.  [Google Scholar]

[6]Goin-Kochel RP, Mackintosh VH, Myers BJ, How many doctors does it take to make an autism spectrum diagnosis? Autism 2006 10:439-51.  [Google Scholar]

[7]Jeyendra A, Rajadurai J, Chanmugam J, Trieu T, Nair S, Baskaran R, Australian general Practitioners’ perspectives on their role in well-child health care BMC Family Practice 2013 14:2  [Google Scholar]

[8]Dosreis S, Weiner CL, Johnson L, Newschaffer CJ, Autism spectrum disorder screening and management practices among general pediatric providers Journal of Developmental & Behavioral Pediatrics 2006 27:S88  [Google Scholar]

[9]Johnson CP, Myers SM, Identification and evaluation of children with autism spectrum disorders Pediatrics 2007 120:1183-1215.  [Google Scholar]

[10]Filipek P, Accardo P, Ashwal S, Baranek G, Cook E, Dawson G, Practice parameter: Screening and diagnosis of autism Report of the Quality Standards Subcommittee of the American Academy of Neurology and the Child Neurology Society Neurology 2000 55:468-79.  [Google Scholar]

[11]Tonge B BA, Autism Spectrum Disorders Australian Family Physician 2011 40:672-77.  [Google Scholar]

[12]Barbaresi WJ, Katusic SK, Voigt RG, Autism: a review of the state of the science for pediatric primary health care clinicians Archives of Pediatrics & Adolescent Medicine 2006 160:67  [Google Scholar]

[13]Fombonne E, Epidemiology of autistic disorder and other pervasive developmental disorders The Journal of Clinical Psychiatry 2005 66:3  [Google Scholar]

[14]Nassar N, Dixon G, Bourke J, Bower C, Glasson E, de Klerk N, Autism spectrum disorders in young children: effect of changes in diagnostic practices International Journal of Epidemiology 2009 38:1245-54.  [Google Scholar]

[15]Williams K, MacDermott S, Ridley G, Glasson EJ, Wray JA, The prevalence of autism in Australia. Can it be established from existing data? Journal of Paediatrics and Child Health 2008 44:504-10.  [Google Scholar]

[16]Rutter M, Incidence of autism spectrum disorders: Changes over time and their meaning Acta Paediatrica 2005 94:2-15.  [Google Scholar]

[17]Friedman N, Sadhu J, Jellinek M, DSM-5: Implications for Pediatric Mental Health Care Journal of Developmental & Behavioral Pediatrics 2012 33:163-78.  [Google Scholar]

[18]Valentine K, Rajkovic M, Dinning B, Thompson D, Post-diagnosis support for children with Autism Spectrum Disorder, their families and carers Australian Department of Families, Housing, Community Services and Indigenous Affairs, Occasional Paper 2011   [Google Scholar]

[19]Kennedy T, Regehr G, Rosenfield J, Roberts SW, Lingard LExploring the gap between knowledge and behavior: a qualitative study of clinician action following an educational intervention Academic Medicine. 2004 79:386-93.  [Google Scholar]

[20]Heidgerken AD, Geffken G, Modi A, Frakey L, A survey of autism knowledge in a health care setting Journal of Autism and Developmental Disorders 2005 35:323-30.  [Google Scholar]

[21]Fombonne E, Heavey L, Smeeth L, Rodrigues LC, Cook C, Smith PG, Validation of the diagnosis of autism in general practitioner records BMC Public Health 2004 4:5  [Google Scholar]

[22]Carne Moretti C, Smith B BP, Summary Data Report of the 2009-2010 Annual Survey of Divisions of General Practice. Adelaide: Primary Health Care Research & Information Service, Discipline of General Practice, Flinders University, and Australian Government Department of Health and Ageing 2011   [Google Scholar]

[23]Sudman S, Applied sampling 1976 New YorkAcademic Press  [Google Scholar]

[24]Stone WL, Cross-disciplinary perspectives on autism Journal of Pediatric Psychology 1987 12:615-30.  [Google Scholar]

[25]Lian W, Ho S, Yeo C, Ho L, General practitioners’ knowledge on childhood developmental and behavioural disorders Singapore Medical Journal 2003 44:397-403.  [Google Scholar]

[26]Campbell D, Reichle N, Bourgondien M, The Autism Survey: An evaluation of reliability and validity Journal of Autism and Developmental Disorders 1996 26:621-34.  [Google Scholar]

[27]Poe GS, Seeman I, McLaughlin J, Mehl E, Dietz M, “Dont Know” Boxes in factual questions in a mail questionnaire effects on level and quality of response Public Opinion Quarterly 1988 52:212-22.  [Google Scholar]

[28]Anderberg M, Cluster analysis for applications 1973 New YorkAcademic Press  [Google Scholar]

[29]Steinley D, K means clustering: A half century synthesis British Journal of Mathematical and Statistical Psychology 2006 59:1-34.  [Google Scholar]

[30]Cicchetti DV, Koenig K, Klin A, Volkmar FR, Paul R, Sparrow S, From Bayes through marginal utility to effect sizes: A guide to understanding the clinical and statistical significance of the results of autism research findings Journal of Autism and Developmental Disorders 2011 41:168-74.  [Google Scholar]

[31]Dias J, Rajan R, Thompson J, Which questionnaire is best? The reliability, validity and ease of use of the Patient Evaluation Measure, the Disabilities of the Arm, Shoulder and Hand and the Michigan Hand Outcome Measure Journal of Hand Surgery (European Volume) 2008 33:9-17.  [Google Scholar]

[32]Acceptance and the Autistic Disorders vol. 3: Child And Adolescent Mental Health State-wide Network (CAMHSNET). 2006  [Google Scholar]

[33]Kljakovic M, Ciszek K, Reynolds G, Colman S, Inequality in provider continuity for children by Australian general practitioners BMC family practice 2011 12:106  [Google Scholar]

[34]Tracey JM, Arroll B, Richmond DE, Barham PM, The validity of general practitioners’ self assessment of knowledge: cross sectional study BMJ 1997 315:1426  [Google Scholar]

[35]Dijksterhuis M, Scheele F, Schuwirth L, Essed G, Nijhuis J, Braat D, Progress testing in postgraduate medical education Medical Teacher. 2009 31:e464-e68.  [Google Scholar]

[36]Matsunaga M, How to factor-analyze your data right: do’s, don’ts, and how-to’s International Journal of Psychological Research 2010 3:97-110.  [Google Scholar]

[37]Lorenzo-Seva U, Ferrando PJ, FACTOR. A computer program to fit the exploratory factor analysis model Behavior Research Methods 2006 38:88-91.  [Google Scholar]

[38]O’connor BP, SPSS and SAS programs for determining the number of components using parallel analysis and Velicer’s MAP test Behavior Research Methods, Instruments, & Computers 2000 32:396-402.  [Google Scholar]

[39]Saldaña J, The coding manual for qualitative researchers 2012 SAGE Publications Limited  [Google Scholar]

[40]Heylighen F, Objective, subjective and intersubjective selectors of knowledge Evolution and Cognition 1997 3:63-67.  [Google Scholar]

[41]Gabbay J, May A. L, Evidence based guidelines or collectively constructed “mindlines?” Ethnographic study of knowledge management in primary care BMJ 2004 329:1013  [Google Scholar]

[42]Rahbar MH, Ibrahim K, Assassi P, Knowledge and attitude of general practitioners regarding autism in Karachi, Pakistan Journal of Autism and Developmental Disorders 2011 41:465-74.  [Google Scholar]

[43]Imre RW, The nature of knowledge in social work Social Work 1984 29:41-45.  [Google Scholar]

[44]Pomerol JC, Brézillon P, About some relationships between knowledge and context In Modeling and Using Context, ed: Springer 2001 :461-64.  [Google Scholar]

[45]Walsh N, Hall I, The Autism Strategy: implications for people with autism and for service development Advances in Mental Health and Intellectual Disabilities 2012 6:113-20.  [Google Scholar]

[46]Dittrich R, Burgess L, Improving autism services in Hampshire: a lifespan approach Journal of Integrated Care 2012 20:296-307.  [Google Scholar]

[47]Newman P, Pei E, Valuing learners’ experience and supporting further growth: educational models to help experienced adult learners in medicine BMJ 2002 325:200-02.  [Google Scholar]

[48]Marks J, Goldberg DP, Hillier V, Determinants of the ability of general practitioners to detect psychiatric illness Psychological Medicine 1979 9:337-53.  [Google Scholar]

[49]Fleury MJ, Imboua A, Aubé D, Farand L, Lambert Y, General practitioners’ management of mental disorders: A rewarding practice with considerable obstacles BMC Family Practice 2012 13:19  [Google Scholar]

[50]Ewing GB, Selassie AW, Lopez CH, McCutcheon EP, Self-report of delivery of clinical preventive services by US physicians: comparing specialty, gender, age, setting of practice, and area of practice American Journal of Preventive Medicine 1999 17:62-72.  [Google Scholar]

[51]Waters EB, Haby MM, Wake M, Salmon LA, Public health and preventive healthcare in children: current practices of Victorian GPs and barriers to participation The Medical Journal of Australia 2000 173:68  [Google Scholar]

[52]Singhi P, Malhi P, Clinical and neurodevelopmental profile of young children with autism Indian Pediatrics 2001 38:384  [Google Scholar]

[53]Bakare MO, Ebigbo PO, Agomoh AO, Eaton J, Onyeama GM, Okonkwo KO, Knowledge about childhood autism and opinion among healthcare workers on availability of facilities and law caring for the needs and rights of children with childhood autism and other developmental disorders in Nigeria BMC pediatrics 2009 9:12  [Google Scholar]

[54]Pham HH, Schrag D, Hargraves JL, Bach PB, Delivery of preventive services to older adults by primary care physicians JAMA The Journal of the American Medical Association 2005 294:473-81.  [Google Scholar]

[55]DeStefano F, Vaccines and autism: evidence does not support a causal association Clinical Pharmacology & Therapeutics 2007 82:756-59.  [Google Scholar]

[56]Falagas M. E, Zarkadoulia E, Factors associated with suboptimal compliance to vaccinations in children in developed countries: a systematic review Current Medical Research and Opinion 2008 24:1719-41.  [Google Scholar]

[57]Chawarska K, Paul R, Klin A, Hannigen S, Dichtel LE, Volkmar F, Parental recognition of developmental problems in toddlers with autism spectrum disorders Journal of Autism and Developmental Disorders 2007 37:62-72.  [Google Scholar]

[58]Glascoe FP, Macias MM, Wegner LM, Robertshaw NS, Can a broadband developmental-behavioral screening test identify children likely to have autism spectrum disorder? Clinical Pediatric 2007 46:801-05.  [Google Scholar]

[59]Robins DL, Screening for autism spectrum disorders in primary care settings Autism 2008 12:537-56.  [Google Scholar]

[60]Campinha-Bacote J, The process of cultural competence in the delivery of healthcare services: A model of care Journal of Transcultural Nursing 2002 13:181-84.  [Google Scholar]

[61]Scherzer AL, Experience in Cambodia With the Use of a Culturally Relevant Developmental Milestone Chart for Children in Low and Middle Income Countries Journal of Policy and Practice in Intellectual Disabilities 2009 6:287-92.  [Google Scholar]

[62]Case R, Changing views of knowledge and their impact on educational research and practice 1996   [Google Scholar]

[63]Schmied V, Mills A, Kruske S, Kemp L, Fowler C, Homer C, The nature and impact of collaboration and integrated service delivery for pregnant women, children and families Journal of Clinical Nursing. 2010 19:3516-26.  [Google Scholar]

[64]Dawson G, Rogers S, Munson J, Smith M, Winter J, Greenson J, Randomized, controlled trial of an intervention for toddlers with autism: the Early Start Denver Model Pediatrics 2010 125:e17-e23.  [Google Scholar]

[65]Eldevik S, Hastings RP, Hughes JC, Jahr E, Eikeseth S, Cross S, Meta-analysis of early intensive behavioral intervention for children with autism Journal of Clinical Child & Adolescent Psychology 2009 38:439-50.  [Google Scholar]

[66]Eapen V, Walter A, Clinical outcomes of an early intervention program for preschool children with Autism Spectrum Disorder in a community group setting BMC Pediatrics 2013 13:3  [Google Scholar]

[67]Isaacs D, Attention deficit/hyperactivity disorder: Are we medicating for social disadvantage?(For) Journal of Paediatrics and Child Health 2006 42:544-47.  [Google Scholar]

[68]Berbatis CG, Sunderland VB, Bulsara M, Licit psychostimulant consumption in Australia, 1984-2000: international and jurisdictional comparison Medical Journal of Australia 2002 177:539-43.  [Google Scholar]

[69]Fremont WP, Nastasi R, Newman N, Roizen NJ, Comfort level of pediatricians and family medicine physicians diagnosing and treating child and adolescent psychiatric disorders The International Journal of Psychiatry in Medicine 2008 38:153-68.  [Google Scholar]

[70]Towbin KE, Strategies for pharmacologic treatment of high functioning autism and Asperger syndrome Child and Adolescent Psychiatric Clinics of North America 2003   [Google Scholar]

[71]Posey DJ, Erickson CA, Stigler KA, McDougle CJ, The use of selective serotonin reuptake inhibitors in autism and related disorders Journal of Child & Adolescent Psychopharmacology 2006 16:181-86.  [Google Scholar]

[72]McCracken JT, McGough J, Shah B, Cronin P, Hong D, Aman MG, Risperidone in children with autism and serious behavioral problems New England Journal of Medicine 2002 347:314-21.  [Google Scholar]

[73]Findling RL, Pharmacologic treatment of behavioral symptoms in autism and pervasive developmental disorders Journal of Clinical Psychiatry 2005 66:26  [Google Scholar]

[74]Ming X, Gordon E, Kang N, Wagner GC, Use of clonidine in children with autism spectrum disorders Brain & Development 2008 30:454-60.  [Google Scholar]

[75]Rosenberg RE, Mandell DS, Farmer JE, Law JK, Marvin AR, Law PA, Psychotropic medication use among children with autism spectrum disorders enrolled in a national registry, 2007–2008 Journal of Autism and Developmental Disorders 2010 40:342-51.  [Google Scholar]

[76]Piachaud J, Teaching learning disability to undergraduate medical students Advances in Psychiatric Treatment 2002 8:334-41.  [Google Scholar]

[77]Leeuwen Y Van, Mol S, Pollemans M, Drop M, Grol R, Vleuten C Van der, Change in knowledge of general practitioners during their professional careers Family Practice 1995 12:313-17.  [Google Scholar]

[78]Leigh TM, Young PR, Haley JV, Performances of family practice diplomates on successive mandatory recertification examinations Academic Medicine 1993 68:912-9.  [Google Scholar]

[79]Kleitman S, Stankov L, Self-confidence and metacognitive processes Learning and Individual Differences 2007 17:161-73.  [Google Scholar]

[80]Khan A, Hussain R, Plummer D, Minichiello V, Too many surveys! Eliciting the views of general practitioners for not participating in postal surveys Australian Journal of Primary Health 2004 10:76-81.  [Google Scholar]

[81]Groves RM, Peytcheva E, The Impact of Nonresponse Rates on Nonresponse Bias A Meta-Analysis Public Opinion Quarterly 2008 72:167-89.  [Google Scholar]

[82]Burton RF, Misinformation, partial knowledge and guessing in true/false tests Medical Education 2002 36:805-11.  [Google Scholar]

[83]Burton RF, Quantifying the effects of chance in multiple choice and true/false tests: question selection and guessing of answers Assessment & Evaluation in Higher Education 2001 26:41-50.  [Google Scholar]

[84]Cronbach LJ, Studies of acquiescence as a factor in the true-false test Journal of Educational Psychology 194 33:401  [Google Scholar]

[85]Khan Awoniyi OA, Dwarakanath LS TR, Assessments in evidence-based medicine workshops: loose conection between perception of knowledge and its objective assessment Medical Teacher 2001 23:92-94.  [Google Scholar]