3 recherche sur le mot-clé 'Inter-rater reliability'

Inter-rater reliability of parent and preschool teacher ratings of language in children with autism / Anders NORDAHL-HANSEN in Research in Autism Spectrum Disorders, 7-11 (November 2013)  

Public ISBD [article]  inResearch in Autism Spectrum Disorders > 7-11 (November 2013) . - p.1391-1396 Titre : Inter-rater reliability of parent and preschool teacher ratings of language in children with autism Type de document : texte imprimé Auteurs : Anders NORDAHL-HANSEN, Auteur ; Anett KAALE, Auteur ; Stein Erik ULVUND, Auteur Article en page(s) : p.1391-1396 Langues : Anglais (eng) Mots-clés : Language  Autism  Inter-rater reliability  MacArthur CDI  Parents  Preschool teachers Index. décimale : PER Périodiques Résumé : Abstract Parent reports such as MacArthur-Bates Communicative Development Inventories (CDIs) have been suggested as a measure of language in young children with autism since this group often score below base levels of direct tests. However, questions have been raised concerning the reliability of report-based assessments. Parents and preschool teachers filled out the CDI–Words amp; Gestures for 55 children diagnosed with autistic disorder. Inter-rater reliability analyses were done for the whole sample and a subgroup of minimally verbal children (n = 28). Further, potential over- or under-estimation, comparing the raters was analyzed. Results suggested excellent to fair inter-rater reliability between parent and preschool teacher. Parents tended to rate the children slightly higher than preschool teachers. However, the differences were small, and most likely due to contextual variations. These findings suggest that parents can be reliable sources of information about language abilities in children with autism. Therefore, when children are difficult to assess through direct tests, parent reports such as the CDI can be a good alternative. En ligne : http://dx.doi.org/10.1016/j.rasd.2013.08.006 Permalink : https://www.cra-rhone-alpes.org/cid/opac_css/index.php?lvl=notice_display&id=215 [article] Inter-rater reliability of parent and preschool teacher ratings of language in children with autism [texte imprimé] / Anders NORDAHL-HANSEN, Auteur ; Anett KAALE, Auteur ; Stein Erik ULVUND, Auteur . - p.1391-1396. Langues : Anglais (eng) in Research in Autism Spectrum Disorders > 7-11 (November 2013) . - p.1391-1396 Mots-clés : Language  Autism  Inter-rater reliability  MacArthur CDI  Parents  Preschool teachers Index. décimale : PER Périodiques Résumé : Abstract Parent reports such as MacArthur-Bates Communicative Development Inventories (CDIs) have been suggested as a measure of language in young children with autism since this group often score below base levels of direct tests. However, questions have been raised concerning the reliability of report-based assessments. Parents and preschool teachers filled out the CDI–Words amp; Gestures for 55 children diagnosed with autistic disorder. Inter-rater reliability analyses were done for the whole sample and a subgroup of minimally verbal children (n = 28). Further, potential over- or under-estimation, comparing the raters was analyzed. Results suggested excellent to fair inter-rater reliability between parent and preschool teacher. Parents tended to rate the children slightly higher than preschool teachers. However, the differences were small, and most likely due to contextual variations. These findings suggest that parents can be reliable sources of information about language abilities in children with autism. Therefore, when children are difficult to assess through direct tests, parent reports such as the CDI can be a good alternative. En ligne : http://dx.doi.org/10.1016/j.rasd.2013.08.006 Permalink : https://www.cra-rhone-alpes.org/cid/opac_css/index.php?lvl=notice_display&id=215

Inter-rater reliability of subthreshold psychotic symptoms in individuals with 22q11.2 deletion syndrome / Tyler M. MOORE in Journal of Neurodevelopmental Disorders, 13 (2021)  

Public ISBD [article]  inJournal of Neurodevelopmental Disorders > 13 (2021) Titre : Inter-rater reliability of subthreshold psychotic symptoms in individuals with 22q11.2 deletion syndrome Type de document : texte imprimé Auteurs : Tyler M. MOORE, Auteur ; Deby SALZER, Auteur ; Carrie E. BEARDEN, Auteur ; Monica E. CALKINS, Auteur ; Wendy R. KATES, Auteur ; Leila KUSHAN, Auteur ; Robert Sean GALLAGHER, Auteur ; Dafna Sofrin FRUMER, Auteur ; Ronnie WEINBERGER, Auteur ; Donna M. MCDONALD-MCGINN, Auteur ; Raquel E. GUR, Auteur ; Doron GOTHELF, Auteur Langues : Anglais (eng) Mots-clés : Adolescent  Adult  Autism Spectrum Disorder  Child  DiGeorge Syndrome  Female  Humans  Male  Marfan Syndrome  Psychotic Disorders  Reproducibility of Results  Young Adult  DiGeorge  Inter-rater reliability  Psychosis risk syndrome  Scale of Prodromal Symptoms (SOPS)  Structured Interview for Prodromal Syndromes (SIPS)  Subthreshold psychotic symptoms  Velocardiofacial syndrome Index. décimale : PER Périodiques Résumé : BACKGROUND: Pathways leading to psychosis in 22q11.2 deletion syndrome (22q11.2DS) have been the focus of intensive research during the last two decades. One of the common clinical risk factors for the evolution of psychosis in 22q11.2DS is the presence of positive and negative subthreshold psychotic symptoms. The gold standard for measuring subthreshold symptoms is the Structured Interview for Prodromal Syndromes (SIPS) and its accompanying Scale of Prodromal Symptoms (SOPS) ratings. Although the scale has been used by many centers studying 22q11.2DS, the inter-site reliability of the scale in this population has never been established. METHODS: In the present study, experienced clinical assessors from three large international centers studying 22q11.2DS independently rated video recordings of 18 adolescents and young adults with 22q11.2DS. RESULTS: The intraclass correlations coefficients (ICCs) among three raters for the SOPS total scores, as well as for the positive, negative, and disorganization subscale scores, were good-to-excellent (ICCs range 0.73-0.93). The raters were also able to reliably determine the subjects' subthreshold syndrome status (ICC = 0.71). The reliability of individual items was good-to-excellent for all items, ranging from 0.61 for motor disturbances [G3] to 0.95 for bizarre thinking. CONCLUSIONS: Our results show that trained clinicians can reliably screen for subthreshold psychotic symptoms in individuals with 22q11.2DS. To increase assessment reliability, we suggest specific clarifications and simplifications to the standard SIPS interview for future studies. En ligne : https://dx.doi.org/10.1186/s11689-021-09372-3 Permalink : https://www.cra-rhone-alpes.org/cid/opac_css/index.php?lvl=notice_display&id=574 [article] Inter-rater reliability of subthreshold psychotic symptoms in individuals with 22q11.2 deletion syndrome [texte imprimé] / Tyler M. MOORE, Auteur ; Deby SALZER, Auteur ; Carrie E. BEARDEN, Auteur ; Monica E. CALKINS, Auteur ; Wendy R. KATES, Auteur ; Leila KUSHAN, Auteur ; Robert Sean GALLAGHER, Auteur ; Dafna Sofrin FRUMER, Auteur ; Ronnie WEINBERGER, Auteur ; Donna M. MCDONALD-MCGINN, Auteur ; Raquel E. GUR, Auteur ; Doron GOTHELF, Auteur. Langues : Anglais (eng) in Journal of Neurodevelopmental Disorders > 13 (2021) Mots-clés : Adolescent  Adult  Autism Spectrum Disorder  Child  DiGeorge Syndrome  Female  Humans  Male  Marfan Syndrome  Psychotic Disorders  Reproducibility of Results  Young Adult  DiGeorge  Inter-rater reliability  Psychosis risk syndrome  Scale of Prodromal Symptoms (SOPS)  Structured Interview for Prodromal Syndromes (SIPS)  Subthreshold psychotic symptoms  Velocardiofacial syndrome Index. décimale : PER Périodiques Résumé : BACKGROUND: Pathways leading to psychosis in 22q11.2 deletion syndrome (22q11.2DS) have been the focus of intensive research during the last two decades. One of the common clinical risk factors for the evolution of psychosis in 22q11.2DS is the presence of positive and negative subthreshold psychotic symptoms. The gold standard for measuring subthreshold symptoms is the Structured Interview for Prodromal Syndromes (SIPS) and its accompanying Scale of Prodromal Symptoms (SOPS) ratings. Although the scale has been used by many centers studying 22q11.2DS, the inter-site reliability of the scale in this population has never been established. METHODS: In the present study, experienced clinical assessors from three large international centers studying 22q11.2DS independently rated video recordings of 18 adolescents and young adults with 22q11.2DS. RESULTS: The intraclass correlations coefficients (ICCs) among three raters for the SOPS total scores, as well as for the positive, negative, and disorganization subscale scores, were good-to-excellent (ICCs range 0.73-0.93). The raters were also able to reliably determine the subjects' subthreshold syndrome status (ICC = 0.71). The reliability of individual items was good-to-excellent for all items, ranging from 0.61 for motor disturbances [G3] to 0.95 for bizarre thinking. CONCLUSIONS: Our results show that trained clinicians can reliably screen for subthreshold psychotic symptoms in individuals with 22q11.2DS. To increase assessment reliability, we suggest specific clarifications and simplifications to the standard SIPS interview for future studies. En ligne : https://dx.doi.org/10.1186/s11689-021-09372-3 Permalink : https://www.cra-rhone-alpes.org/cid/opac_css/index.php?lvl=notice_display&id=574

Reliability of the ADI-R for the Single Case-Part II: Clinical Versus Statistical Significance / Domenic V. CICCHETTI in Journal of Autism and Developmental Disorders, 44-12 (December 2014)  

Public ISBD [article]  inJournal of Autism and Developmental Disorders > 44-12 (December 2014) . - p.3154-3160 Titre : Reliability of the ADI-R for the Single Case-Part II: Clinical Versus Statistical Significance Type de document : texte imprimé Auteurs : Domenic V. CICCHETTI, Auteur ; Catherine LORD, Auteur ; Kathy KOENIG, Auteur ; Ami KLIN, Auteur ; Fred R. VOLKMAR, Auteur Article en page(s) : p.3154-3160 Langues : Anglais (eng) Mots-clés : Autism  Clinical significance  Statistical significance  Inter-rater reliability  Multiple raters, one patient Index. décimale : PER Périodiques Résumé : In an earlier investigation, the authors assessed the reliability of the ADI-R when multiple clinicians evaluated a single case, here a female 3 year old toddler suspected of having an autism spectrum disorder (Cicchetti et al. in J Autism Dev Disord 38:764–770, 2008). Applying the clinical criteria of Cicchetti and Sparrow (Am J Men Def 86:127–137, 1981); and those of Cicchetti et al. (Child Neuropsychol 126–137, 1995): 74 % of the ADI-R items showed 100 % agreement; 6 % showed excellent agreement; 7 % showed good agreement; 3 % manifested average agreement; and the remaining 10 % evidenced poor agreement. In this follow-up investigation, the authors described and applied a novel method for determining levels of statistical significance of the reliability coefficients obtained in the earlier investigation. It is based upon a modification of the Z test for comparing a given level of inter-examiner reliability with a lower limit value of 70 % (Dixon and Massey in Introduction to statistical analysis. McGraw-Hill, New York, 1957). Results indicated that every item producing a clinically acceptable level of inter-examiner reliability was also statistically significant. However, the reverse was not true, since a number of the items with statistically significant reliability levels did not reach levels of agreement that were clinically meaningful. This indicated that clinical significance was an accurate marker of statistical significance. The generalization of these findings to other areas of diagnostic interest and importance is also examined. En ligne : http://dx.doi.org/10.1007/s10803-014-2177-8 Permalink : https://www.cra-rhone-alpes.org/cid/opac_css/index.php?lvl=notice_display&id=243 [article] Reliability of the ADI-R for the Single Case-Part II: Clinical Versus Statistical Significance [texte imprimé] / Domenic V. CICCHETTI, Auteur ; Catherine LORD, Auteur ; Kathy KOENIG, Auteur ; Ami KLIN, Auteur ; Fred R. VOLKMAR, Auteur . - p.3154-3160. Langues : Anglais (eng) in Journal of Autism and Developmental Disorders > 44-12 (December 2014) . - p.3154-3160 Mots-clés : Autism  Clinical significance  Statistical significance  Inter-rater reliability  Multiple raters, one patient Index. décimale : PER Périodiques Résumé : In an earlier investigation, the authors assessed the reliability of the ADI-R when multiple clinicians evaluated a single case, here a female 3 year old toddler suspected of having an autism spectrum disorder (Cicchetti et al. in J Autism Dev Disord 38:764–770, 2008). Applying the clinical criteria of Cicchetti and Sparrow (Am J Men Def 86:127–137, 1981); and those of Cicchetti et al. (Child Neuropsychol 126–137, 1995): 74 % of the ADI-R items showed 100 % agreement; 6 % showed excellent agreement; 7 % showed good agreement; 3 % manifested average agreement; and the remaining 10 % evidenced poor agreement. In this follow-up investigation, the authors described and applied a novel method for determining levels of statistical significance of the reliability coefficients obtained in the earlier investigation. It is based upon a modification of the Z test for comparing a given level of inter-examiner reliability with a lower limit value of 70 % (Dixon and Massey in Introduction to statistical analysis. McGraw-Hill, New York, 1957). Results indicated that every item producing a clinically acceptable level of inter-examiner reliability was also statistically significant. However, the reverse was not true, since a number of the items with statistically significant reliability levels did not reach levels of agreement that were clinically meaningful. This indicated that clinical significance was an accurate marker of statistical significance. The generalization of these findings to other areas of diagnostic interest and importance is also examined. En ligne : http://dx.doi.org/10.1007/s10803-014-2177-8 Permalink : https://www.cra-rhone-alpes.org/cid/opac_css/index.php?lvl=notice_display&id=243