Young-Sun Lee
Associate Professor of Psychology and Education
212-678-8304
Office Hours: By appointment, so email.
Office Location: 456A Grace Dodge
Expertise
- Assessment and Testing
- Measurement
- Statistics
Young-Sun Lee
Professional Background
Educational Background
Ph.D. University of Wisconsin-Madison, Educational Psychology (Educational Measurement & Statistics), 2002.
M.A. Ewha Womans University, Seoul, South Korea, Educational Measurement & Evaluation, 1995.
B.A. Ewha Womans University , Seoul , South Korea, Education, 1992.
Scholarly Interests
Psychometrics(Classical Test Theory, Item Response Theory, & Cognitive Diagnosis Modeling), Educational and Psychological Measurement, and Applied Statistics
Selected Publications
RECENT PUBLICATIONS
Lee, Y.-S., Park, Y. S., Song, M. Y., Kim, S. E., Lee, Y. J., & In, B. R. (2012). Investigating Score Reporting of Attribute Profiles from the National Assessment of Educational Achievement using Cognitive Diagnostic Models. Journal of Educational Evaluation, 25(3), 411-433. (Written in Korean)
Lee, Y.-S., de la Torre, J., & Park, Y. S. (2012). Cognitive diagnosticity of IRT-constructed assessment: An empirical investigation. Asia Pacific Education Review, 13(2), 333-345.
Park, Y. S., Lee, Y.-S., Lee, Y. J., In, B. R., Kim, S. E., & Song, M. Y. (2012). Multilevel analysis of a cognitive diagnostic model using National Assessment of Educational Achievement: Examining differences between regions. Journal of Educational Evaluation, 25(2), 193-212. (Written in Korean)
Kim, S. E., Park, Y. S., & Lee, Y.-S. (2012). Application of Latent Class Model toMultiple Strategy CDM Analysis. Journal of Educational Evaluation, 25(1), 49-68. (Written in Korean)
Lee, Y.-S., Krishnan, A., & Park, Y. S. (2012). Psychometric properties of the Children's Depression Inventory: An IRT analysis across age in a non-clinical, longitudinal, adolescent sample. Measurement and Evaluation in Counseling and Development. 45(2), 84-100.
Lee, J., & Lee, Y.-S. (2012). The Effects of Testing. In Hattie, J., & Anderman, E., International Guide to Student Achievement. New York: Routledge Publishers.
Lee, Y.-S., Lembke, E.,
Hampton, D. D., Lembke, E. S., Lee, Y.-S., Pappas, S., Chiong, C., & Ginsburg, H. (2012). Technical Adequacy of Early Numeracy Curriculum-Based Progress Monitoring Measures for Kindergarten and First-Grade Students. Assessment for Effective intervention, 37(2), 118-126.
Lee, Y.-S., Park, Y. S., & Taylan, D. (2011). A cognitive diagnostic modeling of attribute mastery in Massachusetts, Minnesota, and the U.S. national sample using the TIMSS 2007. International Journal of Testing, 11, 144-177.
Ginsburg, H. P., Pappas, S., Lee, Y.-S., & Chiong, C. (2011). mCLASS:Math: Insights into Children's Mathematical Minds and Performance. In Noyce, P., & Hickey, D. T., Formative Assessment in Learning Contexts, the Next Generation (pp. 46-97). Harvard Education Press.
Park, Y. S., & Lee, Y.-S. (2011). Diagnostic Cluster Analysis: An Empirical Study of Mathematics Skills via TIMSS 2007. IERI Monograph Series: Issues and Methodologies in Large-Scale Assessments, 4. 75-108.
Kim, S.-H., Sherry, A., Lee, Y.-S., & Kim, C.-D. (2011). Psychometric Properties of a Translated Korean Adult Attachment Measure. Measurement and Evaluation in Counseling and Development, 44, 135-150.
Lee, Y.-S., & Park, Y. S. (2011). Examining the Mastery of Mathematics Skills in Italy Using a Cognitive Diagnostic Model. RicercAzione, 3(1). 59-74.
de la Torre, J., & Lee, Y.-S. (2010). A Note on the Invariance of the DINA Model Parameters. Journal of Educational Measurement, 47(1), 115-127.
Xu, X., Douglas, J., & Lee, Y.-S. (2010). Linking with Nonparametric IRT Models. In von Davier, A. A. (Ed.), Statistical Models for Test Equating, Scaling, and Linking (pp. 243-260). New York
Lee, Y.-S., Cohen, A., & Toro, M. (2009). Examining Type I error and power for detection of differential item and testlet functioning. Asia Pacific Education Review, 10, 365-375.
Lee, Y.-S., Wollack, J., & Douglas, J. (2009). On the use of nonparametric ICC estimation techniques for checking parametric model fit. Educational and Psychological Measurement, 69, 181-197.
Cervellione, K., Lee, Y.-S., & Bonanno, G. A. (2009). Rasch Modeling of the Self-Deception Scale of the Balanced Inventory of Desirable Responding. Educational and Psychological Measurement, 69, 438-458.
Lee, Y.-S., Grossman, J., & Krishnan, A. (2008). Cultural Relevance of Adult Attachment: Rasch Modeling of the Revised Experiences in Close Relationships in a Korean Sample. Educational and Psychological Measurement, 68, 824-844.
Lee, Y.-S. (2007). A Comparison of Methods for Nonparametric Estimation of Item Characteristic Curves for Binary Items. Applied Psychological Measurement, 31(2), 121-134.
Lee, Y.-S., Douglas, J., & Chewning, B. (2007). Techniques For Developing Health Quality of Life Scales For Point of Service Use. Social Indicators Research: An International and Interdisciplinary Journal for Quality-Of-Life Measurement, 83(2), 331-350.
TECHNICAL REPORTS
Kim, C.-D., Lee, Y.-S., Lee, J. Y., Yoo, H. S., Lee, D. H., Oh, I., & Lee, S. M. (2012). Multiphasic Developmental Potential Inventory-Seoul Form: MDPI-S. Seoul Metropolitan Office of Education, Seoul, Republic of Korea.
Song, M.-Y., Lee, Y.-S., & Park, Y. S.(2011). Analysis and score reporting based oncognitivediagnostic models using the National Assessment Educational Achievement. Seoul,Republic of Korea: Korea Institute for Curriculum and Evaluation (KICE)Research Report RRE 2011-8.
Lee, Y.-S., Pappas, S., & Chiong, C., & Ginsburg, H. (2011). mCLASS:MATH -Technical Manual. Brooklyn, NY: Wireless Generation, Inc.
Lee, Y.-S., Park, Y. S., & Lee, S. Y. (2010). Post-Smoothing by Kernel Equating to CompareCollege Scholastic Aptitude Test Performance between Offices of Education viaMultilevel Methods. Seoul, Republic of Korea: Ministry of Education, Science and Technology.
Romero, M., & Lee, Y.-S. (2008). How Maternal, Family and Cumulative Risk Affect Absenteeism in Early Schooling: Facts for Policymakers. New York, NY : National Center for Children in Poverty, Columbia University, Mailman School
Romero, M., & Lee, Y.-S. (2008). Brief #2: The Influence of Maternal and Family Risk on Chronic Absenteeism in Early Schooling. "What data tell us about the role of chronic absenteeism in early schooling?" New York , NY : National Center for Children in Poverty, Columbia University, Mailman School
Lee, Y.-S., Lembke, E., Moore, D., Ginsburg, H., & Pappas, S. (2007). mCLASS:MATH - Identifying technically adequate early mathematics measures. Brooklyn, NY: Wireless Generation, Inc.
Romero, M., & Lee, Y.-S. (2007). Brief #1: A National Portrait of Chronic Absenteeism in the Early Grades. "What data tell us about the role of chronic absenteeism in early schooling?" New York , NY National Center for Children in Poverty, Columbia University, Mailman School
biographical information
Dr. Young-Sun Lee joined the department in the fall of 2002. She received her Ph.D in Educational Measurement and Statistics (Department of Educational Psychology) with a minor in Statistics at the
professional presentations
PRESENTATIONS AT MEETINGS AND CONFERENCES
Johnson, M., Lee, Y.-S., Sachdeva, R. *, Zhang, Z. *, & Park, J. Y. * (2013, April). Examination of Gender Differences Using the Multiple Groups DINA Model. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
Johnson, M., Lee, Y.-S., Park, J. Y. *, Zhang, Z. *, & Sachdeva, R.* (April, 2013). Comparing Attribute Distribution Across Countries: Application to TIMSS 2007 Mathematics. Paper presented at the annual meeting of the National Council on Measurement in Education, San Francisco, CA.
Lee, Y.-S., Johnson, M., Park, J. Y.*, Sachdeva, R.*, Zhang, Z.*, & Waldman, M.* (2013, April). A Multidimensional Scaling (MDS) Approach for Investigating Students' Cognitive Weakness and Strength on TIMSS 2007 Mathematics. Paper presented at the annual meeting of the American Educational Research Association, San Francisco, CA.
Lee, Y.-S., Park, Y. S., & Song, Y. (April, 2013). Examining the Mastery of Science Skills using the 4th Grade Science TIMSS. Poster presented at the 86thNational Association for Research in Science Teaching (NARST)Annual International Conference, Rio Grande, Puerto Rico.
Park, J. Y.*, Johnson, M., Lee, Y.-S., Zhang, J.*, & Sachdeva, R.* (2012, July). Comparing Attribute Distribution across Countries; Application to TIMSS 2007 Mathematics. Poster presented atthe 77th annual meeting of the PsychometricSociety, Lincoln, NE.
Park, J. Y.*, Johnson, M., Lee, Y.-S., Sachdeva, R.*, & Zhang, J.* (2012, July). The MDS approach for investigate student's cognitive weakness and strength on TIMSS 2007 Mathematics data. Poster presented at the 8th conference of the International Test Commission at Amsterdam, The Netherlands.
Park, Y. S., & Lee, Y.-S. (2012, July). A Bayesian Model Comparison Approach in Mixture IRTModels:An Empirical Analysis using the TIMSS Mathematics Assessment. Poster presented at the 8th conference of the International Test Commission at Amsterdam, The Netherlands.
Lee, Y.-S., Johnson, M., Park, J. Y.*, Sachdeva, R.*, & Zhang, J.* (2012, July). An Application ofa Multiple-Group CDM to Compare Cognitive Attribute Distributions based on Eighth Grade TIMSS Mathematics. Poster presented at the 8th conference of the International Test Commission at Amsterdam, The Netherlands.
Lee, Y.J.*, In, B.R.*, Park, Y. S., & Lee, Y.-S. (2012, April). An Empirical Analysis of Item Parameter Drift in TIMSS using the DINA model. Posterpresented at the annual conference of the National Council on Measurement in Education(NCME) Graduate Student Issues Committee (GSIC) Poster Session, Vancouver, Canada.
Kim, S.E.*, Park, Y. S., & Lee, Y.-S. (2012, April). An Application of Latent Class Models to Multiple Strategy CDM Analysis. Posterpresented at the annual conference of the National Council on Measurement in Education(NCME) Graduate Student Issues Committee (GSIC) Poster Session, Vancouver, British Columbia, Canada.
Lee, Y.-S., Park, Y. S., & Seong, T.-J. (2012, April). An extension of the DINA model using covariates: Examining factors affecting response probability and latent classification. Paper presented to the annual meeting of the National Council on Measurement in Education, Vancouver, British Columba, Canada.
Ginsburg, H., Pappas, S., Lee, Y.-S., & Chiong, C. (2011, September). Happy Birthday: An assessment tool that helps teachers understand and promote young children's math learning. Paper to be presented at the Society for Research on Educational Effectiveness Fall 2011 Conference, Washington, DC.
Park, Y. S., & Lee, Y.-S. (2011, July). Mixture Higher-Order DINA Model for Differential Attribute Functioning. Paper presented atthe 76th annual meeting of the Psychometric Society, Hong Kong.
Lee, Y.-S., & Park, Y. S. (2011, July). Application of Mixture IRT to Multiple Strategy CDM Analysis. Paper presented atthe 76th annual meeting of the Psychometric Society, Hong Kong.
Lee, Y.-S. (2011, July). mCLASS: Math - Development and analysis of an integrated screening, progress monitoring, and cognitive assessment system for K-3 mathematics. Invited talk given at the BK 21 international forum in the department of Education at Seoul National University, Seoul, Korea.
Lee, Y.-S. (2011, June). Introduction to Diagnostic Classification Models. Invited talk given at the workshop in the department of Education at ChungNam National University, Daejeon, Korea.
Lee, Y.-S. (2011, May). An Application of Cognitive Diagnosis Modeling in the TIMSS 2007 4th Grade Mathematics Assessment. Invited talk given at the BK 21 international forum in the department of Education at Seoul National University, Seoul, Korea.
Lee, Y.-S. (2011, May). An Application of Cognitive Diagnosis Modeling in the TIMSS 2003 8t h Grade Mathematics Assessment: A Comparison of Performance between the United States and Korea. Invited talk given at the Mathematics Education department colloquium at Seoul National University, Seoul, Korea.
Park, Y. S., & Lee, Y.-S. (2011, April). Investigating Item Parameter Drift Using Mixture IRT: An Application from TIMSS. Paper presented at the annual meeting of the National Council on Measurement in Education, New Orleans, LA.
Pappas, S., Chiong, C., Lee, Y.-S., & Ginsburg, H. P. (2011, April). Examining Group Differences Using the Clinical Interview. Paper presented in the symposium of Using Developmental Psychology to Create a New Course in Early Childhood Mathematics Education at the biennial meeting of the Society for Research in Child Development, Montreal, Canada.
Lee, Y.-S., Pappas, S., Chiong, C., & Ginsburg, H. P. (2011, April). Reliability and Validity of the Clinical Interview. Paper presented in the symposium of Using Developmental Psychology to Create a New Course in Early Childhood Mathematics Education at the biennial meeting of the Society for Research in Child Development, Montreal, Canada.
Chiong, C., Pappas, S., Lee, Y.-S., & Ginsburg, H. P. (2011, April). Profiles of Mathematical Thinking and Performance. Paper presented in the symposium of Using Developmental Psychology to Create a New Course in Early Childhood Mathematics Education at the biennial meeting of the Society for Research in Child Development, Montreal, Canada.
Lee, Y.-S., Hartman, G., Pappas, S., Chiong, C., & Ginsburg, H. P. (2011, April). Elaboration of the Early Mathematics Assessment System: The Spanish Version and Screen. Poster presented in the symposium of Developing the New Generation of Preschool Outcome Measures: The Interagency School Readiness Measurement Consortium (ISRMC) at the biennial meeting of the Society for Research in Child Development, Montreal, Canada.
Lee, Y.-S., Park, Y. S., & Lee, S. Y. (2010, December). Post-Smoothing by Kernel Equating to Compare College Scholastic Aptitude Test Performance between Offices of Education via Multilevel Methods. Presented at the symposium on the Analysis of National Assessment of Educational Achievement and College Scholastic Ability Test (CSAT) Data at the Korea Institute for Curriculum and Evaluation (KICE), Seoul, Republic of Korea.
Lee, Y.-S. (2010, November). A cognitive diagnostic modeling of attribute mastery in Massachusetts, Minnesota, and the U.S. national sample via TIMSS 2007. Invited talk given at the BK21 International Symposium on Educational Innovation, Consulting, & Evaluation at Pusan National University, Pusan, Republic of Korea.
Lee, Y.-S., Park, Y. S., & Taylan, D. (2010, July). A Comparative Study of Attribute Mastery between Regional Entities within the U.S.: An Analysis of TIMSS 2007 Using Cognitive Diagnostic Modeling. Paper presented at the 7th conference on the International Test Commission at the Chinese University of Hong Kong Shatin, Hong Kong.
Park, Y. S., & Lee, Y.-S. (2010, July). CTT, IRT, and G-DINA Analysis of TIMSS 2007. Paper presented at the 7th conference of the International Test Commission at the Chinese University of Hong Kong Shatin, Hong Kong.
Park, Y. S., & Lee, Y.-S. (2010, July). Investigating Item Drift in TIMSS via Cognitive Diagnostic Modeling. Paper presented at the 7th conference of the International Test Commission at the Chinese University of Hong Kong Shatin, Hong Kong.
Chiong, C., Lee, Y. S., Pappas, S., & Ginsburg, H. (2010, June). What kind of math student are you? Generating profiles by examining student performance on mCLASS: Math Diagnostic Interview assessment. Poster presented at the fifth annual research conference of the Institute of Education Sciences (IES), Washington, DC.
Ginsburg, H. P., Lee, Y.-S., Pappas, S., Hartman, G., & Rosenfeld, D. (2010, June). A Comprehensive Mathematics Assessment for Preschool-Age Children. Poster presented in the symposium of Developing New Measures to Assess the School Readiness of Young Children: The Interagency Consortium for School Readiness Outcome Measures at the biennial meeting of the Head Start's National Research Conference, Washington , DC
Kim, G., Lee, Y.-S., & Park, Y. S. (2010, April). Multiple Imputation with fully conditional specification approach: Estimation of Reliability Coefficient with missing data. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, CO.
Park, Y. S., & Lee, Y.-S. (2010, April). Mixture IRT Model Comparison using Bayesian Methods: An Empirical Analysis via Cognitive Diagnosis Interview Data. Paper presented at the annual meeting of the National Council on Measurement in Education, Denver, CO.
Lee, Y.-S., & de la Torre, J. (2010, April). Item-Level Comparison of Saturated and Reduced Cognitive Diagnosis Models. Paper presented at the annual meeting of the National Council on Measurement in Education, New York,
Pappas, S., Lee, Y.-S., Chiong, C., & Ginsburg, H. P. (2010, April). What might you know by your next birthday? Poster presented at the annual meeting of the American Educational Research Association, Denver, CO.
Lee, Y.-S., Chiong, C., Pappas, S., & Ginsburg, H. P. (2010, April). How did you know that? - Digging deeper into K-3rd grade students' mathematical strategy use within the mCLASS: Math assessment system. Poster presented at the annual meeting of the American Educational Research Association, Denver, CO.
Kim, G., & Lee, Y.-S. (2010, April). Evaluating Diagnostic Accuracy and Utility of mCLASS: Math CBM for Grade K to 3 Students. Poster presented at the annual meeting of the American Educational Research Association, Denver, CO.
Park, Y. S., Lee, Y.-S., & Choi, K. M. (2010, April). Cognitive Diagnostic Analysis of TIMSS 2007 Using the DINA Model: A Multilevel Comparison of High, Average, and Low Performance. Paper presented at the annual meeting of the American Educational Research Association, Denver, CO.
Lee, Y.-S., & Ginsburg, H. P. (2010, January). Piaget meets IRT & IRT meets Piaget. Invited talk given at the Human Development department colloquium at Teachers College, Columbia University, NY.
Lee, Y.-S., & Park, Y. S. (2010, January). An Analysis of Mathematical Performance in 4th grade American Students to the International Average via TIMSS. Paper presented at the annual meeting of the Hawaii International Conference on Education,
Lee, Y.-S., & Lee, S. Y. (2010, January). Exploring Young Children's Metacognitive Skills and Usage of Mathematical Strategy: A Comparison between American and Korean Kindergarteners. Paper presented at the annual meeting of the Hawaii International Conference on Education,
Park, Y. S., & Lee, Y.-S. (2010, January). International Comparison of Content and Cognitive Clustering in TIMSS 2003 8th grade Mathematics. Paper presented at the annual meeting of the Hawaii International Conference on Education, Honolulu , HI
professional experiences
PROFESSIONAL ACTIVITIES
Committee Member, Brenda H. Loyd Outstanding Dissertation Award Committee, National Council on Measurement in Education (NCME), 2007-2011
Review Panel, Child-related interventions research applications (ZMH1 ERB-P(01)) for the National Institute of Mental Health (NIMH), 2005
Journal Reviewer for Psychological Methods, Asia Pacific Education Review, Applied Psychological Measurement, Educational and Psychological Measurement, Journal of Educational Measurement
Proposal Reviewer for AERA Annual Meetings & NCME Annual Meetings
service to the college and university
grants
Principal Investigator: "An Extension of the DINA Model Using Covaiates: Examining Attribute Mastery Prevalence and Matsery Profile on 4th Grade TIMSS Science", Dean's Grant for Tenured Faculty Research, Teachers College, Columbia University, Dates: 9/1/2012 - 8/31/2013, a semester research leave with salary & $5,000 research funds.
Co-Principal Investigator: "Developing an instrument for measuring Multiphasic Developmental Potential Inventory (MDPI)" (다면적 성장잠재력 검사 개발 연구), Seoul Metropolitan Office of Education, Seoul, Republic of Korea, Chang-Dai Kim (PI), Dates: 7/1/2011-2/29/2012, 50,000,000 won (approximately $50,000) (Written in Korean). Principal Investigator: "A Study on Examining and Improving the National Assessment of Educational Achievement using Cognitive Diagnostic Models"(인지진단모형을 통한 국가수준 학업성취도 평가자료의 분석 및 결과보고 개선 연구), Korea Institute for Curriculum and Evaluation (KICE), Dates: 6/1/2011 – 11/31/2011, 48,000,000 won (approximately $44,200) (Written in Korean).
Co-Principal Investigator: "Emerging Research-Empirical: Development and Application of a Multilevel Multiple-Group CDM to Compare Cognitive Attribute Distributions based on Eighth Grade TIMSS Mathematics", Johnson (PI), National Science Foundation (NSF), Dates: 9/1/2010 – 8/31/2012, $1,399,144 requested.
Principal Investigator: "Post-Smoothing by Kernel Equating to compare College Scholastic Aptitude Test Performance between Offices of Education via Multilevel Methods"(비모수 커널 추정법을 통한 대학수학능력시험의 검사동등화 및 다층모형 분석: 시도교육청간의 학업 성취도 비교 연구), Korea Institute for Curriculum and Evaluation (KICE) - The College Scholastic Aptitude Test (CSAT) Research Project, Dates: 8/15/2010 - 12/7/2010, 20,000,000 won (approximately $18,000) (Written in Korean).
Co-Principal Investigator: "mCLASS:Math: Development and analysis of an integrated screening, progress monitoring, and cognitive assessment system for K-3 mathematics", Institute of Education Sciences (IES; R305B070325), Ginsburg (PI), Dates: 9/1/2007 - 6/30/2011, total costs $1,565,455.
Co-Principal Investigator: "Computer Guided Comprehensive Mathematics Assessment for Young Children", National Institute of Health (NIH; 1 R01 HD051538-01), Ginsburg (PI), Dates: 10/01/2005 - 8/31/2010, total costs $3,170,839.
Statistician: "What Data Tell Us About the Role of Chronic Absenteeism in Early School", Annie E. Casey Foundation, Knitzer & Romero (PI), National Center for Children in Poverty, School of Public Health, Columbia University, Dates: 3/01/2007 - 2/28/2008, total costs $35,000.
professional organization membership
American Educational Research Association (AERA)
American Psychological Association (APA)
National Council on Measurement in Education (NCME)
Psychometric Society
Society for Research in Child Development (SRCD)
current projects
Emerging Research-Empirical: Development and Application of a Multilevel Multiple-Group CDM to Compare Cognitive Attribute Distributions based on Eighth Grade TIMSS Mathematics (NSF funded)
mCLASS:Math: Development and analysis of an integrated screening, progress monitoring, and cognitive assessment system for K-3 mathematics (IES funded)
Students in the United States have consistently performed below many of their international peers on mathematics assessments like TIMSS and PISA (AFT, 1999). This gap in performance is described in terms of a few very broad content domains (e.g., Algebra, Geometry), but it remains unclear exactly what math skills U.S. students are missing. The proposed research will develop and apply methods based on cognitive diagnostic modeling to understand exactly what math skills U.S. students lack, and compare the distributions of skills across countries and within countries across years. The research team will also investigate the relationship between the presence or absence of these skills and core background variables (e.g., gender). The proposed research focuses on the TIMSS eighth grade mathematics assessments from 1999, 2003, and 2007.
mCLASS:Math: Development and analysis of an integrated screening, progress monitoring, and cognitive assessment system for K-3 mathematics (IES funded)
We conduct a series of studies to evaluate the reliability and validity of an integrated assessment system for K-3 mathematics and to modify it appropriately. The assessment includes Curriculum Based Measurement (CBM) screening and progress monitoring measures and diagnostic cognitive interviews. It is intended especially for use with under-achieving students from a variety of ethnic, linguistic, and economic backgrounds. The two assessment methods use a proven technology platform-a hand-held computer that guides teachers' assessments-to shorten and simplify the assessment administration process, and to make the resulting data readily available to teachers.
Over four years, we will: (1) evaluate the reliability and validity of all items and measures in both the CBM and the diagnostic interviews, and make any necessary revisions; (2) create growth models that describe students' typical trajectories and "aim-lines" on the CBM measures; (3) establish cut-points for the CBM, to aid teachers in identifying students in need of special help; (4) investigate student profiles within and across the CBM and diagnostic interviews; and (5) conduct predictive validity studies to establish which combinations of CBM measures and diagnostic questions best predict student performance in later years.
Computer Guided Comprehensive Mathematics Assessment for Young Children (NIH funded)
Our first aim is to develop an Early Mathematics Assessment System (EMAS) appropriate for young children (3- to 5-year olds) that will serve three major functions. The long form (L-EMAS) can be used to (1) evaluate the effectiveness of a variety of curricula, (2) and to provide immediate and specific cognitive process information that can be used to guide instruction. (3) The short form (S-EMAS) can be used as a screening instrument for identifying children at risk for mathematical difficulties and those who might require comprehensive assessment and intervention. The EMAS will have several key features. It will measure a broad range of mathematical content, assessing number, operations, shape, space, measurement and pattern. It also will measure a broad range of mathematical proficiency, including performance; cognitive processes underlying performance; comprehension and use of mathematical language; and children's "motivation"-attentiveness and affect. The EMAS will be research-based, drawing on modern cognitive science, developmental and educational research. It will engage and motivate young children through the use of games or purposeful activities such as a birthday party. This type of context should ensure that the EMAS, which will be translated into Spanish, can be used with a diverse population.
Our second aim is to develop innovative technology whereby a personal digital assistant (PDA) will guide assessors in administering the EMAS. The technology will help them to use flexible probes modeled on the clinical interview to gain greater insight into student proficiency.
Our third aim is to use statistical procedures to ensure that the EMAS is reliable and valid. The psychometric properties of both the EMAS will be investigated using both classical test theory (CTT) and item response theory (IRT) approaches to ensure high reliability and validity of the scale and quality of the items. We will conduct reliability studies and will use IRT to provide item and test information. We will also conduct validation studies. Once their reliability and validity have been shown to be strong, the L-EMAS and S-EMAS will be ready for norming.
Our fourth aim is to help assessors to use the EMAS and to investigate their use of it. We will design and evaluate professional developmental activities to enable early childhood professionals to use the PDA comfortably to administer the EMAS and to interpret the results. We will also investigate how assessors use the EMAS and learn from it. The EMAS will contribute to the evaluation and improvement of mathematics education for young children.
HUDM 4120: Basic concepts in statistics
Descriptive statistics including organizing, summarizing, reporting, and interpreting data. Understanding relationships expressed by cross-tabulation, breakdown, and scatterdiagrams. Designed as a one-semester introduction to statistical methods. Will include reading journal articles. Lab fee $50.00
HUDM 4122: Probability and statistical inference
Prerequisite: HUDM 4120 or undergraduate statistics course. Elementary probability theory; random variables and probability distributions; sampling distributions; estimation theory and hypothesis testing using binomial, normal, T, chi square, and F distributions.Lab fee $50.00
HUDM 5122: Applied regression analysis
Prerequisite: HUDM 4122 or permission of instructor. Least squares estimation theory. Traditional simple and multiple regression models and polynomial regression models, with grouping variables including one-way ANOVA, two-way ANOVA, and analysis of covariance. Lab devoted to applications of SPSS regression program. Lab fee: $50.
HUDM 6051: Psychometric theory I
Permission required. Prerequisites: HUDM 5059, HUDM 5122, or equivalents. Psychometric theory underlying test construction; classical test theory, item response theory, and applications.
HUDM 6052: Psychometric theory II
Permission required. Prerequisites: HUDM 5059, HUDM 5122, or equivalents. Psychometric theory underlying test construction; classical test theory, item response theory, and applications.
