Wednesday, October 3, 2018

The Dynamic Learning Maps® (DLM®) External Review event took place July 24 to 26, 2018, in Kansas City, MO. The three-day event was a crucial step in the development process with 65 educators from DLM states and 35 staff members participating. External Review allows DLM to carefully evaluate testlets that were previously generated by qualified item writers. Using specific criteria (content, bias and sensitivity, and accessibility), the 65 educators were divided into 18 different groups to determine if the content was appropriate for the DLM alternative assessment. The decisions made helped to determine the quality of the items and if they were worthy of moving forward for field testing.

DLM events bring experts together to collaborate on the various elements of the DLM alternate assessment.

Panelists and staff work together with the goal of creating appropriately challenging assessments.

Events range in size but the quality of the panelists is always a top priority.

Friday, May 11, 2018

The paper, “Condensed Mastery Profile Method for Setting Standards for Diagnostic Assessment Systems” is published in Volume 36, Issue 4 of Educational Measurement: Issues and Practice. It was written by integral members of the Dynamic Learning Maps® (DLM®) team, including Meagan Karvonen, Amy Clark, Brooke Nash, and Neal Kingston. The study set out to develop a method for standard setting compatible with diagnostic assessment. The results of the study provide evidence that suggests the condensed mastery profile method is a viable option for setting standards in diagnostic assessment systems. Additionally, DLM Psychometrician Jake Thompson’s graphic Visualizing Different Levels of Compensation in Multidimensional Item Response Theory Models is the cover image of this issue.

Full text of the article is available online with a subscription at To find out more about the authors and the rest of the DLM team, select “Our Team” from the About Us tab on the DLM website.  

Friday, August 18, 2017

The Achievement and Assessment Institute at the University of Kansas, on behalf of the Dynamic Learning Maps® (DLM®) Alternate Assessment Consortium, invites interested scholars to work with DLM staff in conducting psychometric modeling research on the Consortium’s assessment data. Research should make use of Bayesian networks or diagnostic classification modeling.

Fellowships for doctoral students and visiting scholar appointments for university faculty and researchers are both available.


Fellowships are available for doctoral-level students at accredited US-based institutions. Interested students should submit a proposal to conduct a study using data from the DLM assessment under the direction of a faculty sponsor from their institution.

Proposals should pertain to the field of measurement using Bayesian networks or diagnostic classification modeling and must include a completed application as well as a five- to ten-page proposal including a review of the literature highlighting the gap the proposal seeks to fill, proposed research questions, methodology, and a conclusion section that explains the significance of the work.

Projects are to be completed within four months, with a scope of work broad enough to allow for approximately 15 hours of work per week for the duration of the project. A $7,000 stipend will be provided.

For more information the Dynamic Learning Maps Consortium, additional requirements for the project, potential research topics, and the application, please review the Fellowship RFP.

Proposals are due by October 31, 2017 to

Visiting Scholar Appointments

Visiting scholar appointments are open to university faculty and researchers as part of a research collaboration or sabbatical. Interested individuals may request a summer or one- to two-semester appointment. Research should make use of Bayesian networks or diagnostic classification modeling.

Scope of work for visiting scholars is to be arranged between the Achievement and Assessment Institute and the researcher, and funding is available. Work could be conducted at KU or at the researcher’s own institution. In either case, an initial on-site visit will be arranged by Consortium staff and paid for by the Dynamic Learning Maps project.

For additional information about this opportunity, including suggested research topics, see our Visiting Scholar RFP.

Interested individuals should contact the Consortium at by September 11, 2017

Monday, October 17, 2016

The Dynamic Learning Maps® team is proud to unveil the redesign of this week, featuring improved organization and simplified navigation in a familiar shell. As we progress into a new year of testing, we hope the site redesign helps our Consortium members access the information they need for another successful year as quickly and easily as possible.

States may now access their state’s page directly via the States dropdown, while other popular pages are accessible directly via the Assessment Resources tab. The many Consortium-provided resources available on state webpages have been reorganized into four distinct categories for convenience. If your state department of education has provided additional resources for implementation in your state, those resources can be found in a fifth category, Supplemental Resources. All resources on state webpages, regardless of their category, are customized to each state’s unique requirements.

The site update brings along with it a change in URL for many of the site’s pages. We encourage you to click around the site, explore its new design, and then update your bookmarks as necessary.

Best wishes,

The Dynamic Learning Maps team at CETE

Thursday, June 16, 2016

In an effort to continually improve the experience of all who participate in Dynamic Learning Maps® assessments, the Consortium would like to request feedback of educators and administrators who participated in DLM testing for the 2015–16 school year.

Teachers and other test administrators are invited to complete a survey of their experience in administering DLM® assessments in 2015–16.

All 2015–16 DLM participants are invited to provide feedback on their satisfaction with the DLM Service Desk and its support.

District administrators whose students participated in 2015–16 assessments are invited to share their feedback on DLM training and resources.

The Consortium would like to issue a big thank you to all who complete these surveys. Your feedback is invaluable.

Update, 07/01/2016: All 2016 DLM surveys are now closed. Thank you to all who participated!

Monday, May 2, 2016

All test administrators are invited to complete the Spring 2016 DLM Teacher Survey, asking about your experience administering Dynamic Learning Maps® (DLM®) assessments this year in English language arts and mathematics. Results will be used to document the quality of the assessment system. Your individual responses will be kept confidential, and the results will only be reported for groups of respondents.

Unless the instructions say otherwise, please respond to questions about your experience during the spring 2016 window. The survey will take approximately 20 minutes to complete.

Update, 07/01/2016: All 2016 DLM surveys are now closed. Thank you to all who participated!

Friday, February 5, 2016

To smooth the testing experience this year, DLM has made some revisions to features found in KITE® Educator Portal.

Special Circumstances Codes

In the event that a student cannot take or complete a high-stakes, summative assessment, a special circumstance code should be entered under the Test Management menu. Special circumstance code selection is now available for DLM high-stakes, summative assessments. Information on entering special circumstance codes can be found in the Educator Portal User Manual, Chapter 6: Testing


Wednesday, August 19, 2015

Dynamic Learning Maps appointed two new members to its Technical Advisory Committee (TAC) last week, bringing the committee's total appointments to nine experts in areas of assessment ranging from standard setting and validity in large-scale assessments, to accessibility in alternative assessments, to cognitive diagnostic modeling.

Russell Almond is an associate professor of measurement and statistics at Florida State University and brings with him 14 years' experience in assessment. The Harvard Ph.D. recipient has contributed award-winning original research in assessment design and  produced specialized software systems for complex assessment scoring.

Karla Egan brings several years' experience in the development of large-scale, high-stakes assessment and has conducted extensive psychometric research on multiple state-level assessment programs. A recognized expert in standard setting, Egan currently serves on a National Academy of Sciences committee that is evaluating achievement levels in national standardized assessments.

Almond and Egan will join the next TAC meeting on October 1.

Tuesday, January 27, 2015

The Dynamic Learning Maps™ consortium has announced members of its 2015 Technical Advisory Committee (TAC). This year’s committee includes four new and four returning members. The group will first meet on Wednesday, January 28, to discuss the topics of modeling and standard setting.

TAC members advise Dynamic Learning Maps consortium staff on a variety of topics including system design, test development, psychometric and validity research design, and interpretation of findings. Over the coming years, the TAC will advise the consortium especially on how to best present the precise evidence needed for U.S. Department of Education peer review of the Dynamic Learning Maps assessment system.

All committee members hold a Ph.D. in various areas of education and are distinguished in their fields. The committee members’ areas of expertise are several, including:

  • Cognitive diagnostic psychometrics and Bayesian network analysis
  • Implementation and review of large-scale accountability assessment
  • Accessibility and inclusion of students with significant cognitive disabilities in large-scale assessment

2015 Technical Advisory Committee members include, alphabetically:


  • Jamal Abedi, University of California–Davis
  • James Pellegrino, University of Illinois-Chicago
  • Ed Roeber, Assessment Solutions Group/Michigan Assessment Consortium
  • David Williamson, Educational Testing Service


  • Greg Camilli, Rutgers University
  • George Engelhard, University of Georgia
  • Gerald Tindal, University of Oregon
  • Phoebe Winter, Independent Consultant
Monday, January 12, 2015

The Lawrence Journal-World recently reported on the progress of the Dynamic Learning Maps™ project, produced by the Center for Educational Testing and Evaluation at the University of Kansas in Lawrence, Kan.

Currently in its fifth year, the Dynamic Learning Maps project is nearing completion.

Read the full story on the LJ World's website.