Search

In the field of education, we bump constantly into buzzwords, pass unclear phrases in the hall, and greet acronyms as good friends. Yet rarely is it that we unpack or critically examine what is meant when phrases are uttered. What does it actually "mean" to "enhance institutional effectiveness"? To "foster synergy"? To "improve student learning"? In the field of assessment, there is a stated desire for "more use of assessment results," to "close the loop." There is agreement that the purpose and intention for engaging in assessing student learning is to ultimately "improve student learning" but there is no clear framework for what "improving student learning" entails or what it means to "close the loop." However, there does seem to be agreement that whatever "use" might mean, there is not enough of it happening let alone with regularity (Kuh et al., 2015). This paper provides an overview of an alternative conception of use through the lens of evidence-based storytelling--an approach that has been used at the National Institute for Learning Outcomes Assessment (NILOA) to refine and encourage evidence-based stories in assessment (Jankowski & Baker, 2019). This occasional paper serves two main purposes: to re-examine what is meant by use of assessment results and to unpack evidence-based storytelling and its connection to assessment.

In March 2020, institutions abruptly pivoted to remote instruction, sending students, faculty, and staff away from college campuses in response to COVID-19. In June 2020, the National Institute for Learning Outcomes Assessment (NILOA) launched a survey to capture a snapshot of assessment-related changes made during Spring 2020 in response to the sudden shift to remote instruction and to help determine remaining professional development needs. The brief questionnaire focused on changes that were made, potential impacts of those changes on assessment culture, and the role student voice and equity concerns did or did not play in Spring decisions. This report provides an overview of findings from the survey; couples those findings with other reports released from March through July; and provides guidance in the form of "do's" and "do not's" for higher education and the field of assessment--looking beyond Fall 2020 toward what needs to be done.

Stronger connections are needed between employers and higher education, however, questions abound about how best to work in partnership. Stemming from various conversations with members of the higher education and employer communities, this Occasional Paper provides tips for fostering successful partnerships and collaboration. Three lessons learned from successful employer and higher education partnerships are introduced: the importance of context, tips for sparking conversation between faculty and employers, and which questions to ask one another to find common values and deeper understanding. We hope you consider some of the tips and possible conversation foci presented in this guide as you engage in relationship building and find them useful in your employer partnerships. [For "Co-Designing Assessment and Learning: Rethinking Employer Engagement in a Changing World. Occasional Paper #39," see ED598871.]

Traditionally, transcripts present a collection of lists of courses and grades in a format valuable for trading information between and among institutions of higher education. What if transcripts were reimagined to not only provide information on credits earned, but also provide information on learning acquired both inside and outside the classroom? What if the transcript documented learning in a digital portable record, regardless of where the learning took place or was acquired? Beginning from a partnership between the American Association of Collegiate Registrars and Admissions Officers (AACRAO) and NASPA: Association of Student Personnel Administrators, the work to develop Comprehensive Learner Records (CLR) sought to address these questions with the help of a group of pilot institutions. The National Institute for Learning Outcomes Assessment (NILOA) provided professional development support to the pilot institutions as the pilot participants mapped learning and identified assessments of learning from both within and outside of the classroom for inclusion in a formal record. This occasional paper provides an overview of the Comprehensive Learner Record as well as connection points to assessment.

This Occasional Paper outlines lessons learned about mapping and assessing learning in student affairs and student employment. Over the last three years, the National Institute for Learning Outcomes Assessment (NILOA) assisted institutions developing Comprehensive Learner Records and scaling high-impact practices. In each of these initiatives, mapping of learning, redesigning assessments, and creating assignments was a staple of practice. Further, assessment practitioners were reminded that before staff jump into implementing assessment and writing the perfect learning outcome statement with just the right verb, time is needed to think about what is being built, why, how, and which students are best served by it all. The discussion centered upon: What is the role of student affairs as part of a larger system of interlocking and supporting learning for students throughout an institution that builds towards common or shared learning outcomes? This resource provides inroads to such discussions, and offers resources to inform practice and for use in institutional professional development.

Entering into a new decade with an even more diversified college student population will not only require more assessment models involving students but also deeper professional development of institutional representatives key to student learning. Reflecting upon the conversations over the last three years around culturally responsive assessment and related equity and assessment discussions, this occasional paper highlights questions, insights, and future directions for the decade ahead by exploring what equitable assessment is and is not; the challenges and barriers to equitable assessment work; where the decade ahead may lead; and next steps in the conversation on equity and assessment. [For "Equity and Assessment: Moving towards Culturally Responsive Assessment. Occasional Paper #29," see ED574461.]

Learning frameworks are tools that specify learning outcomes and/or competencies that define, classify, and recognize educational, learner, and industry expectations of knowledge, skills, and abilities at increasing levels of complexity and difficulty. They allow for alignment, translation, and mapping of learning through various spaces in order to capture learning that can be valued and recognized by education, industry, and the military. This paper outlines the roles that learning frameworks play in the emerging ecosystem of connected learning--why they matter and how they can bring disparate pieces of the learning ecosystem together for greater portability and documentation of learning in all the places it unfolds. It concludes with a focus on technological innovations as a source of future directions for learning frameworks connectivity.

Over the past decade, the National Institute for Learning Outcomes Assessment (NILOA) has been documenting what colleges and universities are doing to gather evidence about student learning and helping institutions to productively use assessment data to strengthen undergraduate education. NILOA also has been monitoring how institutions communicate with policy makers, families, and others about their efforts to enhance student learning and institutional effectiveness. One mechanism utilized to understand the landscape of assessment practices in United States higher education has been national surveys of senior academic leaders about what is being done to measure student learning outcomes and how results are used to improve teaching and learning. This report summarizes the findings from NILOA's third and most recent survey which was conducted in 2017. It is based on data collected from provosts between April and September 2017. The sample included provosts/chief academic officers (or their designees) at 2,781 regionally accredited, undergraduate degree-granting institutions. The questionnaire was completed by representatives of 811 institutions for a response rate of 29%. Nearly 80% of the survey respondents were from within the office of the provost, with the remainder of the surveys completed by those responsible for assessment within the institution. Appendix A contains additional information about the sample and data analysis. The 2017 questionnaire asked respondents about institution-level assessment, repeating many questions from the first and second survey efforts on assessment methods, uses, drivers of assessment practice, availability of assessment information, while adding a few new questions about initiatives to improve student learning.

Tuning is a bottom-up, faculty-led process which leads to the creation of a discipline-specific learning outcome document along with a degree profile that is used to communicate the value of a particular degree to a variety of audiences including students, employers, policy makers, and the general public. Tuning, introduced in the United States in 2009, involves a five-part process to develop a discipline core: defining the discipline core, mapping career pathways, consulting stakeholders, honing core competencies and learning outcomes, and implementing results locally and writing degree specifications. In contrast to the description of the process of Tuning outlined in the Tuning process report (Marshall, 2017), this study presents the outcomes from the work of Tuning in the United States from 2009-2016. The findings in this report emerge from a review of interviews, surveys, institutional activity reports, grantee interim and final reports, project evaluation reports, observations of project meetings, conference presentations, journals, and materials developed from the Tuning process. This Tuning impact study explores the intended outcomes of Tuning as well as the assumptions behind the benefits of engaging in the Tuning process. The five sections of this report present the findings of the Tuning impact study addressing reaching consensus, fostering faculty-led cross-institution discussions, learning-focused transfer and pathway conversations, expanded conversations on educational redesign and assessment, and student focused and employer engagement. The report concludes with a review of common misconceptions and challenges as well as final thoughts.

As colleges educate a more diverse and global student population, there is increased need to ensure every student succeeds regardless of their differences. This paper explores the relationship between equity and assessment, addressing the question: how consequential can assessment be to learning when assessment approaches may not be inclusive of diverse learners? The paper argues that for assessment to meet the goal of improving student learning and authentically document what students know and can do, a culturally responsive approach to assessment is needed. In describing what culturally responsive assessment entails, this paper offers a rationale as to why change is necessary, proposes a way to conceptualize the place of students and culture in assessment, and introduces three ways to help make assessment culturally responsive.

Following the release of the Degree Qualifications Profile (DQP) in 2011, many institutions of various types tried out different ways to use the DQP. Although over 680 institutions have used the DQP to date, until now the impact of the DQP on institutions and students has not been documented in a systematic manner. To determine the effects of DQP use on institutional policies and practices, the National Institute for Learning Outcomes Assessment (NILOA) conducted a study of the more than 400 (n = 425) institutions that used the DQP between the 2011 release and the October 2014 revision. The study explored how institutions engaged with the DQP and how working with DQP was associated with changes in curriculum, instructional practices, and assessment activities. One appendix is included: Funded DQP Projects and Related Initiatives.

Examples from the field indicates that effectively using the Degree Qualifications Profile (DQP) can benefit both students and institutions (Jankowski & Giffin, 2016). But what does "effective use" entail and how does it unfold? That is, what is the nature of the process that makes it possible for institutions to use the DQP to achieve desired ends? In a post-convening survey of participants following the October 2014 launch of the revised DQP, 91% of participants agreed or strongly agreed with Lumina's call for widespread implementation of DQP, but only 5% agreed that they understood the next steps in order to implement it. With this in mind, the National Institute for Learning Outcomes Assessment (NILOA) has been tracking campus engagement with the DQP, identifying approaches that institutions have used to implement the framework in meaningful ways. In this report, we describe those approaches and how they have been used within and across institutions.