Exploring the complexity of student learning outcome assessment practices across multiple libraries

Donna Harp Ziegenfuss, Stephen Borrelli

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

Objectives - The purpose of this collaborative qualitative research project, initiated by the Greater Western Library Alliance (GWLA), was to explore how librarians were involved in the designing, implementing, assessing, and disseminating student learning outcomes (SLOs) in GWLA member academic libraries. The original objective of the research was to identify library evaluation/assessment practices at the different libraries to share and discuss by consortia members at a GWLA-sponsored Student Learning Assessment Symposium in 2013. However, findings raised new questions and areas to explore beyond student learning assessment, and additional research was continued by two of the GWLA collaborators after the Symposium. The purpose of this second phase of research was to explore the intersection of library and institutional contexts and academic library assessment practices. Methods - This qualitative research study involved a survey of librarians at 23 GWLA member libraries, about student learning assessment practices at their institutions. Twenty follow-up interviews were also conducted to further describe and detail the assessment practices identified in the survey. Librarians with expertise in library instruction, assessment, and evaluation, either volunteered or were designated by their Dean or Director, to respond to the survey and participate in the interviews. Interview data were analyzed by seven librarians, across six different GWLA libraries, using constant comparison methods (Strauss & Corbin, 2014). Emerging themes were used to plan a GWLA member Symposium. Based on unexpected findings, after the Symposium, two GWLA researchers continued the analysis using a grounded theory methodology to re-examine the data and uncover categorical relationships and conceptual coding, and to explore data alignment to theoretical possibilities. Results - Seventeen categories and five themes emerged from the interview data and were used to create a 3-part framework for describing and explaining library SLO assessment practices. The themes were used to plan the GWLA Assessment Symposium. Through additional qualitative grounded theory data analysis, researchers also identified a core variable, and data were re-evaluated to verify an alignment to Engeström's Activity and Expansion Theories (Engeström, 2001, 2004). Conclusions - The findings of this multi-phased qualitative study discovered how contextual, structural, and organizational factors can influence how libraries interact and communicate with college departments, and the larger institution about student learning outcomes and assessment. Viewing library and campus interaction through the activity theory lens can demonstrate how particular factors might influence library collaboration and interaction on campuses. Institutional contexts and cultures, campus-wide academic priorities, leadership at the library level, and changing roles of librarians were all themes that emerged from this study that are important factors to consider when planning the design, implementation, assessment and dissemination of library SLOs.

Original languageEnglish (US)
Pages (from-to)9-27
Number of pages19
JournalEvidence Based Library and Information Practice
Volume11
Issue number2
StatePublished - Jan 1 2016

Fingerprint

learning
student
librarian
interview
grounded theory
qualitative research
interaction
evaluation
director
coding
data analysis
expertise
research project
leadership
instruction
planning
methodology

All Science Journal Classification (ASJC) codes

  • Library and Information Sciences

Cite this

@article{7fc7475e93ba454495af6c0b51c6c4d1,
title = "Exploring the complexity of student learning outcome assessment practices across multiple libraries",
abstract = "Objectives - The purpose of this collaborative qualitative research project, initiated by the Greater Western Library Alliance (GWLA), was to explore how librarians were involved in the designing, implementing, assessing, and disseminating student learning outcomes (SLOs) in GWLA member academic libraries. The original objective of the research was to identify library evaluation/assessment practices at the different libraries to share and discuss by consortia members at a GWLA-sponsored Student Learning Assessment Symposium in 2013. However, findings raised new questions and areas to explore beyond student learning assessment, and additional research was continued by two of the GWLA collaborators after the Symposium. The purpose of this second phase of research was to explore the intersection of library and institutional contexts and academic library assessment practices. Methods - This qualitative research study involved a survey of librarians at 23 GWLA member libraries, about student learning assessment practices at their institutions. Twenty follow-up interviews were also conducted to further describe and detail the assessment practices identified in the survey. Librarians with expertise in library instruction, assessment, and evaluation, either volunteered or were designated by their Dean or Director, to respond to the survey and participate in the interviews. Interview data were analyzed by seven librarians, across six different GWLA libraries, using constant comparison methods (Strauss & Corbin, 2014). Emerging themes were used to plan a GWLA member Symposium. Based on unexpected findings, after the Symposium, two GWLA researchers continued the analysis using a grounded theory methodology to re-examine the data and uncover categorical relationships and conceptual coding, and to explore data alignment to theoretical possibilities. Results - Seventeen categories and five themes emerged from the interview data and were used to create a 3-part framework for describing and explaining library SLO assessment practices. The themes were used to plan the GWLA Assessment Symposium. Through additional qualitative grounded theory data analysis, researchers also identified a core variable, and data were re-evaluated to verify an alignment to Engestr{\"o}m's Activity and Expansion Theories (Engestr{\"o}m, 2001, 2004). Conclusions - The findings of this multi-phased qualitative study discovered how contextual, structural, and organizational factors can influence how libraries interact and communicate with college departments, and the larger institution about student learning outcomes and assessment. Viewing library and campus interaction through the activity theory lens can demonstrate how particular factors might influence library collaboration and interaction on campuses. Institutional contexts and cultures, campus-wide academic priorities, leadership at the library level, and changing roles of librarians were all themes that emerged from this study that are important factors to consider when planning the design, implementation, assessment and dissemination of library SLOs.",
author = "Ziegenfuss, {Donna Harp} and Stephen Borrelli",
year = "2016",
month = "1",
day = "1",
language = "English (US)",
volume = "11",
pages = "9--27",
journal = "Evidence Based Library and Information Practice",
issn = "1715-720X",
publisher = "University of Alberta",
number = "2",

}

Exploring the complexity of student learning outcome assessment practices across multiple libraries. / Ziegenfuss, Donna Harp; Borrelli, Stephen.

In: Evidence Based Library and Information Practice, Vol. 11, No. 2, 01.01.2016, p. 9-27.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Exploring the complexity of student learning outcome assessment practices across multiple libraries

AU - Ziegenfuss, Donna Harp

AU - Borrelli, Stephen

PY - 2016/1/1

Y1 - 2016/1/1

N2 - Objectives - The purpose of this collaborative qualitative research project, initiated by the Greater Western Library Alliance (GWLA), was to explore how librarians were involved in the designing, implementing, assessing, and disseminating student learning outcomes (SLOs) in GWLA member academic libraries. The original objective of the research was to identify library evaluation/assessment practices at the different libraries to share and discuss by consortia members at a GWLA-sponsored Student Learning Assessment Symposium in 2013. However, findings raised new questions and areas to explore beyond student learning assessment, and additional research was continued by two of the GWLA collaborators after the Symposium. The purpose of this second phase of research was to explore the intersection of library and institutional contexts and academic library assessment practices. Methods - This qualitative research study involved a survey of librarians at 23 GWLA member libraries, about student learning assessment practices at their institutions. Twenty follow-up interviews were also conducted to further describe and detail the assessment practices identified in the survey. Librarians with expertise in library instruction, assessment, and evaluation, either volunteered or were designated by their Dean or Director, to respond to the survey and participate in the interviews. Interview data were analyzed by seven librarians, across six different GWLA libraries, using constant comparison methods (Strauss & Corbin, 2014). Emerging themes were used to plan a GWLA member Symposium. Based on unexpected findings, after the Symposium, two GWLA researchers continued the analysis using a grounded theory methodology to re-examine the data and uncover categorical relationships and conceptual coding, and to explore data alignment to theoretical possibilities. Results - Seventeen categories and five themes emerged from the interview data and were used to create a 3-part framework for describing and explaining library SLO assessment practices. The themes were used to plan the GWLA Assessment Symposium. Through additional qualitative grounded theory data analysis, researchers also identified a core variable, and data were re-evaluated to verify an alignment to Engeström's Activity and Expansion Theories (Engeström, 2001, 2004). Conclusions - The findings of this multi-phased qualitative study discovered how contextual, structural, and organizational factors can influence how libraries interact and communicate with college departments, and the larger institution about student learning outcomes and assessment. Viewing library and campus interaction through the activity theory lens can demonstrate how particular factors might influence library collaboration and interaction on campuses. Institutional contexts and cultures, campus-wide academic priorities, leadership at the library level, and changing roles of librarians were all themes that emerged from this study that are important factors to consider when planning the design, implementation, assessment and dissemination of library SLOs.

AB - Objectives - The purpose of this collaborative qualitative research project, initiated by the Greater Western Library Alliance (GWLA), was to explore how librarians were involved in the designing, implementing, assessing, and disseminating student learning outcomes (SLOs) in GWLA member academic libraries. The original objective of the research was to identify library evaluation/assessment practices at the different libraries to share and discuss by consortia members at a GWLA-sponsored Student Learning Assessment Symposium in 2013. However, findings raised new questions and areas to explore beyond student learning assessment, and additional research was continued by two of the GWLA collaborators after the Symposium. The purpose of this second phase of research was to explore the intersection of library and institutional contexts and academic library assessment practices. Methods - This qualitative research study involved a survey of librarians at 23 GWLA member libraries, about student learning assessment practices at their institutions. Twenty follow-up interviews were also conducted to further describe and detail the assessment practices identified in the survey. Librarians with expertise in library instruction, assessment, and evaluation, either volunteered or were designated by their Dean or Director, to respond to the survey and participate in the interviews. Interview data were analyzed by seven librarians, across six different GWLA libraries, using constant comparison methods (Strauss & Corbin, 2014). Emerging themes were used to plan a GWLA member Symposium. Based on unexpected findings, after the Symposium, two GWLA researchers continued the analysis using a grounded theory methodology to re-examine the data and uncover categorical relationships and conceptual coding, and to explore data alignment to theoretical possibilities. Results - Seventeen categories and five themes emerged from the interview data and were used to create a 3-part framework for describing and explaining library SLO assessment practices. The themes were used to plan the GWLA Assessment Symposium. Through additional qualitative grounded theory data analysis, researchers also identified a core variable, and data were re-evaluated to verify an alignment to Engeström's Activity and Expansion Theories (Engeström, 2001, 2004). Conclusions - The findings of this multi-phased qualitative study discovered how contextual, structural, and organizational factors can influence how libraries interact and communicate with college departments, and the larger institution about student learning outcomes and assessment. Viewing library and campus interaction through the activity theory lens can demonstrate how particular factors might influence library collaboration and interaction on campuses. Institutional contexts and cultures, campus-wide academic priorities, leadership at the library level, and changing roles of librarians were all themes that emerged from this study that are important factors to consider when planning the design, implementation, assessment and dissemination of library SLOs.

UR - http://www.scopus.com/inward/record.url?scp=84988917909&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988917909&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84988917909

VL - 11

SP - 9

EP - 27

JO - Evidence Based Library and Information Practice

JF - Evidence Based Library and Information Practice

SN - 1715-720X

IS - 2

ER -