Opportunities for natural language processing in qualitative engineering education research: Two examples

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This research full paper proposes opportunities to expand qualitative and textual data analysis using natural language processing (NLP), and demonstrates opportunities to use NLP in engineering education work in our presentation of two NLP-based projects as examples of how NLP can be used. The discipline of engineering education frequently employs qualitative data analysis techniques, but fundamentally, the analysis of large corpora of textual documents is limited by researcher's time. In this paper, we present a brief review literature of how NLP has been used in other qualitative research fields. This portion of the paper is aimed to provide a clear description of NLP for those unfamiliar with machine learning and natural language processing methods. The second part of the paper will provide two brief examples of how NLP is being employed in our research group. Example 1 is a study of engineering résumés, with the intention of being able to calculate the 'disciplinary discourse density' based off the engineering language presented in engineering résumés, a technique validated in prior qualitative studies by hand. Example 2 is a genre analysis of engineering literature reviews, seeking to understand the ways in which sentences linguistically build into arguments, such that the task of writing literature reviews might be demystified. This paper will have a methodological impact for researchers attempting to use NLP methods to analyze qualitative data, articulating the opportunities and barriers in using these methods for engineering education research.

Original languageEnglish (US)
Title of host publicationFrontiers in Education
Subtitle of host publicationFostering Innovation Through Diversity, FIE 2018 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538611739
DOIs
StatePublished - Mar 4 2019
Event48th Frontiers in Education Conference, FIE 2018 - San Jose, United States
Duration: Oct 3 2018Oct 6 2018

Publication series

NameProceedings - Frontiers in Education Conference, FIE
Volume2018-October
ISSN (Print)1539-4565

Conference

Conference48th Frontiers in Education Conference, FIE 2018
CountryUnited States
CitySan Jose
Period10/3/1810/6/18

Fingerprint

Engineering education
engineering
Processing
language
education
data analysis
Learning systems
qualitative research
genre
discourse

All Science Journal Classification (ASJC) codes

  • Software
  • Education
  • Computer Science Applications

Cite this

Berdanier, C. G. P., Baker, E., Wang, W., & McComb, C. (2019). Opportunities for natural language processing in qualitative engineering education research: Two examples. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings [8658747] (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/FIE.2018.8658747
Berdanier, Catherine G P. ; Baker, Eric ; Wang, Weiqin ; McComb, Christopher. / Opportunities for natural language processing in qualitative engineering education research : Two examples. Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (Proceedings - Frontiers in Education Conference, FIE).
@inproceedings{c7bb67e3af24488b8c605417c9142346,
title = "Opportunities for natural language processing in qualitative engineering education research: Two examples",
abstract = "This research full paper proposes opportunities to expand qualitative and textual data analysis using natural language processing (NLP), and demonstrates opportunities to use NLP in engineering education work in our presentation of two NLP-based projects as examples of how NLP can be used. The discipline of engineering education frequently employs qualitative data analysis techniques, but fundamentally, the analysis of large corpora of textual documents is limited by researcher's time. In this paper, we present a brief review literature of how NLP has been used in other qualitative research fields. This portion of the paper is aimed to provide a clear description of NLP for those unfamiliar with machine learning and natural language processing methods. The second part of the paper will provide two brief examples of how NLP is being employed in our research group. Example 1 is a study of engineering r{\'e}sum{\'e}s, with the intention of being able to calculate the 'disciplinary discourse density' based off the engineering language presented in engineering r{\'e}sum{\'e}s, a technique validated in prior qualitative studies by hand. Example 2 is a genre analysis of engineering literature reviews, seeking to understand the ways in which sentences linguistically build into arguments, such that the task of writing literature reviews might be demystified. This paper will have a methodological impact for researchers attempting to use NLP methods to analyze qualitative data, articulating the opportunities and barriers in using these methods for engineering education research.",
author = "Berdanier, {Catherine G P.} and Eric Baker and Weiqin Wang and Christopher McComb",
year = "2019",
month = "3",
day = "4",
doi = "10.1109/FIE.2018.8658747",
language = "English (US)",
series = "Proceedings - Frontiers in Education Conference, FIE",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "Frontiers in Education",
address = "United States",

}

Berdanier, CGP, Baker, E, Wang, W & McComb, C 2019, Opportunities for natural language processing in qualitative engineering education research: Two examples. in Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings., 8658747, Proceedings - Frontiers in Education Conference, FIE, vol. 2018-October, Institute of Electrical and Electronics Engineers Inc., 48th Frontiers in Education Conference, FIE 2018, San Jose, United States, 10/3/18. https://doi.org/10.1109/FIE.2018.8658747

Opportunities for natural language processing in qualitative engineering education research : Two examples. / Berdanier, Catherine G P.; Baker, Eric; Wang, Weiqin; McComb, Christopher.

Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8658747 (Proceedings - Frontiers in Education Conference, FIE; Vol. 2018-October).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Opportunities for natural language processing in qualitative engineering education research

T2 - Two examples

AU - Berdanier, Catherine G P.

AU - Baker, Eric

AU - Wang, Weiqin

AU - McComb, Christopher

PY - 2019/3/4

Y1 - 2019/3/4

N2 - This research full paper proposes opportunities to expand qualitative and textual data analysis using natural language processing (NLP), and demonstrates opportunities to use NLP in engineering education work in our presentation of two NLP-based projects as examples of how NLP can be used. The discipline of engineering education frequently employs qualitative data analysis techniques, but fundamentally, the analysis of large corpora of textual documents is limited by researcher's time. In this paper, we present a brief review literature of how NLP has been used in other qualitative research fields. This portion of the paper is aimed to provide a clear description of NLP for those unfamiliar with machine learning and natural language processing methods. The second part of the paper will provide two brief examples of how NLP is being employed in our research group. Example 1 is a study of engineering résumés, with the intention of being able to calculate the 'disciplinary discourse density' based off the engineering language presented in engineering résumés, a technique validated in prior qualitative studies by hand. Example 2 is a genre analysis of engineering literature reviews, seeking to understand the ways in which sentences linguistically build into arguments, such that the task of writing literature reviews might be demystified. This paper will have a methodological impact for researchers attempting to use NLP methods to analyze qualitative data, articulating the opportunities and barriers in using these methods for engineering education research.

AB - This research full paper proposes opportunities to expand qualitative and textual data analysis using natural language processing (NLP), and demonstrates opportunities to use NLP in engineering education work in our presentation of two NLP-based projects as examples of how NLP can be used. The discipline of engineering education frequently employs qualitative data analysis techniques, but fundamentally, the analysis of large corpora of textual documents is limited by researcher's time. In this paper, we present a brief review literature of how NLP has been used in other qualitative research fields. This portion of the paper is aimed to provide a clear description of NLP for those unfamiliar with machine learning and natural language processing methods. The second part of the paper will provide two brief examples of how NLP is being employed in our research group. Example 1 is a study of engineering résumés, with the intention of being able to calculate the 'disciplinary discourse density' based off the engineering language presented in engineering résumés, a technique validated in prior qualitative studies by hand. Example 2 is a genre analysis of engineering literature reviews, seeking to understand the ways in which sentences linguistically build into arguments, such that the task of writing literature reviews might be demystified. This paper will have a methodological impact for researchers attempting to use NLP methods to analyze qualitative data, articulating the opportunities and barriers in using these methods for engineering education research.

UR - http://www.scopus.com/inward/record.url?scp=85063502349&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85063502349&partnerID=8YFLogxK

U2 - 10.1109/FIE.2018.8658747

DO - 10.1109/FIE.2018.8658747

M3 - Conference contribution

AN - SCOPUS:85063502349

T3 - Proceedings - Frontiers in Education Conference, FIE

BT - Frontiers in Education

PB - Institute of Electrical and Electronics Engineers Inc.

ER -

Berdanier CGP, Baker E, Wang W, McComb C. Opportunities for natural language processing in qualitative engineering education research: Two examples. In Frontiers in Education: Fostering Innovation Through Diversity, FIE 2018 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8658747. (Proceedings - Frontiers in Education Conference, FIE). https://doi.org/10.1109/FIE.2018.8658747