Australasian Journal of Educational Technology 2006, 22(4), 495-510. | AJET 22 |
Given the current diversity of communication tools at an educator‘s disposal, what role (if any) does the discussion forum play in the development of a strong sense of community among students? This study sought to investigate the relationship between discussion forum interaction and perceived student sense of community. The results of the study demonstrate that while mere quantity of discussion forum postings is not an indicator of community development, a significant relationship is observed when contributions are codified into the various discussion interaction types (learner - learner; learner - content; system). An implication emerging from these findings is the ability for the institution to implement evaluative measures to gauge levels of student sense of community in a just in time environment. As discussion interactions are automatically captured and reported, the data provides an indication of the degree of community developing among the student population at a specific snapshot in time. As multiple snapshots provide an ongoing indicator of community development, practitioners have the capacity to develop intervention activities designed to promote further peer to peer discussion and therefore, facilitate the development of a strong sense of community.
This study aimed to investigate the relationship between asynchronous forum contributions and the degree of sense of community established among the student population within a large Australian metropolitan university. To address this aim, the paper firstly explores the dynamic between government policy and education practice, leading to a discussion of the concept of community as a psychological construct. The paper then presents a case for assessing community through quantitative methods incorporating the tracking of student (IT) user behaviours. Finally the paper discusses the findings of a large scale quantitative study, illustrating the applicability for data mining techniques to inform teaching practice and the relationship between student communication interactions and sense of community.
Changes in government policy have not only altered the day to day functioning of institutions but also has impacted upon the study and employment characteristics of the traditional student cohort. The rising cost of education has resulted in an increased number of traditional on campus students undertaking part time employment (Ford, Bosworth & Wilson, 1995). Consequently, student participation in on campus learning activities is often secondary to personal and financial commitments.
The growing demand for increased student numbers and the associated increase in student diversity (Gomes & Murphy, 2003) has required universities to adopt more flexible approaches to delivering education. In particular, the integration of information and communication technologies (ICTs) has been promoted as a means for providing flexible delivery (Flew, 1998) whilst maintaining quality of education standards. The distinction between distance and traditional modes of education is becoming blurred as both on and off campus students access education material through multiple modes of delivery. Lecture content is now placed online and may also contain components of audio or video streaming. Thus, the dissemination of course content is being supported for multiple modes of enrolment through various formats of delivery. However, while the current student cohort can access unit information, the degree of collaboration between peers and teaching staff is potentially inhibited as a result of reduced face to face opportunities for interaction.
The integration of computer mediated communication (CMC) is one approach to overcome the spatial and temporal barriers often associated with collaborative learning (McKenzie & Murphy, 2000). Although many authors advocate the integration of both synchronous and asynchronous CMC for collaborative learning activities (Curtin, 2002; Haythornthwaite, Kazmer & Robins, 2000; Wang & Newlin, 2001), the flexible af fordances associated with an asynchronous medium have resulted in greater acceptance and adoption among educators. In particular, discussion forums have gained popularity, providing avenues and opportunities for social interaction among an increasingly disparate student cohort.
Resulting from this almost ubiquitous integration of discussion forums among education practitioners is the capacity to track and analyse the evolving student discourse (Holt, Kleiber, Swenson, Rees & Milton, 1998). These data can be applied with novel methods to generate new insights into the design of learning and teaching practices, and the overall student experience. As educators are called upon to illustrate quality learning experiences, the quantitative data generated through CMCs may be readily applied to an overarching theoretical framework to inform practitioners of the achievement of student outcomes, and alignment with the initial learning design.
The concept of community as a theoretical framework for teaching and learning is gaining increasing momentum within the academy. Thus, the application of scalable, automated, fine grained, quantitative analyses may further our understanding of how community develops and the types of interactions necessary to foster a strong sense of community among the student cohort. The following section frames and defines the term community within the context of this study.
Literature relating to social constructivist practices has emphasised the importance of developing a community of learners (or learning community) for effective and efficient collaboration and knowledge construction among the student cohort (Bielaczyc & Collins, 1999; Gabelnick, MacGregor, Matthews & Smith, 1990). The educational benefits deriving from fostering a community of learners have been well documented. For instance, Rovai (2002c) in his study on community and learning suggests a positive correlation exists between sense of community and cognitive learning. Rovai demonstrates that students indicating a strong sense of community exhibit increased perceived cognitive learning, course satisfaction, and feel less isolated and are, therefore, more likely to persist with their course of study then their less community oriented peers. Similarly, Tinto (1993) links the establishment of learning communities with reduced student attrition rates in community colleges.
While research in these areas has advanced our understanding of the learning process and community development, the direct comparison between educational studies undertaken is problematised through the variety of definitions and contexts adopted. For example, the term has been applied to a range of educational strategies from collaborative virtual environments (Stacey, 1999), integrated course curricula (Smith, MacGregor, Matthews & Gabelnick, 2004; Tinto, 1998), and undergraduate interest groups (Staasen 2003), to residence based programs (Shapiro & Levine, 1999, p. 36). Despite this diversity of applications of the term within the literature, there is a growing consensus among educators to define and measure community as a psychological construct (Anderson, 2004; Brook & Oliver, 2003b; Dueber & Misanchuk, 2001; Rovai, 2002a). Thus in this context, the notion of community is often expressed as a sense of attachment or belonging to a particular group.
Defining community as a psychological construct also provides researchers with alternative methods of measuring community. The current primary method of evaluating community within education studies is to formulate a set of characteristics that underpin the definition of community. The analysis of the data is then framed within this developed schema to provide an indication of the presence or absence of community (Dueber & Misanchuk, 2001; Holt et al., 1998; Wang, Sierra & Folger, 2003). What is often lacking in these studies is a quantifiable determination of the strength of the social ties among the student cohort and, therefore, the level of community developed. One approach to address this deficit is to adopt a psychological scale to measure an individual‘s perceived sense of community. Rovai (2002b) developed and validated the Classroom Community Scale (CCS) to quantitatively measure the degree of student sense of community. Although the scale incorporates the theoretical framework posed by McMillan and Chavis (1986), the instrument has been designed specifically for the education context.
This study aimed to investigate the relationship between asynchronous forum contributions and the degree of sense of community established among the student population within a large Australian metropolitan university utilising a quantitative approach. Specifically, the study addresses the following research questions:
Initial data were collected from an online survey. In addition, information on unit discussion forum contributions derived from student participation over the course of one semester of study was collated by the institution‘s in house learning management system. The percentages of forum interaction types occurring at a unit level were then correlated with student perceived sense of community as measured by the online survey. From the pool of 2017 students enrolled in the identified units, 22% completed the online survey (N = 441). All teaching units involved in the study (N = 21) were represented in the returned student online survey responses. Delimiting the sample population into gender and mode of enrolment revealed that 84% of the respondents were female, 16% male, 81% were enrolled via the internal modality and 19% undertaking an external mode of study. The participant demographics observed in this study are consistent with the general education faculty student population.
Strijbos, Martens, Prins and Jochems (2006) stress the importance of implementing measures of reliability for studies utilising a quantitative methodology to ensure subsequent interpretations are based on potentially replicable data. To ascertain the degree of reliability, this study employed statistical measures such as Cronbach‘s alpha and Guttman split half coefficients. The analyses demonstrated excellent reliability and consistency with Cronbach alpha and Guttman split half coefficients of 0.90 and 0.89 respectively for the CCS. More refined analysis of the CCS sub-scales also revealed excellent reliability and consistency. The sub-scale social community resulted in a 0.86 Cronbach alpha and 0.85 Guttman split half coefficient. Similarly, for learning community excellent reliability was observed with a 0.84, Cronbach alpha and 0.76, Guttman split half coefficient. As the survey demonstrated acceptable factorial validity and reliability as demonstrated by EFA, Cronbach‘s alpha and Guttman split half coefficient, the remaining stage involved the marketing of the survey to the intended broader sample population.
a. Student sense of community | Community* | Social community | Learning community |
Mean (N = 21) | 46.2 (SD = 6.5) | 20.2 (SD = 4.2) | 26.0 (SD = 3.3) |
b. Forum interactions | Learner-learner | Learner-content | System |
Mean (N = 2179) | 39.3 (SD = 62.5) | 15.9 (SD = 23.1) | 48.5 (SD = 77.1) |
* Community is equal to the sum of the 2 constructs social community and learning. Community scores range from a maximum of 80 to a minimum of 0. |
Harasim (1987) endorses the categorisation of forum interactions and suggests that the most important forum interactions for enhancing the learning process are student to student (learner-learner) and staff to student (learner-content). Building upon the methodology of codifying forum interactions, Schire (2006) differentiates between participation and interaction. The author argues that contributions that are not responded to, in this case system interactions, do not contribute to the knowledge building process. Similarly, Garrison, Anderson and Archer (2001) maintain that an active teacher presence (learner-content) is required to support students in developing higher order cognitive skills. Hence, the aggregation of learner-learner and learner-content interactions (cumulative learner interactions) provides an indication of the degree of social and learning interactions occurring among the teaching staff and student cohort, in contrast to measuring levels of mere participation. Examination of the relationship occurring between the cumulative learner interactions and community indicates a significant correlation (r = 0.504). A significant correlation was also observed between the sub-scale social community and the percentage of cumulative learner interactions (r = 0.576). In contrast, no significant relationship was observed between the sub-scale learning community and the percentage of cumulative learner interactions. Table 3 summarises the correlations observed between the codified forum interactions and community for the sampled population.
Community | Social community | Learning community | |
Total forum contributions | r = 0.351 | r = 0.381 | r = 0.213 |
Interaction type (1) | Community | Social community | Learning community |
System | r = - 0.504* | r = - 0.576** | r = - 0.267 |
Learner-content | r = 0.127 | r = 0.216 | r = - 0.024 |
Learner-learner | r = 0.479* | r = 0.460* | r = 0.365 |
Cumulative learner interactions (a) | r = 0.504* | r = 0.576** | r = 0.267 |
1. Specific interaction is calculated as a percentage of the total contributions occurring within the unit discussion forum. ** Correlation is significant at the 0.01 level (2-tailed). * Correlation is significant at the 0.05 level (2-tailed). a. Cumulative score calculated from the percentage of learner-learner and learner-content interactions occurring within the Unit discussion forum. |
Vonderwell (2003), in her study examining student and staff perspectives of online communication, noted that students contributing to the forum experience a degree of frustration when their messages are unrequited. Similar conclusions can be drawn from this study, as units exhibiting high levels of system posts (orphaned contributions) demonstrate a lower reported level of student sense of community. The lack of social interplay among students provides teaching staff with an indication of the degree of community development, and the potentially high level of student frustration and dissatisfaction. The monitoring of the quantity and type of student postings provides a snapshot of the potential level of community evolving among the student cohort. Therefore, educators have the capacity to implement and then monitor learning intervention episodes to encourage greater learner-learner interaction.
The lack of correlation observed with the sub-scale learning community may be an indication of the time required for developing an online social presence, particularly given that with the discussion forum medium a textual interface is the sole mechanism for creating an identity online. Within the offl ine environments, non-verbal communication cues provide a source of information to interpret an individual‘s social identity. For example, Donath (1999) states: "...the body provides a compelling and convenient definition of identity" (p. 29). However, within the online domain the absence of visual and auditory cues results in an emphasis on the textual artefacts of communication in order to establish an identity. Consequently, developing the foundational layer of social community through establishing an identity and moving through online socialisation may absorb the greater part of the semester, and may therefore limit the opportunity for students to engage in a more learning oriented discourse.
A study undertaken by Gunawardena (1995) illustrates that the rapidity and level of social presence formed online is influenced by the instructors‘ ability to generate discussion. Hence, the period of socialisation may be reduced through the implementation of effective instructor led social activities and thus, provide increased opportunity for a more learning oriented discourse to emerge among the forum participants.
Potential sources of Australian government funding are increasingly dependent upon student satisfaction ratings, garnered from post-graduation surveys. Consequently the ability to monitor student satisfaction prior to graduation provides a potential lead indicator to preliminarily assess future student ratings and therefore the degree of possible funding secured. The quantitative approach adopted in this study is scaleable in nature and therefore may be extrapolated to the broader institution to ascertain levels of student sense of community. While this study has addressed one domain of student satisfaction, Williams (2002) maintains that satisfaction is influenced by both the learning environment and learning process. Hence while the evaluation of community within units may provide a framework for assessing sense of community and thereby levels of student satisfaction, the incorporation of parameters relating to the learning process would result in a more holistic and accurate representation of student satisfaction.
Barab, S. & Duffy, T. (2000). From practice fields to communities of practice. In D. Jonassen & S. M. Land (Eds), Theoretical foundations of learning environments (pp. 25-56). Mahwah, New Jersey: Lawrence Erlbaum Associates.
Bielaczyc, K. & Collins, A. (1999). Learning communities in classrooms: A reconceptualization of educational practice. In C. Reigeluth (Ed), Instructional-design theories and models, Volume II: A new paradigm of instructional theory (pp. 269-292). Mahwah, New Jersey: Lawrence Erlbaum Associates.
Brook, C. & Oliver, R. (2003a). Designing for online learning communities. In C. McNaught & D. Lassner (Eds), Proceedings of Ed-Media (pp. 1494-1500). Hawaii, USA.
Brook, C. & Oliver, R. (2003b). Online learning communities: Investigating a design framework. Australasian Journal of Educational Technology, 19(2), 139-160. http://www.ascilite.org.au/ajet/ajet19/brook.html
Burr, L., & Dawson, S. (2003). Codification of interaction within a large scale online forum environment. Paper presented Educause 2003, University of Adelaide.
Curtin, J. (2002). WebCT and online tutorials: New possibilities for student interaction. Australian Journal of Educational Technology, 18(1), 110-126. http://www.ascilite.org.au/ajet/ajet18/curtin.html
Dawson, S., Burnett, B., & O‘Donohue, M. (2006). Learning Communities - an untapped sustainable competitive advantage for Higher education. International Journal of Educational Management, 20(2), 127-139.
Dawson, S., Winslett, G., & Burr, L. (2004). Toward a quantitative analysis of online communities. Paper presented at the OLT 2004: Exploring Integrated learning Environments, 3 November, Brisbane, Australia.
Dewey, J. (1938/1963). Experience and education. New York: Collier.
Donath, J. (1999). Identity and deception in the virtual community. In M. Smith & P. Kollack (Eds), Communities in cyberspace. London: Routledge.
Dueber, B. & Misanchuk, M. (2001). Sense of community in a distance education course. Paper presented at the Mid South Instructional Technology Conference, 8-10 April, Murfreesboro, TN. [verified 17 Oct 2006] http://bill.dueber.com/dueber-misanchuk.pdf
Flew, T. (1998). Fast times at virtual U: Digital media, markets and the future of higher education in the West report. Australian Universities Review, 41(1), 20-25.
Ford, J., Bosworth, D. & Wilson, R. (1995). Part-time work and full-time higher education. Studies in Higher Education, 20(2), 187-202.
Gabelnick, F., Mac Gregor, J., Matthews, R. S. & Smith, B. L. (1990). Students in learning communities: Engaging with self, others, and the college community. New Directions for Teaching and Learning, 41(1), 39-51.
Garrison, D. R., Anderson, T. & Archer, W. (2001). Critical thinking, cognitive presence and computer conferencing in distance education. The American Journal of Distance Education, 15(1), 7-23.
Gomes, L. & Murphy, J. (2003). An exploratory study of marketing international education online. The International Journal of Educational Management, 17(3), 116-125.
Gunawardena, C. N. (1995). Social presence theory and implications for interaction and collaborative learning in computer conferences. International Journal of Educational Telecommunications, 1(2/3), 147-166.
Harasim, L. (1987). Teaching and learning on-line: Issues in computer-mediated graduate courses. Canadian Journal of Educational Communication, 16(2), 117-135. [verified 21 Oct 2006] http://www.amtec.ca/cjlt/vol16no2.pdf
Hargreaves, A., Earl, L. & Ryan, J. (1996). Schooling for change: Reinventing education for early adolescents. Washington, DC: Falmer Press.
Haythornthwaite, C., Kazmer, M. M. & Robins, J. (2000). Community development among distance learners: Temporal and technological dimensions. Journal of Computer Mediated Communications, 6(1). [verified 17 Oct 2006] http://jcmc.indiana.edu/vol6/issue1/haythornthwaite.html
Heathcote, E. & Dawson, S. (2005). Data mining for evaluation, benchmarking and reflective practice in a LMS. In Proceedings E-Learn 2005: World conference on E-learning in corporate, government, health and higher education, 24-28 October, Vancouver. [verified 17 Oct 2006] http://eprints.qut.edu.au/archive/00002368/01/2368.pdf
Hew, K. F. & Cheung, W. S. (2003). Models to evaluate online learning communities of asynchronous discussion forums. Australian Journal of Educational Technology, 19(2), 241-259. http://www.ascilite.org.au/ajet/ajet19/hew.html
Hiltz, R. (1994). Online communities: A case study of the office of the future. Norwood, NJ: Ablex Publishing Corporation.
Holt, M. E., Kleiber, P. B., Swenson, J. D., Rees, E. F. & Milton, J. (1998). Facilitating group learning on the Internet. New Directions for Adult and Continuing Education, 1998(78), 43-51.
Mazzarol, T., Soutar, G. N. & Seng, M. S. Y. (2003). The third wave: Future trends in international education. The International Journal of Educational Management, 17(3), 90-99.
McKenzie, W. & Murphy, D. (2000). "I hope this goes somewhere": Evaluation of an online discussion group. Australian Journal of Educational Technology, 16(3), 239-257. http://www.ascilite.org.au/ajet/ajet16/mckenzie.html
McMillan, D. & Chavis, D. (1986). Sense of community: A definition and theory. Journal of Community Psychology, 14(1), 6-23.
Minister for Education Science & Training (2002). Higher education at the crossroads: An overview paper.Department of Education, Science and Training. http://www.backingaustraliasfuture.gov.au/publications/crossroads/default.htm
Palloff, R. & Pratt, K. (1999). Building learning communities in cyberspace. San Francisco, CA: Jossey-Bass.
Rafaeli, S., Ravid, G. & Soroka, V. (2004). De-lurking in virtual communities: A social communication network approach to measuring the effects of social and cultural capital. Proceedings 37th Hawaii International Conference on System Sciences. [verified 17 Oct 2006] http://csdl.computer.org/comp/proceedings/hicss/2004/2056/07/205670203.pdf
Rovai, A. P. (2002a). Building sense of community at a distance. International Review of Research in Open and Distance Learning, 3(1). [viewed 25 Jan 2005, verified 4 Nov 2006] http://www.irrodl.org/index.php/irrodl/article/view/79/152
Rovai, A. P. (2002b). Development of an instrument to measure classroom community. Internet and Higher Education, 5(3), 197-211.
Rovai, A. P. (2002c). Sense of community, perceived cognitive learning, and persistance in asynchronous learning networks. Internet and Higher Education, 5(4), 319-332.
Rovai, A. P. & Wighting, M. J. (2005). Feelings of alienation and community among higher education students in a virtual classroom. Internet and Higher Education, 8(2), 97-110.
Salmon, G. (2000). E-moderating: The key to teaching and learning online. London: Kogan Page.
Scadarmalia, M. & Bereiter, C. (1994). Computer support for knowledge-building communities. Journal of the Learning Sciences, 3(3), 265-283.
Schrire, S. (2006). Knowledge building in asynchronous discussion groups: Going beyond quantitative analysis. Computers and Education, 46(1), 49-70.
Shapiro, N., & Levine, J. (1999). Creating learning communities: A practical guide to winning support, organising for change, and implementing programs. San Francisco: Jossey-Bass.
Smith, B. L., MacGregor, J., Matthews, R. & Gabelnick, F. (2004). Learning communities: Reforming undergraduate education. San Francisco: Jossey-Bass.
Stacey , E. (1999). Collaborative learning in an online environment. Journal of Distance Education, 14(2), 14-33.
Strijbos, J.-W., Martens, R. L., Prins, F. J. & Jochems, W. M. G. (2006). Content analysis: What are they talking about? Computers and Education, 46(1), 29-48.
Svensson, L. (2002). Discursive evaluation in a distributed learning community. Australian Journal of Educational Technology, 18(3), 308-322. http://www.ascilite.org.au/ajet/ajet18/svensson.html
Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition (2nd ed.). Chicago: University of Chicago Press.
Tinto, V. (1998). Learning communities: Building gateways to student success. [viewed 13 Feb 2006, verified 17 Oct 2006] http://www.ntlf.com/html/lib/suppmat/74tinto.htm
Tu, C. (2002). The relationship between social presence and online privacy. Internet and Higher Education, 5(4), 293-318.
Vonderwell, S. (2003). An examination of asynchronous communication experiences and perspectives of students in an online course: a case study. Internet and Higher Education, 6(1), 77-90.
Wang, A. Y. & Newlin, M. H. (2001). Online lectures: Benefits for the virtual classroom. THE Journal, 29(1), 17-24. [verified 18 Oct 2006] http://www.thejournal.com/articles/15513
Wang, M., Sierra, C. & Folger, T. (2003). Building a dynamic online learning community among adult learners. Education Media International, 40(1/2), 49-62.
Wellman, B., & Gulia, M. (1999). Virtual communities as communities: Net surfers don‘t ride alone. In M. Smith & P. Kollock (Eds), Communites in cyberspace. London: Routledge.
Williams, J. (2002). Student satisfaction: Student feedback and its potential role in quality assessment and enhancement. Paper presented at the EAIR Forum, 8-11 September, Prague.
Wood, A. & Smith, M. (2005). Online communication: Linking technology, identity and culture (2n ed.). London: Lawrence Erlbaum Associates.