NSSE07 Benchmark Comparisons Report (NSSEville State)

11 pages

English

NSSE07 Benchmark Comparisons Report (NSSEville State)

Megar

Le téléchargement nécessite un accès à la bibliothèque YouScribe
Tout savoir sur nos offres

11 pages

English

Le téléchargement nécessite un accès à la bibliothèque YouScribe
Tout savoir sur nos offres

A propos
Informations
Extrait

Description

NSSEville State UniversityBenchmark ComparisonsAugust 2007Interpreting the Benchmark Comparisons ReportTo focus discussions about the importance of student engagement and guide institutional improvement efforts, NSSE created five clusters or "benchmarks" of effective educational practice: Level of Academic Challenge, Active and Collaborative Learning, Student-Faculty Interaction, Enriching Educational Experiences, and Supportive Campus Environment. This Benchmark Comparisons Report compares the performance of your institution with your selected peers or consortium. In addition, page 9 provides two other comparisons between your school and (a) above-average institutions with benchmarks in the top 50% of all NSSE institutions and (b) high-performing institutions with benchmarks in the top 10% of all NSSE institutions. These displays allow you to determine if the engagement of your typical student differs in a statistically significant, meaningful way from the average student in these comparison groups. More detailed information about how benchmarks are created can be found on the NSSE Web site at www.nsse.iub.edu/2007_Institutional_Report/.Statistical SignificanceBenchmarks with mean differences that are larger than would be expected by chance alone are noted with one, two, or three asterisks, denoting one of three Class and Samplesignificance levels (p<.05, p< .01, and p<.001). The smaller the significance level, Means are reported for Effect Sizethe ...

Informations

Publié par	Megar
Nombre de lectures	9
Langue	English

Extrait

NSSEville State University

Benchmark Comparisons August 2007

Interpreting the Benchmark Comparisons Report

To focus discussions about the importance of student engagement and guide institutional improvement efforts, NSSE created five clusters or "benchmarks" of effective educational practice: Level of Academic Challenge, Active and Collaborative Learning, Student-Faculty Interaction, Enriching Educational Experiences, and Supportive Campus Environment. This Benchmark Comparisons Report compares the performance of your institution with your selected peers or consortium. In addition, page 9 provides two other comparisons between your school and (a) above-average institutions with benchmarks in the top 50% of all NSSE institutions and (b) high-performing institutions with benchmarks in the top 10% of all NSSE institutions. These displays allow you to determine if the engagement of your typical student differs in a statistically significant, meaningful way from the average student in these comparison groups. More detailed information about how benchmarks are created can be found on the NSSE Web site at www.nsse.iub.edu/2007_Institutional_Report/.

Class and Sample Means are reported for first-year students and seniors. Institution-reports class ranks are used. All randomly selected students are included in these analyses. Students in targeted or locally administered oversamples are not included.

Mean The mean is the weightedarithmetic average of student level benchmark scores.

Benchmark Description & Survey Items A description of the benchmark and the individual items used in its creation are summarized.

Statistical Significance Benchmarks with mean differences that are larger than would be expected by chance alone are noted with one, two, or three asterisks, denoting one of three significance levels (p<.05, p< .01, and p<.001). The smaller the significance level, the smaller the likelihood that the difference is due to chance. Please note that statistical significance does not guarantee that the result is substantive or important. Large sample sizes (as with the NSSE project) tend to produce more statistically significant results even though the magnitude of mean differences may be inconsequential. It is recommended to consult effect sizes to judge the practical meaning of the results.

Level of Academic Challenge (LAC) Benchmark Comparisons

Class First-Year Senior

100

52.3

NSSEville State

a Mean 52.3 55.8

First-Year

51.6

Selected Peers

50.4

Carnegie Peers

Selected Peers Effect a b c Mean SigSize51.6 .05 55.9 -.01

51.8

NSSE 2007

100

NSSEville State compared with: Carnegie Peers Effect b c SigSize50.4 * .14 55.6 .02

55.8

NSSEville State

Senior

55.9

Selected Peers

NSSE 2007 a b Mean Sig51.8 55.8

55.6

Carnegie Peers

55.8

NSSE 2007

ze.04 .00

Level of Academic Challenge (LAC) Items Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance.

● Preparing for class (studying, reading, writing, rehearsing, etc. related to academic program) ● Number of assigned textbooks, books, or book-length packs of course readings ●number of written papers or reports of between 5 and 19 pages; and Number of written papers or reports of 20 pages or more; number of written papers or reports of fewer than 5 pages ● Coursework emphasizing analysis of the basic elements of an idea, experience or theory ● Coursework emphasizing synthesis and organizing of ideas, information, or experiences into new, more complex interpretations and relationships ● Coursework emphasizing the making of judgments about the value of information, arguments, or methods ● Coursework emphasizing application of theories or concepts to practical problems or in new situations ● Working harder than you thought you could to meet an instructor's standards or expectations ● Campus environment emphasizing time studying and on academic work

Effect Size Effect size indicates the practical significanceof the mean difference. It is calculated by dividing the mean difference by the standard deviation of the group to which the institution is being compared. In practice, an effect size of .2 is often considered small, .5 moderate, and .8 large. A positive sign indicates that your institution’s mean was greater, thus showing an affirmative result for the institution. A negative sign indicates the institution lags ehind the comparison group. Look for patterns of effect sizes that point to areas of student or institutional performance that warrant attention.

Bar Charts A visual display of first-year and senior mean benchmark scores for your institution and your selected peer or consortium groups.

Page 2

Level of Academic Challenge (LAC) Benchmark Comparisons

Class First-Year Senior

100

51.8

NSSEville State

a Mean 51.8 55.7

First-Year

52.1

Selected Peers

51.5

Carnegie Peers

Selected Peers Effect a b c Mean SigSize52.1 -.02 55.2 .04

51.7

NSSE 2007

Level of Academic Challenge (LAC) Items

100

NSSE 2007 Benchmark Comparisons NSSEville State University

NSSEville State compared with:

Carnegie Peers Effect a b c Mean SigSize51.5 .02 55.1 .05

55.7

NSSEville State

Senior

55.2

Selected Peers

NSSE 2007

a Mean 51.7 55.6

55.1

Carnegie Peers

b Sig

55.6

NSSE 2007

Effect c Size.00 .01

Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance.

a Weighted by gender, enrollment status, and institutional size. b * p<.05 ** p<.01 ***p<.001 (2-tailed). c Mean difference divided by comparison group standard deviation.

Page 3

Active and Collaborative Learning (ACL) Benchmark Comparisons

Class First-Year Senior

100

42.1

NSSEville State

a Mean 42.1 50.7

First-Year

40.1

Selected Peers

39.9

Carnegie Peers

Selected Peers Effect a b c Mean SigSize40.1 ** .13 48.0 *** .16

41.2

NSSE 2007

Active and Collaborative Learning (ACL) Items

100

NSSE 2007 Benchmark Comparisons NSSEville State University

NSSEville State compared with:

Carnegie Peers Effect a b c Mean SigSize39.9 ** .14 48.5 ** .13

50.7

NSSEville State

Senior

48.0

Selected Peers

NSSE 2007

a Mean 41.2 50.1

48.5

Carnegie Peers

b Sig

50.1

NSSE 2007

Effect c Size.05 .04

Students learn more when they are intensely involved in their education and asked to think about what they are learning in different settings. Collaborating with others in solving problems or mastering difficult material prepares students for the messy, unscripted problems they will encounter daily during and after college.

● Asked questions in class or contributed to class discussions ● Made a class presentation ● Worked with other students on projects during class ● Worked with classmates outside of class to prepare class assignments ● Tutored or taught other students ● Participated in a community-based project as part of a regular course ● Discussed ideas from your readings or classes with others outside of class (students, family members, co-workers, etc.)

a Weighted by gender, enrollment status, and institutional size. b * p<.05 ** p<.01 ***p<.001 (2-tailed). c Mean difference divided by comparison group standard deviation.

Page 4

Student-Faculty Interaction (SFI) Benchmark Comparisons

Class First-Year Senior

100

34.3

NSSEville State

a Mean 34.3 41.9

First-Year

31.4

Selected Peers

30.9

Carnegie Peers

Student-Faculty Interaction (SFI) Items

Selected Peers Effect a b c Mean SigSize31.4 *** .17 40.0 * .10

32.8

NSSE 2007

100

NSSE 2007 Benchmark Comparisons NSSEville State University

NSSEville State compared with:

Carnegie Peers Effect a b c Mean SigSize30.9 *** .20 39.6 * .11

41.9

NSSEville State

Senior

40.0

Selected Peers

NSSE 2007

a Mean 32.8 41.2

39.6

Carnegie Peers

b Sig

41.2

NSSE 2007

Students learn firsthand how experts think about and solve practical problems by interacting with faculty members inside and outside the classroom. As a result, their teachers become role models, mentors, and guides for continuous, life-long learning. ● Discussed grades or assignments with an instructor ● Talked about career plans with a faculty member or advisor ● Discussed ideas from your readings or classes with faculty members outside of class ● Worked with faculty members on activities other than coursework (committees, orientation, student-life activities, etc.) ● Received prompt written or oral feedback from faculty on your academic performance ● Worked with a faculty member on a research project outside of course or program requirements

a Weighted by gender, enrollment status, and institutional size. b * p<.05 ** p<.01 ***p<.001 (2-tailed). c Mean difference divided by comparison group standard deviation.

Page 5

Effect c Size.09 .04

Enriching Educational Experiences (EEE) Benchmark Comparisons

Class First-Year Senior

100

24.2

NSSEville State

a Mean 24.2 38.1

First-Year

28.1

Selected Peers

28.0

Carnegie Peers

Selected Peers Effect a b c Mean SigSize28.1 *** -.30 42.2 *** -.23

27.1

NSSE 2007

Enriching Educational Experiences (EEE) Items

100

NSSE 2007 Benchmark Comparisons NSSEville State University

NSSEville State compared with:

Carnegie Peers Effect a b c Mean SigSize28.0 *** -.29 41.1 *** -.17

38.1

NSSEville State

Senior

42.2

Selected Peers

NSSE 2007

a Mean 27.1 39.9

41.1

Carnegie Peers

b Sig*** *

39.9

NSSE 2007

Effect c Size-.22 -.10

Complementary learning opportunities enhance academic programs. Diversity experiences teach students valuable things about themselves and others. Technology facilitates collaboration between peers and instructors. Internships, community service, and senior capstone courses provide opportunities to integrate and apply knowledge.

● Participating in co-curricular activities (organizations, publications, student government, sports, etc.) ● Practicum, internship, field experience, co-op experience, or clinical assignment ● Community service or volunteer work ● Foreign language coursework & study abroad ● Independent study or self-designed major ● Culminating senior experience (capstone course, senior project or thesis, comprehensive exam, etc.) ● Serious conversations with students of different religious beliefs, political opinions, or personal values ● Serious conversations with students of a different race or ethnicity ● Using electronic technology to discuss or complete an assignment ● Campus environment encouraging contact among students from different economic, social, and racial or ethnic backgrounds ● Participate in a learning community or some other formal program where groups of students take two or more classes together

a Weighted by gender, enrollment status, and institutional size. b * p<.05 ** p<.01 ***p<.001 (2-tailed). c Mean difference divided by comparison group standard deviation.

Page 6

Supportive Campus Environment (SCE) Benchmark Comparisons

Class First-Year Senior

100

59.4

NSSEville State

a Mean 59.4 56.5

First-Year

58.6

Selected Peers

58.3

Carnegie Peers

Selected Peers Effect a b c Mean SigSize58.6 .05 55.4 .06

59.8

NSSE 2007

Supportive Campus Environment (SCE) Items

100

NSSE 2007 Benchmark Comparisons NSSEville State University

NSSEville State compared with:

Carnegie Peers Effect a b c Mean SigSize58.3 .06 54.6 * .10

56.5

NSSEville State

Senior

55.4

Selected Peers

NSSE 2007

a Mean 59.8 56.9

54.6

Carnegie Peers

b Sig

56.9

NSSE 2007

Effect c Size-.02 -.02

Students perform better and are more satisfied at colleges that are committed to their success and cultivate positive working and social relations among different groups on campus.

● Campus environment provides the support you need to help you succeed academically ● Campus environment helps you cope with your non-academic responsibilities (work, family, etc.) ● Campus environment provides the support you need to thrive socially ● Quality of relationships with other students ● Quality of relationships with faculty members ● Quality of relationships with administrative personnel and offices

a Weighted by gender, enrollment status, and institutional size. b * p<.05 ** p<.01 ***p<.001 (2-tailed). c Mean difference divided by comparison group standard deviation.

Page 7

NSSE 2007 Benchmark Comparisons With Highly Engaging Institutions

Interpreting the Top 10% and Top 50% Comparisons

This section of the NSSE Benchmark Comparisons report allows you to estimate the performance of your average student in relation to the average student attending two different institutional peer groups identified by NSSE for their high levels of student engagement: (a) those with benchmark scores placing them in the top 50% of all NSSE schools in 2007 and (b) those a with benchmark scores in the top 10% for 2007. These comparisons allow an institution to determine if their engagement of their students differs in significant, meaningful ways from these high performing peer groups.

Example

LAC ACL SFI EEE SCE

NSSEville State Mean 57.1 50.3 37.3 21.8 60.9

NSSE 2007 Top 50% Mean Sig Effect size 55.8 * .10 45.8 *** .28 37.2 .01 30.0 *** -.63 64.7 *** -.21

Mean 60.5 50.7 42.0 34.4 69.7

NSSE 2007 Top 10% Sig Effect size ** -0.28 -0.02 *** -0.24 *** -0.98 *** -0.49

NSSEville State CAN conclude... The average score for NSSEville State first-year students is slightly above (i.e., small positive effect size) that of the average student attending NSSE 2007 schools that scored in the top 50% on Level of Academic Challenge (LAC). The average NSSEville State first-year student is as engaged (i.e., not significantly different) as the average student attending NSSE 2007 schools that scored in the top 10% on Active and Collaborative Learning (ACL). It islikelythat NSSEville State is in the top 50% of all NSSE 2007 schools for first-year students on Level of a,b Academic Challenge (LAC) and Active and Collaborative Learning (ACL).

a NSSEville State CANNOT conclude ... NSSEville State is in the top half of all schools on the Student-Faculty Interaction (SFI) benchmark for first-year b students. NSSEville State is a "top ten percent" institution on Active and Collaborative Learning (ACL) for first-year b students.

For additional information on how to understand and use the Top 50% and Top 10% section of the benchmark report, see www.nsse.iub.edu/2007_Institutional_Report/.

a Precision-weighted means (produced by Hierarchical Linear Modeling) were used to determine the top 50% and top 10% institutions for each benchmark, separately for first-year and senior students. Using this method, benchmark scores of institutions with relatively large standard errors are adjusted substantially toward the grand mean of all students, while those with smaller standard errors receive smaller corrections. Thus, schools with less stable data, though they may have high scores, may not be identified among the top scorers.

b NSSE does not publish the names of the top 50% and top 10% institutions because of our commitment not to release individual school results and because of issues raised in our policy against the ranking of institutions.

Page 8

Senior

Enrichin Educational Ex eriences (EEE)

Senior

38.1

32.4

29.5

42.1

First-Year

Senior

54.3

57.8

First-Year

24.2

NSSEville State compared with NSSE 2007 NSSE 2007 Top 50% Top 10% a c a c Mean Sig Effect size Mean Sig Effect size 55.3***-.28 57.8***-.47 45.3***-.20 48.7***-.38 37.1***-.15 40.4***-.31 29.5***-.40 32.4***-.61 65.2***-.32 68.2***-.48 58.8***-.22 63.1***-.55 54.3***-.21 57.8***-.41 47.4***-.26 54.1***-.56 45.6***-.43 50.3***-.69 63.1***-.36 66.3***-.53

100

Active and Collaborative Learnin (ACL)

100

LAC ACL SFI EEE SCE LAC ACL SFI EEE SCE

Senior

65.2

47.4

58.8

50.7

Student-Facult Interaction (SFI)

100

Senio

57.8

55.7

First-Year

First-Yea

NSSEville State a Mean 51.8 42.1 34.3 24.2 59.4 55.7 50.7 41.9 38.1 56.5

34.3

37.1

This display compares your students with those attending schools that scored in the top 50% and top 10% of all NSSE 2007 institutions on the benchmark.

63.1

Level of Academic Challen e (LAC)

Legend SSEville State Top 50% Top 10%

100

45.3

48.7

a Weighted by gender, enrollment status, and institutional size. b * p<.05 ** p<.01 ***p<.001 (2-tailed). c Mean difference divided by comparison group standard deviation.

45.6

50.3

59.4

NSSE 2007 Benchmark Comparisons With Highly Engaging Institutions NSSEville State University

55.3

51.8

54.1

40.4

41.9

First-Year

56.5

Page 9

Senior

First-Year

68.2

66.3

ortive Cam us Environmen (SCE)

63.1

Selected Peers Carnegie Peers NSSE 2007 Top 50% Top 10%

STUDENT-FACULTY INTERACTION (SFI) NSSEville State (N = 529) 34.3

ACTIVE AND COLLABORATIVE LEARNING (ACL) NSSEville State (N = 571) 42.1 15.8

a All statistics are weighted by gender, enrollment status, and institutional size. b Standard Deviation is a measure of the average amount the individual scores deviate from the mean of all the scores in the distribution.

SUPPORTIVE CAMPUS ENVIRONMENT (SCE) NSSEville State (N = 502) 59.4

Mean Statistics

LEVEL OF ACADEMIC CHALLENGE (LAC) NSSEville State (N = 517) 51.8

32 30 30 34 37

48 48 52 57 58

60 60 61 64 67

28 28 28 33 36

47 47 47 53 56

58 58 61 67 69

39 39 44 50 53

Selected Peers Carnegie Peers NSSE 2007 Top 50% Top 10%

c The 95% confidence interval for the population mean it is equal to the sample mean plus/minus the product of 1.96 times the standard error of the mean. d A percentile is the point in the distribution of student-level benchmark scores at or below which a given percentage of benchmark scores fall. e Degrees of freedom used to compute the t-tests. Values vary for the total Ns due to weighting and the equal variance assumption.

13.3

19 19 19 24 24

f Statistical significance represents the probability that the difference between the mean of your institution and that of the comparison group occurred by chance. g Effect size is calculated by subtracting the comparison group mean from the school mean, and dividing the result by the standard deviation of the comparison group.

ENRICHING EDUCATIONAL EXPERIENCES (EEE) NSSEville State (N = 508) 24.2 12.2

Selected Peers Carnegie Peers NSSE 2007 Top 50% Top 10%

40.1 39.9 41.2 45.3 48.7

.1 .1 .0 .1 .2

17.5 18.1 18.6 17.9 18.3

73 73 74 76 78

17,456 47,732 168,742 58,353 13,994

Distribution Statistics d Percentiles 25th 50th 75th 95th

18.4

15.6 15.9 16.2 16.0 17.2

.1 .1 .0 .1 .2

First-Year Students

67 67 71 75 81

Selected Peers Carnegie Peers NSSE 2007 Top 50% Top 10%

28.1 28.0 27.1 29.5 32.4

Effect g size

.17 .20 .09 -.15 -.31

.13 .14 .05 -.20 -.38

-.02 .02 .00 -.28 -.47

-.30 -.29 -.22 -.40 -.61

51 51 50 52 55

16,808 45,564 161,034 46,992 10,326

Page 10

58.6 58.3 59.8 65.2 68.2

44 43 43 47 49

52 51 52 55 58

27 27 26 29 32

19 19 18 20 23

67 61 67 72 78

17,604 539 170,932 50,539 9,970

52.1 51.5 51.7 55.3 57.8

29 29 29 33 38

38 38 38 43 48

3.0 3.4 1.5 -2.7 -6.0

.000 .000 .050 .001 .000

542 519 510 514 548

7 6 11 11 11

17.4 17.2 17.8 18.5 19.4

18.8

10 10 8 11 12

69 69 72 78 81

36 36 35 37 41

86 89 92 94 97

Reference Group Comparison Statistics Deg. of Mean e Freedom Diff. Sig.

19,008 52,717 184,649 57,295 649

2.0 2.2 .9 -3.2 -6.6

.002 .001 .196 .000 .000

.620 .604 .950 .000 .000

17 17 22 22 28

28 28 28 33 39

.1 .1 .0 .0 .1

13.0 12.9 13.1 13.1 13.3

12.6 13.0 13.3 12.7 12.7

.1 .1 .0 .1 .1

31.4 30.9 32.8 37.1 40.4

-3.8 -3.8 -2.8 -5.3 -8.1

.000 .000 .000 .000 .000

.1 .1 .0 .1 .2

c SEM

5th

-.3 .3 .0 -3.6 -6.0

.05 .06 -.02 -.32 -.48

NSSE 2007 Benchmark Comparisons a Detailed Statistics and Effect Sizes NSSEville State University

Mean

.9 1.1 -.4 -5.8 -8.7

.281 .167 .632 .000 .000

.04 .05 .01 -.22 -.55

Effect g size

d A percentile is the point in the distribution of student-level benchmark scores at or below which a given percentage of benchmark scores fall. e Degrees of freedom used to compute the t-tests. Values vary for the total Ns due to weighting and the equal variance assumption. f Statistical significance represents the probability that the difference between the mean of your institution and that of the comparison group occurred by chance. g Effect size is calculated by subtracting the comparison group mean from the school mean, and dividing the result by the standard deviation of the comparison group.

Page 11

.10 .11 .04 -.26 -.56

-.23 -.17 -.10 -.43 -.69

.16 .13 .04 -.21 -.41

55.4 54.6 56.9 63.1 66.3

18.3 18.8 19.1 18.5 18.6

.2 .1 .1 .1 .2

76 76 81 86 90

14,565 41,939 142,583 33,974 582

78 78 80 83 94

.1 .1 .0 .1 .2

19.9

16.8 17.1 17.3 16.9 17.5

38 38 38 43 48

48 48 48 52 57

24 24 24 29 29

Reference Group Comparison Statistics Deg. of Mean e Freedom Diff. Sig.

Distribution Statistics d Percentiles 25th 50th 75th 95th

14,436 459 451 40,693 6,346

78 78 78 81 84

65 65 65 69 73

55 55 56 59 64

32 32 32 36 40

46 46 46 50 54

42 41 39 46 51

14 14 11 17 21

29 28 26 33 39

55.2 55.1 55.6 58.8 63.1

25 22 25 31 33

67 67 69 75 81

56 56 58 64 67

44 42 44 50 53

Mean

1.1 1.8 -.4 -6.7 -9.8

.232 .045 .634 .000 .000

.06 .10 -.02 -.36 -.53

NSSE 2007 Benchmark Comparisons a Detailed Statistics and Effect Sizes NSSEville State University

c SEM

.2 .1 .1 .1 .3

20.4 20.5 20.7 21.3 21.7

.403 .298 .855 .000 .000

.1 .1 .0 .1 .2

15,196 44,224 148,796 43,714 536

2.7 2.2 .6 -3.6 -7.1

.000 .006 .436 .000 .000

40.0 39.6 41.2 47.4 54.1

14,250 40,697 138,627 54,202 11,196

71 71 71 75 79

.1 .1 .0 .1 .2

Selected Peers Carnegie Peers NSSE 2007 Top 50% Top 10%

17.5 17.5 17.8 17.5 17.5

c The 95% confidence interval for the population mean it is equal to the sample mean plus/minus the product of 1.96 times the standard error of the mean.

14,046 40,030 136,550 35,715 9,214

86 86 89 94 94

11 11 11 17 22

.040 .016 .436 .000 .000

.000 .000 .041 .000 .000

-4.1 -3.0 -1.7 -7.5 -12.1

2.0 2.3 .8 -5.5 -12.1

ENRICHING EDUCATIONAL EXPERIENCES (EEE) NSSEville State (N = 442) 38.1 17.2

42.2 41.1 39.9 45.6 50.3

Selected Peers Carnegie Peers NSSE 2007 Top 50% Top 10%

STUDENT-FACULTY INTERACTION (SFI) NSSEville State (N = 458) 41.9

48.0 48.5 50.1 54.3 57.8