NSSE09 Benchmark Comparisons Report (UT Austin)

Informations

• Publié par: Vukih
• Nombre de lectures: 19
• Langue: English

Extrait

The University of Texas at Austin
Benchmark Comparisons
August 2009b
Note: Each box and whisker chart plots the 5th (bottom of lower bar), 25th (bottom of box), 50th (middle line), 75th (top of box), and 95th (top of upper bar)
c
percentile scores. The dot shows the benchmark mean. See page 2 for an illustration. See pages 10 and 11 for percentile values.
Cla
Me

c
n

a
Size
Me
ct
ct
Effe
Sig
b
Me

n
Sig
b
a
a
n
c
a
Size
Me
Effe
c


a
Size
a
ct
ss
Effe
a
b
a

Weighted by gender, enrollment status, and institutional size.
Sig
* p<.05 ** p<.01 ***p<.001 (2-tailed).
a
Mean difference divided by the pooled standard deviation.
n
NSSE 2009 Benchmark Comparisons
Interpreting the Benchmark Comparisons Report
To focus discussions about the importance of student engagement and to guide institutional improvement efforts, NSSE created
five Benchmarks of Effective Educational Practice: Level of Academic Challenge, Active and Collaborative Learning, Student-
Faculty Interaction, Enriching Educational Experiences, and Supportive Campus Environment. This Benchmark Comparisons
Report compares the performance of your institution with your selected peers or consortium. In addition, page 9 provides two other
comparisons between your school and (a) above-average institutions with benchmarks in the top 50% of all NSSE institutions and
(b) high-performing institutions with benchmarks in the top 10% of all NSSE institutions. These displays allow you to determine if
the engagement of your typical student differs in a statistically significant, meaningful way from the average student in these
comparison groups. They also provide more insight into how the student experience varies on your campus and in comparison
groups. More detailed information about how benchmarks are created can be found on the NSSE Web site at
www.nsse.iub.edu/2009_Institutional_Report/.
aClass and Sample Statistical Significance Effect Size
Means are reported for Benchmarks with mean differences that are larger than would be expected by Effect size indicates the
first-year students and chance alone are noted with one, two, or three asterisks, denoting one of three practical significance of the
seniors. Institution- significance levels (p<.05, p< .01, and p<.001). The smaller the significance level, mean difference. It is
reported class levels the smaller the likelihood that the difference is due to chance. Please note that calculated by dividing the
are used. All randomly statistical significance does not guarantee that the result is substantive or mean difference by the
selected students are important. Large sample sizes (as with the NSSE project) tend to produce more pooled standard deviation. In
included in these statistically significant results even though the magnitude of mean differences may practice, an effect size of .2 is
analyses. Students in be inconsequential. It is recommended to consult effect sizes to judge the practical often considered small, .5
targeted or locally meaning of the results. moderate, and .8 large. A
administered positive sign indicates that
oversamples are not your institution’s mean was
included. Level of Academic Challenge (LAC) greater, thus showing an
affirmative result for the Mean Comparisons NSSEville State University compared with:
institution. A negative sign
NSSEville State Mid East Public Carnegie Class NSSE 2009
indicates the institution lags
First-Year 47.9 53.6 *** -.41 53.1 *** -.39 53.7 *** -.43 behind the comparison group,
Senior 52.2 57.1 *** -.36 56.9 *** -.33 57.0 *** -.34
suggesting that the student
behavior or institutional Mean
Distributions of Student Benchmark Scores practice represented by the The mean is the weighted First-Year Senior
100 100 item may warrant attention.arithmetic average of the
student level benchmark
75 75scores.
50 50
2525Benchmark Description Box and Whiskers Charts
& Survey Items A visual display of first-year and
A description of the 0 0
NSSEville State Mid East Public Carnegie Class NSSE 2009 senior benchmark scoreNSSEville State Mid East Public Carnegie Class NSSE 2009benchmark and the individual dispersion for your institution items used in its creation is and your selected comparison or provided. Level of Academic Challenge (LAC) Items consortium groups.Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels
of student achievement by emphasizing the importance of academic effort and setting high expectations for student performance.
● Preparing for class (studying, reading, writing, doing homework or lab work, etc. related to academic program)
● Number of assigned textbooks, books, or book-length packs of course readings
● Number of written papers or reports of 20 pages or more; number of written papers or reports of between 5 and 19 pages; and
number of written papersports of fewer than 5 pages
● Coursework emphasizes: Analysis of the basic elements of an idea, experience or theory
●ewmphasizes: Synthesis and organizing of ideas, information, or experiences into new, more complex interpretations
and relationships
● Coursework emphasizes: Making judgments about the value of information, arguments, or methods
●ewmphasizes: Applying theories or concepts to practical problems or in new situations
● Working harder than you thought you could to meet an instructor's standards or expectations
● Campus environment emphasizes: Spending significant amount of time studying and on academic work.
95th Percentile
Box and Whiskers Key
A box and whiskers chart is a concise way to summarize the variation 75th Percentile
of student benchmark scores. This display compares the distribution
of scores at your institution, in percentile terms, with that of your 50th Percentile/Median (Bar)
comparison groups. The ends of the whiskers show the 5th and 95th Mean (Dot)
percentile scores, while the box is bounded by the 25th and 75th 25th Percentile
percentiles. The bar inside the box indicates the median score, and the
dot shows the mean score.
5th Percentile
a Page 1 See Contextualizing NSSE Effect Sizes at www.nsse.iub.edu/pdf/effect_size_guide.pdf for additional information. NSSE 2009 Benchmark Comparisons
The University of Texas at Austin
Level of Academic Challenge (LAC)
Mean Comparisons The University of Texas at Austin compared with:
UT Austin AAUDE UT System NCG & TAMU
Effect Effect Effect
a a b c a b c a b cMean Sig Size Mean Sig Size Mean Sig Size Class Mean
First-Year 53.3 54.9 ** -.13 51.1 *** .16 55.4 *** -.17
Senior 57.1 57.2 -.01 55.9 .08 57.4 -.02
a Weighted by gender, enrollment status, and institutional size.
b * p<.05 ** p<.01 ***p<.001 (2-tailed).
c Mean difference divided by the pooled standard deviation.
Distributions of Student Benchmark Scores
First-Year Senior
100 100
75 75
50 50
25 25
0 0
UT Austin AAUDE UT System NCG & TAMU UT Austin AAUDE UT System NCG & TAMU
Note: Each box and whiskers chart plots the 5th (bottom of lower bar), 25th (bottom of box), 50th (middle line), 75th (top of box), and 95th (top of upper bar) percentile scores. The
dot shows the benchmark mean. See page 2 for an illustration. See pages 10 and 11 for percentile values.
Level of Academic Challenge (LAC) Items
Challenging intellectual and creative work is central to student learning and collegiate quality. Colleges and universities promote high levels of
student achievement by emphasizing the importance of academic effort and setting high expectations for student performance.
Preparing for class (studying, reading, writing, doing homework or lab work, etc. related to academic program)
Number of assigned textbooks, books, or book-length packs of course readings
Number of written papers or reports of 20 pages or more; number of written papers or reports of between 5 and 19 pages; and
number of written papers or reports of fewer than 5 pages
Coursework emphasizes: Analysis of the basic elements of an idea, experience or theory
Coursework emphasizes: Synthesis and organizing of ideas, information, or experiences into new, more complex interpretations
and relationships
Coursework emphasizes: Making of judgments about the value of information, arguments, or methods
Coursework emphasizes: Applying theories or concepts to practical problems or in new situations
Working harder than you thought you could to meet an instructor's standards or expectations
Campus environment emphasizes: Spending significant amount of time studying and on academic work.
Page 1NSSE 2009 Benchmark Comparisons
The University of Texas at Austin
Active and Collaborative Learning (ACL)
Mean Comparisons The University of Texas at Austin compared with:
UT Austin AAUDE UT System NCG & TAMU
Effect Effect Effect
a a b c a b c a b cMean Sig Size Mean Sig Size Mean Sig Size Class Mean
First-Year 38.3 42.3 *** -.26 42.5 *** -.25 41.9 *** -.23
Senior 47.6 49.0 -.09 51.5 *** -.22 48.6 -.06
a Weighted by gender, enrollment status, and institutional size.
b * p<.05 ** p<.01 ***p<.001 (2-tailed).
c Mean difference divided by the