Medical College of Georgia top bar(2150 bytes)

Title Page

Executive Summary

Chapter I:
Definition of the Problems/Issues

Problem Statement
Definitions
Background
Research Objective

Chapter II:
Literature Review

Shelf Reading and
     Shelving
Staff Motivation
Staffing and Training
Benchmarking

Chapter III:
Methodology

Type of Research
Hypotheses
Units of Analysis
Data Usage Indicators
Population/Sample

Chapter IV:

Reliability and Validity
Scope and Limitations
Analysis
Results
Summary

Chapter V:
Summary, Conclusions and Recommendations

Summary
Conclusions
Recommendations

References

Appendixes

List of Tables

List of Charts


 

Data Analysis

Data analysis consisted of charts on all observations and historical data. These were used to make comparisons of each aspect relating to quality. First, all data were collected and charted. Second, the mean or average of each set was calculated. Third, some of the data were analyzed through the use of chart functions in PowerPoint for comparison. A Z-test was performed to test if there were a significant difference between the shelving quality of books versus journal collections.

Reliability and Validity

Historical data and observational data from the actual population were collected. These provided accurate and reliable results. Measured was the exact level of quality or accuracy of items shelved in the book and journal collections. These results also provided information useful to management for making decisions regarding staffing issues. By using several different sources of information the possibility of bias was significantly reduced. Actual population data were collected through shelf-reading of the book and journal collections. This was done by experienced staff with an extremely accurate and reliable indicator of current quality. These data were useful for making comparisons to see if there were a significant difference between the two collections.

Scope and Limitations

The scope and limitations of this study was shelving quality or accuracy of the book and journal collections in the Greenblatt Library. The study did not include information from other collections in the Greenblatt Library nor did it include data from other health science libraries

Analysis

  1. Data collection and analysis of Actual shelf reading results from full time staff reading the entire book and journal collections

Observational data were collected for the book collection in November 1997 and for the journal collection in August 1997. Both collections were shelf-read by experienced full-time staff and senior level library assistants. The table below displays the actual number of units each reader read (1 unit = 7 shelves), the number of errors found, and the totals.

Table 1
Actual Shelf Reading Data for Books - November 1997

  Reader
1
Reader
2
Reader
3
Reader
4
Reader
5
Reader
6
Reader
7
Reader
8
Total
Units 25 27 28 34 38 24 27 29 232
Errors 40 41 26 41 48 4 75 98 373

The book collection was read by eight readers. The instructions given to readers were to count only errors from items found on incorrect shelves; however, readers 7 and 8 included all errors. These included transpositions on the same shelf. This could have skewed the results of this data collection section, slightly in the direction of having lower quality. However, because the results were already within the acceptable level of greater than 95% accuracy, no adjustments were made.

The book collection was divided into units and assigned to library staff for shelf- reading. There were 232 units with seven shelves each. This was a total of 1,626 actual shelves of books. The total number of books is approximately 68,808. This figure was from the FY 1997 Annual Report Statistics kept by Cataloging Services. This was the most accurate figure available.

The mean was calculated by subtracting the number of errors from the total number of books in the collection (68,808-373 = 68,435). This gave the total number of accurately shelved books. The number of accurately shelved books was divided by the total number of books in the book collection (68,435/68,808 = .9945). Lastly, this number was multiplied by 100 to give the percent of accuracy (.9945*100 = 99.45%) for the book collection. Chart 1 depicts the accuracy level of the book collection.

Chart 1

chart1.gif (32780 bytes)

The journal collection was read by three readers in August 1997. The reading was done by two experienced full-time staff and one senior level library assistant. The journal collection was divided into three approximately equal size sections. Errors were counted only if a journal was in the wrong section and errors which were transpositions within a title were not counted; e.g., volume 1, 2, 4, 3, etc., on the same shelf would be considered correct. It took a total of 24 hours to read all of the journal collection and only three errors were found. The total number of volumes were provided from the FY 1997 Annual Report. Table 2 below shows the data collected from the journal collection reading done in August 1997.

Table 2
Actual Shelf Reading Data for Journals - August 1997

Reader Section Errors
Reader 1 Section 1 1
Reader 2 Section 2 2
Reader 3 Section 3 0

The journal collection calculations for finding the mean were done in exactly the same way as for the book collection. The total number of errors was subtracted from the total number of books in the collection (102,055 - 4 = 102051). This gave the total number of accurately shelved journals. Next, the number of accurately shelved journals was divided by the total number of books in the book collection (102,051/102,055 = .9999). Lastly, this number was multiplied by 100 to give the percent of accuracy (.9999*100 = 99.99 %) for the journal collection.

Chart 2

chart2.gif (32780 bytes)

 

The data from this first section were used to test the first hypothesis. It is stated as follows:

  • Hypothesis: The Greenblatt Library’s book and journal collection quality of shelving is not greater than 95% accurate.

Hypothesis 1 is rejected because the mean of the book collection (99.45%) and the journal collection (99.99%) readings were greater than 95% accurate. Chart 3 shows the combined actual shelf reading comparison of the book collection versus the journal collection readings which supports these findings.

Chart 3

chart3.gif (32780 bytes)

These data were also used to test the second hypothesis which follows:

Hypothesis 2: There is a difference in the quality of shelving of books versus journals.

These particular data were chosen for the Z-test because they were highly valid, reliable data and were from a large quantity of data (actual population data). They were collected by experienced staff and the possibility of bias was smaller due to having several staff reading the collection. The data were used to calculate this test..

Book Collection Journal Collection
Population P1 = 68,808 P2 = 10,2055
Sample size n1 = 68,808 n2 = 10,2055
Number of successes x1 = 68,433 x1 = 10,2055
Population mean/successes p1 = .9945 p2 = .9999

Problem: Is a .0054% difference in the mean from the book collection and the mean from the journal collection statistically significant?

Solution:

H0: P1 P2 (There is a difference between the shelving quality of books versus journals) H1: P1 = P2(There is no a difference between the shelving quality of books versus journals)

If = .05, and p = percentage of shelving quality/accuracy of the book and journal collections and p1 = .9945 (books), p2 = .9999 (journals), n1 = 68,808, and n2 = 10,2055 then P* = n1 P1 +n2 P2 /n1 +n2 or 68808*.9945 +102055*.9999/68,808+102,055 = .9977

P1-P2

.9945 - .9999

.0054

Z =                         =

=

=.0034
(P*)(1-P*)(1/n1+1/n2)

.9977*.9977* 2.433

1.5524

The Z value at .05 level is 0.0000 for a two-tailed test. Because Z0 = Z /2 it is concluded that there is no significant difference between the shelving quality of books versus journals.

  1. Direct shelf reading observations from random spot checks

Direct shelf reading observations in the book and journal collections were done. They produced approximately the same results as actual shelf reading from population data. These results were 99.45% accuracy for books and 99.63% accuracy for journals as compared to section 1 results of 99.45% accuracy for books and 100% accuracy for journals. The spot checks were done by the LInC evening/weekend supervisor over a two months period. There were 25 random readings from each collection. This information was useful as a verification of reliability and validity. Tables 3 and 4 are the actual data sample results as collected. Table 3 displays the book collection data and Table 4 displays the journal collection data. Additional data collected from these tables include the mean for books per shelf and the mean for journals per shelf.

Charts 4 and 5 show the level of accuracy for the book and journal collections separately. Chart 6 shows the comparison of the two collections. These charts indicate the collection accuracy is > 95% for both collections, thus supporting the first hypothesis and varifying the first section full shelf reading totals.

Table 3
Sample Shelf Reading Data for Books - Collected August 1995

Reading No. Shelf No. No. Items Checked Correct. Errors
1 478 22 22 0
2 328 16 15 1
3 519 34 34 0
4 57 31 30 1
5 1,024 25 25 0
6 993 22 22 0
7 649 13 12 1
8 848 29 29 0
9 1,521 27 27 0
10 858 18 18 0
11 455 27 27 0
12 1,144 28 28 0
13 339 23 23 0
14 800 29 29 0
15 767 18 18 0
16 1,112 12 12 0
17 917 23 23 0
18 3 32 32 0
19 187 14 13 1
20 559 30 28 2
21 589 20 20 0
22 498 28 28 0
23 429 24 24 0
24 1,077 24 24 0
25 905 28 28 0
  Total 597 591 6
    Mean (591/594=99.49%) (6/..0051=1%)

Table 4
Sample Shelf Reading Data for Books - Collected August 1997

Reading
No.

Shelf
No.

No. Items
Checked

Correct.

Errors

1 420 20 20 0
2 1,619 15 15 0
3 886 26 26 0
4 412 18 18 0
5 28 28 28 0
6 22 22 21 1
7 6 6 6 0
8 2,005 23 23 0
9 199 25 25 0
10 3,160 20 20 0
11 853 19 19 0
12 4,600 24 24 0
13 220 31 31 0
14 4,967 22 22 0
15 2,788 17 17 0
16 4,420 14 14 0
17 1,760 21 21 0
18 1,893 21 21 0
19 1,379 10 10 0
20 789 21 21 0
21 4,317 49 49 0
22 1,934 26 25 0
23 3,279 23 23 0
24 62 23 23 0
25 2,200 25 25  
    549 547  
    Mean (546/549=99.63%) (2/549=00.36%)

Chart 4

chart4.gif (32780 bytes)

Chart 5

chart5.gif (9045 bytes)

Chart 6

chart6.gif (32780 bytes)

  1. Cumulative supervisor spot check reports on library assistants

Cumulative supervisor spot checks of the shelving quality of each part-time library assistant were collected from LInC evening/weekend supervisor. Ten books from each cart were chosen. This was done by the process of selecting every third book and then scanning the barcode into the Library Information System. Next the book title and call number were printed and the number of books per cart, cart number and date were noted on the paper. The cart was processed for shelving and the library assistant would sign out the cart for shelving. This was the usual process for shelving. The shelver did not know if their particular cart was being checked for accuracy. However, the shelvers did know the supervisor checked shelving accuracy on a random basis throughout the year. The LInC evening/weekend supervisor then waited until the cart was shelved and checked the 10 books for accuracy. Table 5 below displays the results.

Table 5
Sample Shelf Reading Data for Books - Collected August 1997

Sample No.

No. Books on Cart

Correct Errors

No. Journals on Cart

Correct Errors
1 60 10 0 38 10 0
2 40 9 1 60 10 0
3 42 10 0 38 10 0
4 52 10 0 34 10 0
5 44 10 0 44 10 0
6 41 10 0 41 10 0
7 43 10 0 28 10 0
8 58 10 0 36 10 0
9 52 10 0 44 10 0
10 56 10 0 38 10 0
11 54 10 0 34 10 0
12 42 10 0 33 10 0
13 42 10 0 39 10 0
14 52 10 0 34 10 0
15 47 8 2 29 10 0
16 35 10 0 36 10 0
17 46 10 0 39 10 0
18 40 10 0 28 10 0
Totals 846 177 3 673 180 0

Mean for books per cart = 47
Mean for journals per cart = 37
Mean for shelving accuracy of books = 98.34%
Mean for shelving accuracy of journals = 100%

The results from these tables were also used for testing the first hypothesis. Greenblatt Library’s book and journal collection quality of shelving is > 95% accuracy. The mean for book errors was .012 and the mean for journal errors was .000. Accuracy percentages were derived by dividing the number of errors in each section by 180 which was the number of items used to check each collection. In order to find the percent of accuracy each total was subtracted from one, then multiplied by 100. For the book collection this total was 98% accuracy and for the journal collection the total was 100 % accuracy. The results of this section are displayed in Charts 7, 8 and 9. Chart 7 depicts the accuracy level for shelving books, Chart 8 for journals and Chart 9 compares the two.

Chart 7

chart7.gif (32780 bytes)

Chart 8

chart8.gif (32780 bytes)

Chart 9

chart9.gif (32780 bytes)

  1. Complaint forms received which were related to shelving issues

There were zero complaint forms received which related to shelving issues. This, too, indicates high quality shelving in both book and journal collections.

Dissatisfied users = .00     Satisfied users = 100%

  1. Item locate requests for the past six months

Item locate requests for the past six months were counted and divided into groups. They were counted as possible shelving errors if they were found shelved incorrectly or not found at all. They were not counted in the study if they were found shelved correctly or checked out. There was a total of 21 locate requests for books from April 1997-September 1997. Of those 21 requests, 2 were checked out, 5 were found in the stacks and 1 was found in library. This left only 13 possible shelving errors in six months.

Journal locate requests were handled in the same manner. There were a total of 19 locate requests and of those 19, 1 journal was found checked out and 12 were found in the stacks, leaving only 6 possible shelving errors for the same six-month period.

There are a number of reasons other than misshelving errors which could cause a book to be missing (e.g., the book could be lost or hidden by a library user). However, these data will be useful for a later comparison to see if there is an increase/decrease in locates and compared with the total check outs. It can also be used as an indicator of quality from the perspective of users. This relates to the user being able to find or access the item they are looking for in the library. The number of check-outs for this same six- month period of time (11,560) divided into the total possible misshelvings gave a percentage of non-accessability for both collections (29/11,560=.0025). Then, the non-accessability total (.0025) subtracted from 1 and multiplied by 100 gave the percentage of accessability which was 99.75% for books and journals.

  1. Total number of requests from full time staff to LInC supervisor for library assistants to shelf-read in a particular area

The total number of requests from April 1997 through September 1997, from full-time staff to the LInC supervisor regarding particular sections which appear to need shelf- reading or straightening was two for the book collection and zero for the journal section. This, too, was an indicator of shelving quality, but it is a better figure to follow over time as a benchmark for quality.

  1. Shelf reading log for the past six months

From April 1997 through September 1997, 10.5 hours of shelf-reading were recorded for the book collection and 4.6 hours were recorded for the journal collection. These figures are specifically library assistant shelf reading and do not include the complete shelf-reading done by the full-time LInC staff and senior library assistant. They are to be used as benchmark totals useful to follow over time.

  1. Additional information and samples

Additional information and samples gathered included the number of minutes it took to shelf read a unit of books (7 shelves) and a unit of journals (6 shelves), the number of units in the book (236) and units of journals in the collection, and the price per hour paid to FY97 library assistants ($5.23). These totals were needed to calculate how much time it should take for the Library Assistants to shelf read both collections and how much it would cost.

It was found that the mean for the number of minutes it took to shelf read one unit of books was 6.20. The average number of minutes to shelf read one unit of books times the number of units in the book collection gives the number of minutes it would take to shelf read the entire book collection (6.20 * 236 = 1,463.20 minutes or 1,463.20/60= 24.38 hours). The number of hours multiplied by the pay per hour for library assistants is the cost of reading the book collection (24.38 * $5.23 = $127.54).

This same process was repeated for the journal collection. The average number of minutes to shelf read one unit of journals times the number of units in the journal collection gives the number of minutes it would take to shelf read the entire journal collection (3.04 * 754 = 2,292.16 minutes or 2,292.16/60 = 38.20 hours). The number of hours multiplied by the pay per hour for library Assistants is the cost of reading the journal collection (38.20 * $5.23 = $199.79). Table 6 contains 25 samples of the number of minutes it took to shelf read in the book collection and Table 7 contains 25 samples of the number of minutes it took to shelf read in the journal collection.

Table 6
Sample Shelf Reading for the Number of Minutes to Shelf Read 1 Range of Books - (1 range = 7 shelves) - Collected November 1997

Each number in this data set represents the number of minutes it takes to read 1 range of books

     Column 1          Column 2           Column 3            Column 4            Column 5

5 10 4 5 5
4 6 4 8 7
5 10 8 8 6
6 10 8 7 6
5 10 4 6 6

mean = 163 (total number of minutes spent) / 25 (total number of readings) = 6.52 minutes per range

Table 7
Sample Shelf Reading for the Number of Minutes to Shelf Read 1 Range of Journals - (1 range = 6 shelves) - Collected November 1997

Each number in this data set represents the number of minutes it takes to read 1 range of journals

     Column 1           Column 2           Column 3           Column 4           Column 5

4 3 3 3 3
4 3 3 3 3
3 3 3 2 3
3 3 2 3 2
4 4 3 3 3

mean = 76 (total number of minutes spent) / 25 (total number of readings) = 3.04 minutes per range

Results

The alternative to the null hypothesis one was accepted because the data supports that there is a greater than 95% accuracy for the book and journal collections at the Greenblatt Library. In fact, the data support a greater than 99.72% accuracy level average for the two collections.

The alternative to the null hypothesis two was accepted because the data results from the Z-test found there was no significant difference between the quality/accuracy of the book collection versus journal collection.

Summary

  • The level of quality for the book and journal collections was 99.45% (book), and 99.99% (journal) from actual shelf reading the entire collections. The average for both was 99.72%.

  • Random spot checks in the book and journal collections quality/accuracy level were at 99.49% for books and 100% for journals. The average for the two collections was 99.45%.

  • The average number of books per shelf was 23.88 and the average number of journals per shelf was 22.

  • Random spot checks of shelvers’ quality/accuracy were 98.34% for books and 100% for journals. The average quality/accuracy for both collections was 99.17%.

  • There were 0 complaints relating to shelving in books or journals for a six month period of time. This indicates 100% quality or user satisfaction related to shelving.
  • There were 29 possible misshelvings related to locate request from users. These were from both book and journal collections.

  • The total number of check-outs for April 1997-September 1997 was 11,560.

  • The accessibility rate relating to locates is 99.75% accessibility for books and journals.

  • Total number of requests from LInC full time staff to LInC supervisor to have someone shelf-read in a particular area because it appeared to be sloppy were two for the book collection and zero for the journal collection.

  • Total number of library assistant shelf- reading hours for six months = 10.5 for books and 4.6 for journals.

  • The average number of minutes to shelf-read one unit of books was 6.20 and the average number of minutes to shelf read one unit of journals was 3.04.

  • The average number of units in the book section was 236 and the number of units in the journal section was 754.

  • The pay per hour for the library assistants was $5.23.

  • The total cost to shelf read the book collection was $127.54 (if read by library assistants) and the total cost to shelf-read the journal collection was $199.78.

Back to Main Menu

Copyright © 1998
Medical College of Georgia
All rights reserved

   

Library   |  Medical College of Georgia

Please email comments, suggestions or questions to:
Jackie Rodgers, jrodgers@mail.mcg.edu.
September, 1998