National Academies Press: OpenBook

Safety is Seguridad: A Workshop Summary (2003)

Chapter: 4 Development and Evaluation of Materials

« Previous: 3 What Information Exists and What Are the Gaps?
Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×

4
Development and Evaluation of Materials

The first question regarding the development of new materials is how to prioritize which gaps to fill. The committee uses the term “materials” in this report to mean not only written information, but also communications methods such as audiocassettes, videocassettes, workshops, meetings, comic books, television and radio programming. In general, workshop participants were of the opinion that priority should not be on translation of technical health and safety documents. Rather, emphasis would be better placed on developing materials as part of a strategic initiative to reach Spanish-speaking workers, their employers, and their communities with practical information that can assist in injury and illness prevention in the workplace. Materials development in Spanish is important but only in the context of a larger outreach, education, and action strategy. A thought repeatedly expressed during the workshop was: “Good Spanish-language materials are necessary but not sufficient.”

A more comprehensive approach requires that those who develop new, effective materials be able to plan a comprehensive education plan that takes into account the organizational, societal, economic, and other factors that define the environment in which workplace change must take place. Ideally, materials development would be in the context of a plan that considers the significant barriers immigrant workers may face in taking action for workplace safety. These include fear based on immigration status, linguistic and language barriers, and different work experiences in their countries of origin. An effective approach also requires that we draw on cultural strengths, such as strong community institutions and health beliefs.

Much is known about cultural appropriateness and cultural competence in other aspects of public health. In the opinion of the workshop participants, the occupational safety and health community needs to become more familiar with the literature and experiences in such fields as tobacco control, human immunodeficiency virus and acquired immune deficiency syndrome education, and other significant public health campaigns that have addressed cultural and linguistic issues successfully. Partnerships with community and other public health professionals with health education and communications expertise would be useful.

Finally, workshop participants noted that it would be beneficial if materials development in Spanish drew on sound principles of effective adult education, social marketing, and public health education. Some of the key precepts that are well established include:

  1. involvement of the target population in developing the educational message and outreach plan;

  2. pilot testing of materials with the target population to assess, for example, appropriate messages, literacy level and readability, terminology, and graphics;

  3. use of workers’ own narratives and images in materials;

  4. development of action-oriented (problem-solving), participatory, and hands-on educational materials;

  5. addressing of different learning styles by using a variety of methods;

Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×
  1. use of multiple means of communication and education (e.g., radio, face-to-face, comic books); and

  2. design materials that allow them to be used with some flexibility in a variety of instructional and learning situations.

When existing materials are being translated into Spanish, many of these same principles will apply. Workshop participants agreed that materials should be adapted for use by a Spanish-speaking audience, rather than simply translated literally. There was substantial discussion in the workshop about the preference for materials developed originally in Spanish (or in Spanish and English) rather than translated. However, because this is not always feasible, the importance of high-quality translation was highlighted. In particular, translations should be performed by native Spanish speakers who are qualified as translators and not just by anyone who speaks Spanish; translations should then be reviewed by native Spanish speakers and pilot tested with the intended audience. When translating materials, the education level of the audience should be taken into account. Unfortunately, there are far too many examples of embarrassingly bad translations, according to the workshop participants.

Approaches to materials development are most effective if grounded in broader intervention efforts that are based on sound principles of program planning. These principles include targeting interventions based on the best available surveillance data; thoroughly assessing needs; involving stakeholders in the process; establishing clear, measurable objectives; designing a participatory education program; pilot testing with the target population; evaluating program effectiveness; and revising efforts based on findings. Workshop participants thought it is essential that leadership and staff in organizations that fund materials development and testing understand the resource needs. The CDC Guide to Community Based Public Health Practice includes methodological guidelines for designing and funding sound evidence-based intervention research.3

Once an educational intervention is well tested, a wide-ranging dissemination program will be needed. It is essential to customize dissemination program to each audience and situation. Given the seriousness of the situation, society cannot afford to continually “reinvent the wheel.” Therefore, it is important that results be shared so that resources are maximized.

Workshop participants discussed the desire for a concerted effort to promote evaluation of Spanish-language materials. Evaluation should be built into the initial planning stages of materials development and educational interventions of all kinds. Materials development is greatly enhanced when target populations, objectives, and methods for measuring accomplishments are defined. However, during the push to develop and use materials, the evaluation phase does not always occur, because all too often these development projects lack evaluation resources.

Workshop participants thought that it is important to have a solid evaluation process of multiple phases, including (1) pilot testing and focus groups with intended audiences during the development phase; (2) feedback from end users (such as trainees) to determine comprehension of the materials; and (3) evaluation to determine which practices work best. In addition, there was discussion of how to review and rate existing materials in Spanish. One suggestion was that an organization should create a comprehensive clearinghouse of safety and health material on the Internet as a single source for this information in Spanish. Others responded that Internet sites might be burdensome and difficult to navigate, and the content quality might be questionable, depending on the skill and background of the person or group authoring a Web site. In addition to the task of developing acceptable criteria, the task of going through all the material may become overwhelming. As discussed in a later section, Hispanics still have limited access to the Internet.

There are, however, some positive examples of information compilation sites. The National Institute of Environmental Health Sciences clearinghouse on hazardous waste materials

Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×

management4 and the Building Trades Master Trainers forum5 are sites with no official evaluation of materials. On the other hand, the National Agricultural Safety Database6 and Electronic Library for Construction Occupational Safety and Health7 have advisory boards to review content.

Workshop participants agreed that rating criteria are important. Possible rating criteria discussed include:

  • whether materials for Hispanic workers are presented in a manner that is “culturally and linguistically competent,” comfortable to the worker, and not offensive;

  • whether materials are grammatically correct but in the vernacular of the workers, even when it may be a mix of Spanish and English (these variations can be identified as such);

  • whether materials are created for the appropriate literacy levels of the workers;

  • whether the information provided is technically sound; and

  • whether the subject matter is compatible with audience priorities and needs.

Workshop participants agreed that it is essential that a solid materials evaluation process be implemented so that materials can be judged as efficacious before being introduced to the workforce. Likewise, a program of continual evaluation is important to assure that the target population understands the materials and the materials continue to improve. Agreement on a common set of evaluation criteria would be useful both for the development of new materials and for distribution of existing materials through some type of clearinghouse.

4  

See <http://www.niehs.nih.gov>. Date accessed November 5, 2002.

5  

See <http://www.buildingtrades.org>. Date accessed November 5, 2002.

6  

See <http://www.cdc.gov/niosh/nasd/nasdhome.html>. Date accessed November 5, 2002.

7  

See <http://www.cdc.gov/niosh/elcosh>. Date accessed November 5, 2002.

Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×
This page in the original is blank.
Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×
Page 19
Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×
Page 20
Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×
Page 21
Suggested Citation:"4 Development and Evaluation of Materials." National Research Council. 2003. Safety is Seguridad: A Workshop Summary. Washington, DC: The National Academies Press. doi: 10.17226/10641.
×
Page 22
Next: 5 Delivery Mode »
Safety is Seguridad: A Workshop Summary Get This Book
×
Buy Paperback | $51.00 Buy Ebook | $40.99
MyNAP members save 10% online.
Login or Register to save!
Download Free PDF

Approximately 32.8 million persons of Hispanic descent live in the United States, half of whom were born outside the United States (Therrien and Ramirez, 2000). By the year 2050, it is expected that Hispanics will constitute more than 25 percent of the total U.S. population and approximately 15 percent of the U.S. labor force. These estimates and the fact that 90 percent of Hispanic American men and 60 percent of Hispanic American women participate in the U.S. workforce strongly suggest a need for occupational safety and health information in Spanish.

The growing presence of Spanish-speaking workers and employers in the United States and the unprecedented 12-percent increase in the overall rate of workplace fatalities among Hispanic workers in 2000 highlights the need to better communicate occupational safety and health information in Spanish to both employees and employers. To address this need the National Institute for Occupational Safety and Health (NIOSH) is preparing a strategy for developing and disseminating Spanish-language occupational safety and health educational and technical material. To gather information necessary to create this strategic plan the National Research Council (NRC) was asked to host a workshop. The committee commissioned five white papers (see Appendices D-H) and organized a workshop on May 29-30, in San Diego, California.

Safety is Seguridad: A Workshop Summary is a synopsis of the presentations and discussions at the workshop. It does not contain any conclusions and recommendations. The conclusions and recommendations in the white papers represent the views of the authors and not necessarily those of the committee or the NRC. It is intended as input to the NIOSH strategic planning in this area. Chapter 2 discusses the available information and identifies information gaps regarding risks and adverse events for Latino workers. Chapter 3 examines the available health and safety training resource materials for Latino workers, especially for those with little or no English capabilities; in particular, it discusses issues of the linguistic and cultural appropriateness of materials. Chapter 4 considers issues surrounding the assessment of existing materials and the development of new materials. Chapter 5 discusses the various means of conveying information to Spanish-speaking workers, again focusing on cultural appropriateness and ways of maximizing understanding. Chapter 6 summarizes the discussion in the prior chapters and presents some overarching issues raised by the workshop attendees.

  1. ×

    Welcome to OpenBook!

    You're looking at OpenBook, NAP.edu's online reading room since 1999. Based on feedback from you, our users, we've made some improvements that make it easier than ever to read thousands of publications on our website.

    Do you want to take a quick tour of the OpenBook's features?

    No Thanks Take a Tour »
  2. ×

    Show this book's table of contents, where you can jump to any chapter by name.

    « Back Next »
  3. ×

    ...or use these buttons to go back to the previous chapter or skip to the next one.

    « Back Next »
  4. ×

    Jump up to the previous page or down to the next one. Also, you can type in a page number and press Enter to go directly to that page in the book.

    « Back Next »
  5. ×

    Switch between the Original Pages, where you can read the report as it appeared in print, and Text Pages for the web version, where you can highlight and search the text.

    « Back Next »
  6. ×

    To search the entire text of this book, type in your search term here and press Enter.

    « Back Next »
  7. ×

    Share a link to this book page on your preferred social network or via email.

    « Back Next »
  8. ×

    View our suggested citation for this chapter.

    « Back Next »
  9. ×

    Ready to take your reading offline? Click here to buy this book in print or download it as a free PDF, if available.

    « Back Next »
Stay Connected!