Appendix I. Sixteen Assessment questions from baseline and follow up assessments Please define the following terms. No. Evidenced Based Public Health Terms 1 What is informed consent? 2 What is the Belmont Report? 3 What is the Tuskegee Experiment? 4 Define health literacy 5 Define evidence based public health 6 Define cultural competency 7 What role does the Institutional Review Board play in research? 8 What is HIPAA? 9 Explain the difference between quantitative and qualitative research methods 10 What is the difference between Community Based Participatory Research and traditional Research? 11 What is the mixed method approach? 12 Define the term ethnography 13 14 What is the purpose of focus groups? What is the overarching goal of healthy people 2010? 15 What type of information should a program health planner expect to get from a community health assessment? 16 Describe the health promotion planning model that you believe is best to prevent and reduce substance abuse in an African American community
Appendix II CARES Pre-test questions for each session 1. Which of the following is not part of the research process? CARES Session 1 Module Pre-Test MULTIPLE CHOICE Data collection Self-enlightenment Hypothesis construction Interpretation of data 2. You know that research requires a clear articulation of a goal. Is the following statement representative of an articulated goal? "Why do birds form a V-shaped pattern when they fly in groups?" 3. Once you have formulated a research goal, the next step is: 4. If hypotheses are supported by a growing body of data, they evolve into: 5. are tentative explanations that new data either support or do not support. 6. Looking in an encyclopedia to determine who discovered the North Pole is an example of research. 7. Research often includes the publication of what the researcher has discovered 1 No You propose a procedure to reach that goal You accept a hypothesis Laws Theories Hypotheses Theories Facts True False True False TRUE or FALSE Yes You start the collection of data to meet th You devise assumptions Rules Suggestions
8. Hypotheses are never proved in research. 9. The collection of data is a subjective process. 10. The interpretation of data is an objective process. True False True False True False CARES Session 2 Module Pre-Test 1. Which of the following is the strongest predictor of a person s health status? 2. Which of the following are coping mechanisms used by patients with low health literacy? 3. Uniting health information with technology is at the core of healthcare industry changes for the following purposes, except: 4. An informed healthcare consumer can impact the quality of their own care by 5. Health information will be better managed when technology is utilized as a tool. a. Employment status b. Education level b. Income c. Literacy skills a. Nod politely when doctor speaks and don t ask any questions b. Say they forgot their eyeglasses to avoid filling out forms or questionnaires c. Laugh and being forgetful when asked about their medical condition or treatments d. All of the above a. Ensuring national safety b. Threatening a consumer s information privacy c. Improved quality of patient care and safety d. Reduction of healthcare costs a. Calling attention to errors in documented information b. Advising physicians of recent medical tests and medications c. Taking care to balance privacy concerns with information availability d. All of the above a. True b. False 2
CARES Session 3 Module Pre-Test 1. Which of the following statements define the human research principle of respect for persons? 2. Which of the following is not an ethical practice? 3. What is the over-riding principle governing ethical behavior? 4. Which of the following is not considered to be an example of scientific misconduct? 5. Research conducted today has more ethical problems that research conducted 30 years ago. a. The capacity and rights of all individuals to make their own decisions b. The respect for the autonomy of all human beings c. The recognition of the dignity and freedom of all persons d. The need to provide special protection to vulnerable persons e. All of the above a. Sharing your data with other organizations who have a legitimate interest in your research b. Using pseudonyms to protect participants from being identified c. Obtaining someone s informed consent to participate in research project prior to the project starting d. Keeping your data under lock and key a. To obtain the informed consent of the participants b. To avoid dealing with sensitive topics c. To protect research participants and their communities from harm d. To preserve the anonymity of your participants a. Fabrication of data b. Plagiarism c. Publishing a table with a typographical error d. Authorship on a project that you did not work on a. True b. False 3
1. A good qualitative problem statement: CARES Session 4 Module Pre-Test a. Defines the independent and dependent variables b. Conveys a sense of emerging design c. Specifies a research hypothesis to be tested d. Specifies the relationship between variables that the researcher expects to find 2. Research hypotheses are. a. Formulated prior to a review of the literature b. Statements of predicted relationships between variables c. Stated such that they can be confirmed or refuted d. b and c 3. A review of the literature prior to formulating research questions allows the researcher to do which of the following 4. A formal statement of the research question or purpose of research study generally. 5. Sometimes a comprehensive review of the literature prior to data collection is not recommended by grounded theorists. a. To become familiar with prior research on the phenomenon of interest b. To identify potential methodological problems in the research area c. To develop a list of pertinent problems relative to the phenomenon of interest d. All of the above a. Is made prior to the literature review b. Is made after the literature review c. Will help guide the research process d. All of the above e. e. b and c a. True b. False 4
5
1. According to the text, questionnaires can address events and characteristics taking place when 2. Which of these is not a method of data collection? 3. Secondary/existing data may include which of the following? 4. Which of the following terms best describes data that were originally collected at an earlier time by a different person for a different purpose? 5. Researchers use both open-ended and closed-ended questions to collect data. Which of the following statements is true? 6 CARES Session 5 Module Pre-Test a. In the past (retrospective questions) b. In the present (current time questions) c. In the future (prospective questions) d. All of the above a. Questionnaires b. Interviews c. Experiments d. Observations a. Official documents b. Personal documents c. Archived research data d. All of the above a. Primary data b. Secondary data c. Experimental data d. Field notes a. Open-ended questions directly provide quantitative data based on the researcher s predetermined response categories b. Closed-ended questions provide quantitative data in the participant s own words c. Open-ended questions provide qualitative data in the participant s own words d. Closed-ended questions directly provide qualitative data in the participants own words
7
1. The specific cultural conventions or statements that people who share a culture hold to be true or false are called. 2. Which of the following is a characteristic of qualitative research? 3. Which major characteristic of qualitative research refers to studying real world situations as they unfold naturally? 4. In which qualitative research approach is the primary goal to gain access to individuals inner worlds of experience? 5. Which of the following is usually not a characteristic of qualitative research? CARES Session 6 Module Pre-Test a. Shared attitudes b. Shared beliefs c. Shared values d. Norms a. Design flexibility b. Inductive analysis c. Context sensitivity d. All of the above a. Holistic perspective b. Naturalistic inquiry c. Dynamic systems d. Inductive analysis a. Phenomenology b. Ethnography c. Grounded theory d. Case study a. Design flexibility b. Dynamic systems c. Naturalistic inquiry d. Deductive design 8
CARES Session 7 Module Pre-Test 1. A research method in which a researcher asks study participants several conversational style questions and does not provide a set of responses to choose from 2. The key feature of probability sampling is: 3. Which of the following is an example of nominal level measurement? 4. When each member of a population has an equally likely chance of being selected, this is called: a. Case study b. Interview c. Comparative method d. Quantitative study a. Selection of very large samples b. Elimination of sampling error c. Random selection d. Reduction of bias in the sampling frame a. Family size (number of children in a family) b. Political participation (number of times voted in last 10 years) c. Educational attainment (highest year or grade in school completed) d. Political party affiliation (Republican, Democrat, Independent, Other) a. A nonrandom sampling method b. A quota sample c. A snowball sample d. An Equal probability selection method 9
CARES Session 8 Module Pre-Test 1. Which of the following is a principle of community-based participatory research? 2. As a community member serving on an IRB board of a local university, you have a responsibility 3. Many university researchers are required by grant-making institutions to involve community members in their research projects 4. Community members who are part of a CBPR project should expect to play a role in analyzing, writing, and/or distributing results of the research a. Data collection must be conducted by people who do not live in the community to be studied. b. Collaborative partnership must occur in all phases of the research. c. Researchers from the university must decide the methods of evaluation used in the research project. d. None of the above a. To make sure that no one conducts research in poor communities. b. To agree with the other members of the committee. c. To make sure that researchers protect the identities of people who participate in their studies d. Make sure that university researchers do as much research as possible. a. True b. False a. True b. False 10
1. A nurse labels a patient an alcoholic because of the patient s ethnicity. This is called 2. Which applies best as an overall goal is to increase the quality of years and healthy life? 3. Which is a factor that affects the health of a community CARES Session 9 Module Pre-Test a. Stereotyping b. Risk c. Mercury d. Biology a. Host b. True c. HP2010 d. Age a. Physical b. Social and Cultural c. Community Organization d. Individual Behaviors e. All the above 4. Program planning begins with: a. Assessment of existing health needs and problems b. Identification of different practice settings c. Measurement of social marketing process d. Evaluation of learning objectives 5. An example of secondary prevention would be a. Wearing a seat belt b. Getting a mammogram c. Exercising d. Getting a flu vaccination 11
CARES Session 10 Module Pre-Test 1. In the definition of epidemiology, the terms distribution and determinants taken together refer to: 2. Descriptive epidemiology includes all EXCEPT: 3. The London cholera epidemic of 1848 was traced to the Broad Street pump by whom? 4. The time course of a disease outbreak is usually displayed as a/an: 5. Because socioeconomic status is difficult to quantify, we commonly use all of the following substitute measures EXCEPT: a. Frequency, pattern, and causes of health events b. Dissemination of information to those who need to know c. Knowledge, attitudes, and practices related to health d. Public health services and resources a. What b. Who c. When d. Where e. Why a. Graunt b. Farr c. Snow d. Doll e. Hill a. Secular trend b. Seasonal trend c. Epidemic curve d. Endemic curve a. Educational achievement b. Family income c. Occupation social standing 12
CARES Session 11 Module Pre-Test 1. The term literacy is defined by which of the following: 2. The term Health Literacy focuses solely on minorities and low-income persons. 3. Which of the following does not apply to persons with Level 1 literacy? 4. How many people in the U.S. may be at risk of difficulty due to low literacy skills? 5. One out of five American Adults reads at the 5 th grade level or below, and the average American reads at the 10 th grade level. a. Read b. Write c. Speak in English d. Compute and solve problems e. All of the above a. True b. False a. Can sign one s name b. Total a bank deposit entry c. Identify and enter background information on a social security card application d. Identify a country in a short article e. Find the expiration date on a driver s license a. 50 million b. 70 million c. 80 million d. 90 million e. 100 million a. True b. False 13
14
Appendix III CARES Post-test questions for each session CARES Module Post-Test Session 1 Multiple Choice 1. A research project involves not only the collection of data but also the: 2. Which research project is an example of basic research? 3. Which research project is an example of applied research? 4. The scientific method is a set of rules specifying how Generation of the data Listing of the data A comparison of the effectiveness of different strategies for training future nurses Determination of the effect of a new mathematics curriculum on students math scores Examination of the mating habits of bears in North America Examination of the effect of adding nitrogen to the soil for the yield of corn Scientific knowledge should be acquired, stated, and tested Scientists should conduct their life 5. The results of scientific research: Should be made available for critique and replication Should not be used to support existing theories True or False Interpretation of data Modification of the data Examination of the effect of nutrients on the growth of fish in lakes within five different watersheds A study of adolescents thought processes A study of the driving habits of adolescents Examination of the life cycle of bees How society should conduct its affairs How society should conduct its affairs Do not have to be obtained under controlled observations Must conform to public expectations about the outcome 6. Looking in an encyclopedia to determine who discovered the North Pole is an example of research. 7. Research often includes the publication of what the researcher has discovered. 1 True True False False
8. Hypotheses are never proved in research. 9. The collection of data is a subjective process. 10. The interpretation of data is an objective process. True True True False False False CARES Session 2 Module Post-Test 1. Which of these statements about people with low health literacy is False? 2. Health literacy refers only to the ability to read and understand written information. 3. The responsibility for high quality healthcare outcomes rests solely with physicians. 4. Which of the following is not a benefit of an Electronic Health Records system? 5. E-Health refers to the use of computers and networks like the internet to store and manage your medical records, instead of paper files. a. They are less likely to comply with prescribed treatment and self-care regimens. b. Often require additional care that results in annual health care costs that are four times higher than those with higher literacy skills. c. They fail to seek preventive care and are at higher risk for hospitalization d. None of the above a. True b. False a. True b. False a. Cost-reduction b. Improved continuum of care c. Increase time of processing medical claims d. Medications management a. True b. False 2
3
CARES Session 3 Module Post-Test 1. The Belmont Report, which sets forth the basic ethical principles that govern the conduct of research involving human subjects, was developed in response to: 2. ALL guidelines for research involving human subjects require a. Nazi experiments on prisoners in concentration camps b. Placebo-controlled AZT studies in Africa c. Research conducted on pregnant women d. The Tuskegee syphilis study e. The Common Rule a. Elimination of placebo controls b. Benefits for all research participants c. Voluntary participation by subjects d. Publication of all study findings e. Research in animals before research in humans 3. According to the Nuremberg Code: * a. Military doctors should never conduct medical research b. The voluntary consent of the human subject is absolutely essential c. Research must not be conducted in times of war d. Research should be regulated by an international agency e. All of the above 4. Minimal risk research a. Poses zero risk of harm b. Is risk that is judged acceptable after consideration is given to the potential benefits of the research c. Is no risker than normal activities of daily life d. None of the above 5. Populations are considered vulnerable because they: a. Have a compromised capacity for free consent b. Are dependent on others c. Are at greater risk than the average individual for harm d. All of the above 4
*Adapted from Research Ethics Training Curriculum for Community Representatives (2004) by Family Health International 5
CARES Session 4 Module Post-Test 1. A statement of the quantitative research question should: 2. Which research paradigm is least concerned about generalizing its findings? 3. Qualitative research is often exploratory and has all of the following characteristics except: a. Extend the statement of purpose by specifying exactly the question(s) the researcher will address b. Help the research in selecting appropriate participants, research methods, measures, and materials c. Specify the variables of interest d. All of the above a. Quantitative research b. Qualitative research c. Mixed research d. None of the above a. It is typically used when a great deal is already known about the topic of interest b. It relies on the collection of non-numerical data such as words and pictures c. It is used to generate hypotheses and develop theory about phenomena in the world d. It uses the inductive scientific method 4. A qualitative research question a. Asks a question about some process, or phenomenon to be explored b. Is generally an open-ended question c. Both a and b are correct d. None of the above 5. A research plan. a. Should be detailed b. Should be given to others for review and comments c. Sets out the rationale for a research study 6
7 d. All of the above
CARES Session 5 Module Post-Test 1. Open-ended questions provide primarily data. 2. Another name for a Likert Scale is a(n): 3. Which one of the following in not a major method of data collection 4. The researcher has secretly placed him or herself (as a member) in the group that is being studied. This researcher may be which of the following? 5. When constructing a questionnaire, there are 15 principles to which you should adhere. Which of the following is not one of those principles? a. Confirmatory data b. Qualitative data c. Predictive data d. None of the above a. Interview protocol b. Event sampling c. Summated rating scale d. Ranking a. Questionnaires b. Interviews c. Secondary data d. Focus groups e. All of the above are methods of data collection a. A complete participant b. An observer-as-participant c. A participant-as-observer d. None of the above a. Do not use "leading" or "loaded" questions b. Avoid double-barreled questions c. Avoid double negatives e. Avoid using multiple items to measure a single construct 8
CARES Session 6 Module Post-Test 1. Which of the following does not apply to qualitative research? 2. The difference between ethnographic research and other types of qualitative research is that ethnographers specifically use the concept of culture to help understand the results. 3. Which of the following is not one of the 4 major approaches to qualitative research? 4. You want to study a Native American group in New Mexico for a six month period to learn all you can about them so you can write a book about that particular tribe. You want the book to be accurate and authentic as well as informative and inspiring. What type of a. Data are often words and pictures b. Uses the inductive scientific method c. Ends with a statistical report d. Involves direct and personal contact with participants a. True b. False a. Ethnography b. Phenomenology c. Case study e. Grounded theory f. Non experimental a. Ethnography b. Phenomenology c. Grounded theory d. Collective case study 9
research will you likely be conducting when you get to New Mexico? 5. When a researcher identifies so completely with the group being studied that he or she can no longer remain objective you have what is called. a. Culture shock b. Going native c. Regression d. Cultural relativism CARES Session 7 Module Post-Test 1. Which of the following techniques yields a simple random sample? 2. Which of the following is not a form of nonrandom sampling? 3. How often does the Census Bureau take a complete population count? 10 a. Choosing volunteers from an introductory psychology class to participate b. Listing the individuals by ethnic group and choosing a proportion from within each ethnic group at random c. Numbering all the elements of a sampling frame and then using a random number table to pick cases from the table d. Randomly selecting schools, and then sampling everyone within the school a. Snowball sampling b. Convenience sampling c. Quota sampling d. Purposive sampling e. They are all forms of nonrandom sampling a. Every year b. Every five years c. Every ten years d. Twice a year
4. Which of the following nonrandom sampling techniques does the researcher ask the research participants to identify other potential research participants? a. Snowball b. Convenience c. Purposive d. Quota 11
CARES Session 8 Module Post-Test 1. In a CBPR project who determines the health problem to be studied/analyzed? a. University researchers b. Community members c. University researchers and community members together 2. CBPR is a qualitative research? a. True b. False 3. CBPR requires a change in a. Approach b. Method c. Problem studied d. Population 4. Which is not a rationale for CBPR? a. Complex health and social problems ill-suited to outside expert research b. History of research abuse and mistrust c. Decreasing community and funder demands for community-driven research d. Disappointing results in intervention research 12
CARES Session 9 Module Post-Test 1. Pretesting participants knowledge of effective weight management techniques may be helpful in: 2. The short term effects of health education interventions are most often directed toward: 3. Which lifestyles have the greatest effect on health? 4. Historically, gains in the populations have been related largely to changes in what? 5. Residents of rural communities report that they must travel for long distances to obtain health care services as a result they seek health care for only emergencies and sever illnesses. a. Guaranteeing that all participants lose weight. b. Determining intervention strategies c. Achieving appropriate body composition d. Learning what causes obesity. a. Achieving changes in health knowledge, attitudes, skills or behavior b. Reducing health care costs. c. Increasing contraceptive use. d. Decreasing morbidity and mortality rates. a. Marine hospital service b. Fee for services c. Personal behavior/lifestyle d. Social risk a. Marine hospital service b. Safety, sanitation, and personal behavior c. Global Warming d. Pregnancy and child birth a. Access to care b. Increase c. Cost d. Census Bureau 13
CARES Session 10 Module Post-Test 1. In the definition of epidemiology, the terms distribution and determinants taken together refer to 2. Descriptive epidemiology includes all EXCEPT 3. The London cholera epidemic of 1848 was traced to the Broad Street pump by whom? 4. The time course of a disease outbreak is usually displayed as a/an: 5. Because socioeconomic status is difficult to quantify, we commonly use all of the following substitute measures EXCEPT: a. Frequency, pattern, and causes of health events b. Dissemination of information to those who need to know c. Knowledge, attitudes, and practices related to health d. Public health services and resources a. What b. Who c. When d. Where e. why a. Graunt b. Farr c. Snow d. Doll e. Hill a. Secular trend b. Seasonal trend c. Epidemic curve d. Endemic curve a. Educational achievement b. Family income c. Occupation d. Social standing 14
CARES Session 11 Module Post-Test 1. The term literacy is defined by which of the following: 2. The term Health Literacy focuses solely on minorities and low-income persons. 3. Which of the following does not apply to persons with Level 1 literacy? 4. How many people in the U.S. may be at risk of difficulty due to low literacy skills? 5. One out of five American Adults reads at the 5 th grade level or below, and the average American reads at the 10 th grade level. a. Read b. Write c. Speak in English d. Compute and solve problems e. All of the above a. True b. False a. Can sign one s name b. Total a bank deposit entry c. Identify and enter background information on a social security card application d. Identify a country in a short article e. Find the expiration date on a driver s license a. 50 million b. 70 million c. 80 million d. 90 million e. 100 million a. True b. False 15