Chapter 13
Collecting the Data: Field Procedures and Nonsampling Error
the observed values in repetitions of the measurement is (the)
a. effect of the stimulus.
b. nonsampling error.
c. sampling error.
d. main testing effect.
e. interactive testing effect.
population and computes the mean sugar consumption. He repeats the procedure a
number of times using the exact same procedure, and finds the means obtained vary
from sample to sample. This is an example of
a. systematic error.
b. sampling error.
c. nonsampling error.
d. noncoverage error.
e. response error.
a. are random.
b. are non-random.
c. tend to bias sample statistics.
d. b and c.
e. a, b, and c.
a. conceptualization of the response project.
b. reporting the results of a project.
c. arithmetic.
d. interpreting respondent replies.
e. all of the above are nonsampling errors.
a. are as identifiable as sampling errors.
b. decrease with sample size.
c. may increase with sample size.
d. exhibit well behaved functional forms.
e. do not affect sample statistic estimates
a. decrease with increases in sample size.
b. can be estimated if probability sampling is used.
c. distort the reliability of sample estimates.
d. can be decreased by the use of sophisticated samples.
e. are not very important.
a. Better sampling designs and more sophisticated samples may well be
instrumental in eliminating nonsampling errors in research. The more efficient
the sample design, the less important are nonsampling errors.
b. The researcher should experience little difficulty in constraining sampling error
to whatever bounds he or she desires.
c. It is somewhat paradoxical but true that the more statistically efficient the
sample design, the more important nonsampling errors are likely to be.
d. Nonsampling errors arise from weaknesses in research procedure. They are
likely to increase with increases in the sample size.
e. Nonsampling errors contribute more than sampling errors to total error in most
surveys.
increases, sampling errors will while nonsampling errors .
a. decrease; may even increase
b. increase; decrease
c. remain the same; may even increase
d. increase; remain the same
e. decrease; remain the same
a. nonsampling error
b. sampling error
c. noncoverage error
d. overcoverage error
e. nonresponse error
a. decreases sampling error; increase nonsampling error
b. has no influence on sampling error; increase nonsampling error
c. increases nonsampling error; increase sampling error
d. increases sampling error; increase nonsampling error
e. decreases nonsampling error; decrease sampling error
a. decreasing the number of observations.
b. increasing the sample size.
c. using a randomized experimental design.
d. using a Latin Square experimental design.
e. using a quota sample.
a. using a telephone directory as a sampling frame
b. choosing a quota sample by strictly adhering to the respondent solution
instructions
c. using a city map purchased in a gas station as the sampling frame
d. using state car title records as a sampling frame
e. All of the above are examples of non-sampling errors.
a. method errors.
b. observation errors.
c. non-observation errors.
d. a and b.
e. b and c.
a. difference between the reported value and the “true” value.
b. failure to obtain information from some elements of the population which were
selected from the sample.
c. duplication in the list of sample units.
d. failure to include some units of the defined survey population in the actual
sampling frame.
e. difference between the observed values of a variable and the long-run average of
the observed values in repetitions of the measurement.
the actual operational sampling frame represents
a. noncoverage errors.
b. nonresponse errors.
c. sampling errors.
d. random errors.
e. observation errors.
a. phone book
b. mailing list
c. map
d. None of the above have a potential noncoverage problem.
e. All of the above potentially have a noncoverage problem.
biases include
a. research objectives.
b. eliminating duplicate entries.
c. explicit statements identifying exclusion.
d. b and c.
e. a, b, and c.
a. A researcher deliberately excludes those under 21 years of age from his survey.
b. In an opinion poll those incarcerated in a state penitentiary are intentionally
excluded from the sample.
c. In an opinion survey, the sample is selected from a mailing list of car
registrations.
d. A marketer conducting research for a dog food manufacturer purposely restricts
his sample to dog owners.
e. None of the above are nonobservation errors.
a. Noncoverage nonsampling error is best treated by increasing the sample size
that is selected.
b. Noncoverage nonsampling error is essentially a sampling frame problem, and if
clear, complete, up-to-date sampling frames exist, noncoverage is not likely to
be a problem.
c. While noncoverage can be a source of bias, overcoverage is not. In fact,
overcoverage may improve estimates as it means that the sample size is larger
than initially planned at no increase in cost.
d. Noncoverage bias is essentially eliminated with quota samples.
e. All of the above statements are false.
a. refusals
b. no one at home
c. observation errors
d. noncoverage errors
e. designated respondent not at home when interviewer calls
a. increasing the number of characteristics for selection.
b. increasing the interviewer’s flexibility in choosing respondents.
c. sending some interviewers to strictly high-income neighborhoods.
d. thoroughly reviewing completed interview forms.
e. none of the above.
a. high-income class.
b. middle-income class.
c. low-income class.
d. high- and low-income classes
e. Interviewers do not underselect any class in a quota sample.
a. sampling errors.
b. data collection errors.
c. coverage errors.
d. response errors.
e. none of the above.
ineligibles and duplicates are included on the list, while some members of the target
population are excluded. These are examples of
a. coverage errors.
b. response errors.
c. data collection errors.
d. office processing errors.
e. sampling errors.
survey results with some outside criterion?
a. coding errors
b. sampling errors
c. noncoverage errors
d. nonresponse errors
e. refusal errors
a. the list is not up-to-date.
b. ineligibles are included in the list.
c. duplicates are included in the list.
d. some members of the desired population are not on the list.
e. All of the above are common problems of using lists.
a. skip the duplicate and choose the next name on the list.
b. get an updated list.
c. use the standard error formula to estimate the effect.
d. weight the results by the inverse of the probability of selection.
e. do all of the above.
a. do not affect standard error formulas.
b. can be eliminated by increasing the sample size.
c. are small in comparison to sampling errors.
d. can be eliminated by a number of methods.
e. all of the above
a. not-at-homes.
b. nonreceipt of survey instrument.
c. death of the respondent.
d. interviewer training.
e. a and d.
1=no answer
2=not at home when contacted
3=disconnected
4=refused to participate in the study
Which of them contribute to the nonresponse bias in a telephone survey?
a. 1,2
b. 1,2,3
c. 3,4
d. 2,4
e. 1,2,3,4
a. The main sources of nonresponse bias are not-at-homes and refusals.
b. The type of incentive used to reduce nonresponse may create another potential
bias.
c. The evidence that is available on nonresponse errors suggests that this error is
basically random and not systematic.
d. Using incentives to reduce the nonresponse rate may inflate response errors.
e. Not-at-homes and refusals are both sources of error in telephone surveys.
a weekday?
a. married women without children
b. single women
c. married men
d. married women with young children
e. single men
a. make advance appointments with the respondent
b. a callback at a different time than the initial call.
c. leaving a questionnaire if the respondent is not at home.
d. better interviewer training.
e. All of the above are common methods of reducing not-at-homes.
homes?
a. using a straight callback
b. using a modified callback
c. making advance appointments
d. b and c
e. a, b, and c.
problem of not-at-homes?
a. making advance appointments by telephone
b. employing call backs
c. substitution of neighboring dwelling units
d. interviewer judgment in scheduling calls
e. They are all typically effective.
a. a straight callback.
b. a modified callback.
c. the Politz and Simmons’ method in which the interviewed sample respondents
are questioned regarding their availability and then the results of each group are
appropriately weighted.
d. substituting a neighboring dwelling.
e. making an appointment in advance.
substitutes the nearest available subject for the missing subject. This practice
a. is reasonable and provides accurate results.
b. is not recommended as it complicates the problems by increasing the proportion
of at-homes in the sample.
c. is recommended even though it increases the proportion of at-homes.
d. is unreasonable although the results are generally accurate.
e. is probably the best available technique for handling the not-at-home problem.
a. interviewer training.
b. the subject of the research.
c. sample size.
d. quota sampling.
e. using a more sophisticated sample design.
by the total number of sample units approached is commonly called
a. the response rate.
b. the contact rate.
c. the completeness rate.
d. the refusal rate.
e. the nonresponse rate.
a. compare the performance of interviewers.
b. measure the interviewer’s persistence in making a contact.
c. measure the wisdom the interviewer displays in scheduling a callback.
d. do a and b.
e. do a, b, and c.
a. the respondent attitude at the time of initial contact.
b. the reason for the contact.
c. the place where contact was initiated.
d. a and b.
e. a, b, and c.
at-home problem in
a. personal interviews.
b. mail surveys.
c. telephone surveys.
d. a and b.
e. Not-at-homes are always a more important source of error than refusals.
a. an interview.
b. a completely randomized experimental design.
c. a mail survey.
d. a field study.
e. a panel.
in a mail study according to the empirical evidence?
a. provide return postage
b. specify a deadline
c. guarantee anonymity
d. offer an incentive
e. offer to provide survey results
a. extrapolation of information contained elsewhere in the instrument.
b. use of follow-up methods.
c. increasing the initial response rate of the instrument.
d. a and c.
e. a, b, and c.
number of refusals?
a. the use of incentives
b. selling the respondent on the value of the research
c. use of experienced interviewers
d. guarantees of anonymity
e. they have all been shown to be effective
a. selling the respondent on the value of the research.
b. choosing an appropriate interviewer.
c. training the interviewer properly.
d. guaranteeing that the replies will be confidential.
e. all of the above.
rate?
a. nature of the respondent
b. sponsor of the research
c. nature of the subject
d. circumstances surrounding the contact
e. They all affect the refusal rate
a. Ask respondent to complete a simple task at the beginning.
b. Offer respondents money for cooperation.
c. Use a good quota sampling plan.
d. a and b.
e. a, b, and c.
and “nr” to those not responding, which of the following statements is most correct?
a. Both ar and anr can be calculated by splitting up a (which is known or can be
estimated) into its component parts.
b. The nonresponse component can be ignored as it is reasonable that ar equals anr.
c. a cannot be calculated because of the difficulty in estimating ar and anr.
d. A rough estimate of a can be made by adjusting the initial results after a is
estimated by follow-up.
e. A rough estimate of a can be made by adjusting the initial results after anr is
estimated by follow-up.
order of those responding: e.g., group 1, those responding after initial contact; group
2, those responding after first follow-up, etc. Statistics are then computed to see if
there are any significant differences between the groups. If there is no significant
trend the mean for the nonrespondents and respondents is ___. If there is a
significant difference the researcher ____.
a. biased; scraps the project and starts all over again
b. assumed the same; extrapolates to allow for the respondents
c. assumed equal; assumes the nonrespondents are like the respondents
d. assumed different; extrapolates to allow for the nonrespondents
e. assumed equal; extrapolates to allow for the nonrespondents
magnitude of data collection errors have typically
a. relied on the actual availability of bias-free information which then served as a
validity check.
b. used split-run comparisons.
c. measured the consistency of replies over time from the same respondent.
d. been applied in substantive as opposed to method studies.
e. allowed the information gained to be taken at face value.
a. inferring the information for the missing item from other information in the
questionnaire.
b. using regression analysis.
c. substituting the average response for the item of those who did respond.
d. all of the above.
e. none of the above.
following techniques, EXCEPT
a. inferring the response from other answers on the form.
b. using the average response for the item of interest.
c. combining the “don’t know” and “no response” categories.
d. using regression analysis to estimate the response.
e. All of the above are appropriate techniques.
introduced by designated respondents refusing their participation?
a. The initial response rate can be increased.
b. The impact of refusals can be reduced through follow-up.
c. The obtained information can be extrapolated to allow for nonresponse.
d. The sample size can be increased.
e. All of the above can be used.
a. sampling errors.
b. field errors.
c. nonresponse errors.
d. noncoverage errors.
e. office errors.
a. inaccurate information is obtained from the sample elements.
b. errors are introduced in the processing of the data.
c. errors are introduced in reporting the findings.
d. some elements of the sample do not respond.
e. a, b, and c.
a. sampling error
b. nonobservation error
c. observation error
d. noncoverage error
e. nonresponse error
put to them?
a. understand what is being asked
b. process the information cognitively
c. retrieve the pertinent facts
d. evaluate the response in terms of its accuracy
e. all of the above need to occur
procedure, the following technique(s) can be implemented:
a. have the interviewer complete the questionnaire
b. observe the interviewer in action
c. test the interviewer as to the study objective and procedures
d. b and c.
e. a, b, and c.
a. sex of respondents and interviewers does NOT influence the answers in a
survey.
b. Negro interviewers are likely to obtain more information on consumption
expenditures in a predominantly white neighborhood.
c. it is better to have an old interviewer interview a young respondent and vice
versa so as to keep the interview from wandering off the intended topic into
areas of mutual interest.
d. the further the social distance between the interviewer and the respondent the
greater the bias.
e. by requiring the interviewer to complete the questionnaire, it can be determined
if there is a pattern between the interviewer’s answers and the answers he or she
secures when administering the questionnaire.
opinions, perceptions, etc., is through
a. matching the backgrounds of the interviewer and interviewee.
b. training the interviewer.
c. recruiting interviewers with similar socioeconomic backgrounds.
d. conducting the survey using a rigid set of procedures that the interviewers must
follow.
e. requiring the interviewer to complete the questionnaire so that it can be
determined if there is a pattern between the interviewer’s answers and the
answers he or she secures when administering the questionnaire.
particular problem with which of the following?
a. multiple-choice questions
b. dichotomous questions
c. scale type of questions
d. open-ended questions
e. structured questions
a. errors in asking questions
b. errors in recording answers
c. errors in probing when additional information is required
d. errors due to cheating
e. all of the above
a. The empirical evidence suggests that an interviewer’s own opinions on a subject
affect the responses he/she receives and that in particular, these responses are
likely to be opposite his/her opinions.
b. The behaviors of interviewer and respondent in the interview situation represent
the major outcome of perceptual processes.
c. In general, the evidence indicates that the more characteristics the interviewer
and the respondent have in common, the greater the probability of a successful
interview.
d. Both the interviewer and interviewee bring certain background characteristics to
the interview that can affect the interview process.
e. Both the interviewer and interviewee bring psychological predispositions to the
interview that could affect the interview process.
a. It is generally true that bias caused by interviewer expectations will balance out
if a sufficiently large number of interviews is used.
b. The behavior of either interviewer or respondent occurs merely as a physical
reaction to the behavior of the other.
c. Questions which state the alternative answers and multiple choice questions are
particularly recommended in studies where personal interviews are used because
they are not subject to interviewer bias.
d. The interviewer training program has one objective and only one objective and
that is to train the interviewers in the procedures to be used on the project at
hand.
e. All of the above statements are true.
procedures?
a. The interviewer asks only the key questions and fills in the remaining
information later.
b. The interviewer interviews respondents in groups rather than separately as
instructed.
c. The interviewer fabricates the whole interview.
d. The interviewer interviews the “wrong” respondent because the designated
respondent is unavailable.
e. The interviewer employs one contact for information for two separate studies
and thereby introduces contamination through respondent fatigue.
a. not-at-homes
b. refusals
c. interviewer cheating
d. coding errors
e. response errors