An alternative to consumer surveys is the use of controlled
consumer experiments. For example, consumers are given money
(real or script) and must make purchasing decisions. Researchers
then vary key demand variables (and hold others constant) to
determine how the variables affect consumer purchases. Because
consumers make actual decisions (instead of simply being asked
about their preferences and behavior), their results are likely to be
more accurate than those of consumer surveys. Nonetheless, this
approach shares some of the same difficulties as surveys.
Subjects know they are participating in an experiment, and this
may affect their responses. For example, they may react to price
much more in an experiment than they do in real life. In addition,
controlled experiments are expensive. Consequently, they
generally are small (few subjects) and short, and this limits their
accuracy.
Controlled Market Studies
Firms can also generate data on product demand by selling their
product in several smaller markets while varying key demand
determinants, such as price, across the markets. The firm might
set a high price with high advertising spending in one market, a
high price and low advertising in another, a low price and high
advertising in yet another, and so on. By observing sales
responses in the different markets, the firm can learn how various
pricing and advertising policies (and possible interactions among
them) affect demand.
To draw valid conclusions from such market studies, all other factors
affecting demand should vary as little as possible across the markets. The
most common—and important—of these “other” demand factors include
population size, consumer incomes and tastes, competitors’ prices, and
even differences in climate. Unfortunately, regional and cultural
differences, built-up brand loyalties, and other subtle but potentially
important differences may thwart the search for uniform markets. In
practice, researchers seek to identify and control as many of these
extraneous factors as possible.
Market studies typically generate cross-sectional data—observations of
economic entities (consumers or firms) in different regions or markets
during the same time period. Another type of market study relies on time-
series data. Here, the firm chooses a single geographic area and varies its
key decision variables over time to gauge market response. The firm
might begin by setting a high price and a low advertising expenditure and
observing the market response. Some time later, it may increase
advertising; later still, it may lower price; and so on. Time-series
experiments have the advantage that they test a single (and, one would