Abstract
Through observations of AT&T data and the results of two of our own studies, we discovered interesting asymmetrical effects of the level of aggregation of the question on the response accuracy in surveys of behavioral frequency. We find that disaggregating a question to a lower, less comfortable level of aggregation creates greater uncertainty, leading to larger absolute errors in survey responses. However, if a question is asked at a higher less comfortable level, the majority of respondents escape by splitting questions down to the natural level, thereby avoiding greater uncertainty and thus responding more accurately. We argue that for greater accuracy in surveys, one should identify the natural level of aggregation at which a question should be posed. But when in doubt, it is better to ask a question at a higher level of aggregation because of possible escapability downward.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
BlairEdward, and ScotBurton. (1987). “Cognitive Processes Used by Respondents to Answer Behavioral Frequency Questions.” Journal of Consumer Research 14 (September), 280–285.
BurtonScot, and EdwardBlair. (1991). “Task Conditions, Response Formulation Processes, and Response Accuracy for Behavioral Frequency Questions in Surveys.” Public Opinion Quarterly 55, 50–79.
Conrad, Frederick, and Norman Brown. (1994). “Strategies for Estimating Category Frequency: Effects of Abstractness and Distinctiveness”. American Statistical Association Proceedings of the Section on Survey Method Research, Washington, D.C.
FiedlerKlaus, and ThomasArmbruster. (1994). “Two Halfs May Be More Than One Whole: Category-Split Effects.”. Journal of Personality and Social Psychology 66(4), 633–645.
FoekensEijte, PeterLeeflang, and DickWittink. (1994). “A Comparison and an Exploration of the Forecasting Accuracy of a Loglinear Model at Different Levels of Aggregation.” International Journal of Forecasting 10, 245–261.
Grootaert, Christian. (1986). “The Use of Multiple Diaries in a Household Expenditure Survey in Hong Kong.” Journal of the American Statistical Association 81 (December), 938–944.
HasherLynn, and Rose T.Zacks. (1984). “Automatic Processing of Fundamental Information: The Case of Frequency of Occurrence.” American Psychologist 39(12), 1372–1388.
LamaleHelen Humes. (1950). Study of Consumer Expenditures, Incomes, and Savings: Methodology of the Survey of Consumer Expenditures in 1950. University of Pennsylvania Press, Philadelphia.
Lansing, John B., Gerald P. Ginsberg, and Kaiso Braaten. (1961). “An Investigation of Response Error”. In Studies in Consumer Finances #2, Bureau of Economics and Business, University of Illinois.
McKenzieJohn. (1983). “The Accuracy of Telephone Call Data Collected by Diary Methods.” Journal of Marketing Research 20 (November), 417–427.
MenonGeeta. (1993). “The Effects of Accessibility of Information in Memory on Judgments of Behavioral Frequencies.” Journal of Consumer Research 20 (December), 431–440.
MenonGeeta, PriyaRaghubir, and NorbertSchwarz. (1995). “Behavioral Frequency Judgments: An Accessibility-Diagnosticity Framework.” Journal of Consumer Research 22 (September), 212–228.
Neter, John, and Joseph Waksberg. (1961). “Measurement of Non-Sampling Errors in a Survey of Home Owners' Expenditures for Alterations and Repairs”. in Proceedings of the One Hundred Twenty-first Annual Meeting, American Statistical Association (pp. 201–210), Washington, D.C.
Parfitt, John H. (1967). “A Comparison of Purchase Recall with Diary Panel Records.” Journal of Advertising Research 7 (September), 16–31.
Rifkin, Anthony. (1985). “Evidence for a Basic Level in Event Taxonomies.” Memory and Cognition 13(6), 538–556.
Rosch, E. (1978). “Principles of Categorization.” In E.Rosch and B. B.Lloyd (eds.), Cognition and Categorization. Hillsdale, NJ: Erlbaum.
Rosch, E., C. B.Mervis, W.Gray, D.Johnson, and P.Boyes-Braem. (1976). “Basic O Objects in Natural Categories.” Cognitive Psychology 8, 382–439.
Staelin, Richard, and Ronald E.Turner. (1973). “Error in Judgmental Sales Forecasts: Theory and Results.” Journal of Marketing Research 10 (February), 10–16.
Sudman, Seymour. (1964). “On the Accuracy of Recording of Consumer Panels: I.” Journal of Marketing Research 1 (May), 14–20.
Wind, Yoram, and DavidLerner. (1979). “On the Measurement of Purchase Data: Surveys Versus Purchase Diaries.” Journal of Marketing Research 16 (February), 39–47.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Hu, M.Y., Toh, R.S. & Lee, E. Impact of the level of aggregation on response accuracy in surveys of behavioral frequency. Market Lett 7, 371–382 (1996). https://doi.org/10.1007/BF00435543
Issue Date:
DOI: https://doi.org/10.1007/BF00435543