¿Influye el diseño de las preguntas en las respuestas de los entrevistados?

• Díaz de Rada, Vidal ^[1]
  1. [1] Universidad Pública de Navarra

     Universidad Pública de Navarra

     Pamplona, España

     
• Localización: RES. Revista Española de Sociología, ISSN 1578-2824, ISSN-e 2445-0367, Vol. 31, Nº. 1, 2022 (Ejemplar dedicado a: Debate. La prostitución, perspectivas sociológicas)
• Idioma: español
• DOI: 10.22325/fes/res.2022.83
• Títulos paralelos:
  • Does the format of the questions influence in the answers of interviewee?
• Enlaces
  • Texto completo (pdf)
• Dialnet Métricas: 2 Citas
• Resumen
  • español

    En este trabajo se analiza hasta qué punto el orden de administración de las opciones de respuesta afecta a la falta de respuesta y a la elección de respuestas “no definidas”. Un segundo objetivo es considerar si la estrategia de “descomponer” una pregunta en varias disminuye el número preguntas sin respuesta, así como de respuestas “no definidas”. Un experimento con encuesta telefónica muestra que presentar las preguntas del cuestionario comenzando por las opciones desfavorables en preguntas descompuestas aumenta las respuestas ‘no sabe’, además de ampliar el tiempo de respuesta. Por el contrario, utilizar preguntas con opciones de respuesta que comienzan por las desfavorables reduce el rechazo a responder la pregunta. Las respuestas indefinidas se reducen cuando se emplea una pregunta que comienza por preguntas favorables. 

  • English

    The impact of questionnaire format on responses has been long studied in survey research. This study seeks to contribute to this area of study by analyzing the extent to which the strategy of branching decreases the number of nonresponses and “undefined” responses. A second objective is to consider whether nonresponse and the choice of “undefined” responses are related to the order of administration of the response options. An experiment using a telephone survey showed that presenting a questionnaire starting with the unfavorable options and branched questions increased the “don't know” answers and extended response time by 60 seconds. Using a reverse order with a single question reduces the number of item-nonresponse. Undefined responses are dropped when using a question that begins with favorable options.

• Referencias bibliográficas
  • Aldrich, J. H., Niemi, R. G., Rabinowitz, G., & Rohde, D. W. (1982). The Measurement of Public Opinion about Public Policy: A Report on...
  • Alwin, D. F. (1992). Information Transmission in the Survey Interview: Number of Response Categories and the Reliability of Attitude Measurement....
  • Armstrong, J. S., Denniston, W. B., & Gordon, M. M. (1975). The use of the decomposition principle in making judgments. Organizational...
  • Azofra, M. J. (1999). Cuestionarios. Madrid: Centro de Investigaciones Sociológicas.
  • Baka, A., Figgou, L., & Triga, V. (2012). ‘Neither Agree, nor Disagree’: A Critical Analysis of the Middle Answer Category in Voting Advice...
  • Barthel, M., et al. (2021). Measuring news consumption in a digital area. Pew Research Center. Recuperado el 11 de abril de 2021 de https://www.journalism.org/2020/12/08/news-consumption-methodology/
  • Berchtold, A. (2019). Treatment and reporting of item-level missing data in social science research. International Journal of Social Research...
  • Bishop, G. F. (1987). Experiments with the middle response alternative in survey questions. Public Opinion Quarterly, 51(2), 220-232. https://doi.org/10.1086/269030
  • Bishop, G. F. (1990). Issue involvement and response effects in public opinion surveys. Public Opinion Quarterly, 54(2), 209-218. https://doi.org/10.1086/269198
  • Bishop, G., & Smith, A. (2001). Response-Order Effects and the Early Gallup Split-Ballots. Public Opinion Quarterly, 65(4), 479-505. https://doi.org/10.1086/323575
  • Brace, I. (2018). Questionnaire design. How to plan, structure, and write survey material for effective market research. Londres: Kogan Page.
  • Bradburn, N. M. (1983). Response Effects. En P. H. Rossi, J. D. Wright, & A. B. Anderson (Eds.) Handbook of Survey Research (pp. 289-328)....
  • Bradburn, N. (1992). What have we learned?. En N Schwarz & S. Sudman (Eds), Context Effects in Social and Psychological Research (pp....
  • Cabrera-Álvarez, P., y Escobar, M. (2019). El efecto de la ponderación y la imputación en el sesgo de los estudios electorales en España....
  • Cantril, H. (1944). Gauging Public Opinion. Princeton: Princeton University Press.
  • Carlson, J. E., Mason, R., Saitiel, J., et al. (1995). Assimilation and contrast effects in general/specific questions. Rural sociology, 60(4),...
  • Chang, L., & Krosnick, J. A. (2010). Comparing oral interviewing with self-administered computerized questionnaires: an experiment. Public...
  • Clifford, S., Kim, Y., & Sullivan, B. W. (2019). An improved question format for measuring conspiracy beliefs. Public Opinion Quarterly,...
  • Couper, M. P. (2008). Designing effective web surveys. Nueva York: Cambridge University Press. https://doi.org/10.1017/CBO9780511499371
  • De Leeuw, E., Hox, J. J., Scherpenzeel, A. C. (2010). Mode Effect or Question Wording? Measurement Error in Mixed Mode Surveys. Presented...
  • Debell, M., Wilson, C., Jackman, S., & Figueroa, L. (2021). Optimal Response Formats for Online Surveys: Branch, Grid, or Single Item?....
  • Díaz de Rada, V. (2000). Utilización de nuevas tecnologías para el proceso de “recogida de datos” en la investigación social mediante encuesta....
  • Díaz de Rada, V., y Ayerdi, P. (2007). Algunos problemas de la encuesta telefónica para la proyección electoral. Revista Española de Investigaciones...
  • Díaz de Rada, V., y Portilla, I. (2015). Encuestas telefónicas: estrategias para mejorar la colaboración. Perspectiva Empresarial, 2(1), 97-115....
  • Díaz de Rada, V., Domínguez, J. A., y Pasadas, S. (2019). Internet como modo de administración de encuestas. Madrid: CIS.
  • Dillman, D. A. (1978). Mail and telephone surveys. Nueva York: Wiley.
  • Dillman, D. A. (2020). “Three Decades of Advancing Survey Methodology”. En T. W. Smith (Eds.), A Meeting Place and More…: A History of the...
  • Dillman, D. A., et al (1995). Effects of Category Order on Answers in Mail and Telephone Surveys. Rural sociology, 60(4), 674-687. https://doi.org/10.1111/j.1549-0831.1995.tb00600.x
  • Dillman, D. A., Smyth, J., & Christian, L. M. (2014). Internet, Phone, Mail, and Mixed-Mode Surveys: The Tailored Design Method (Cuarta...
  • Escobar, M, y Jaime, A. M. (2013). Métodos de Imputación Múltiple para Predecir Resultados Electorales. En A. Mendoza Velazquez (Ed.), Aplicaciones...
  • Frey, J. (1989). Survey Research by Telephone. Londres: Sage.
  • Fuchs, M. (2005). Children and Adolescents as Respondents. Experiments on Question Order, Response Order, Scale Effects and the Effect of...
  • Garbarski, D., Schaeffer, N. C., & Dykema, J. (2016). The Effect of Response Option Order on Self-Rated Health: A Replication Study. Quality...
  • Gilbert, E. E. (2015). A comparison of branched versus unbranched rating scales for the measurement of attitudes in surveys. Public Opinion...
  • Groves, R. M., & Kahn, R. L. (1979). Surveys by telephone: a national comparison with personal interviews. Orlando, FL: Academic Press.
  • Gutiérrez, C., Sotomayor, R., y Garrido, F. (2004). Manual de encuestadores. Córdoba: Unidad de Estudios Aplicados del IESA–CSIC.
  • Hamilton, L. (2006). Statistics with STATA. Toronto: Thomson.
  • Häder, S., Häder, M., & Kuhne, M. (2012). Introduction: telephone surveys in Europe. En S. Häder, M. Häder & M. Kuhne (Eds.), Telephone...
  • Holbrook, A. L., Krosnick, J. A., Carson, R. T., et al. (2000). Violating Conversational Conventions Disrupts Cognitive Processing of Attitude...
  • Holbrook, A. L., Krosnick, J. A., Moore, D., & Tourangeau, R. (2007). Response order effects in dichotomous categorical questions presented...
  • Insights Analytics España (29 de junio de 2021). Jornada Insights + Analythics: La prospectiva electoral: metodología y fiabilidad. Madrid....
  • Kalton, G., Roberts, J., & Holt, D. (1980). The Effects of Offering a Middle Response Option with Opinion Questions. Journal of the Royal...
  • Krosnick, J. (1991). Response strategies for coping with the cognitive demands of attitude measures in surveys. Applied Cognitive Psychology,...
  • Krosnick, J. A. (1992). The Impact of Cognitive Sophistication and Attitude Importance on Response Order and Question Order Effects. En N....
  • Krosnick, J. A., & Alwin, D. F. (1987). An evaluation of a cognitive theory of response-order effects in survey measurement. Public Opinion...
  • Krosnick, J. A., & Berent, K. M. (1993). Comparison of party identification and policy preferences: the impact of survey question format....
  • Krosnick, J. A., & Fabrigar, L. R. (1997). Designing Rating Scales for Effective Measurement in Surveys. En. L. Lyberg, P. Biemer, M....
  • Krosnick, J. A., & Presser, S. (2010). Question and Questionnaire Design. En P. V. Marsden & J. D. Wright, Handbook of Survey Research...
  • Körmendi, E., & Noordhoek, H. (1989). Data quality and telephone interviews. A comparative study of face-to-face and telephone data collecting...
  • Malhotra, N., Krosnick, J. A., & Thomas, R. K. (2009). Optimal design of branching questions to measure bipolar construct. Public Opinion...
  • Martin, E., et al. (2007). Guidelines for Designing Questionnaires for Administration in Different Modes. Washington: U.S.: Census Bureau,...
  • Menold, N., & Bogner, K. (2016). Design of Rating Scales in Questionnaires. Mannheim, Germany: GESIS – Leibniz Institute for the Social...
  • Miller, P. V. (1984). Alternate Question Forms for Attitude Scale Questions in Telephone Interviews. Public Opinion Quarterly, 48(4), 766-778....
  • Moncus, J.J. (2021). What different survey modes and question types can tell us about Americans’ views of China. Pew Research Center, https://medium.com/pew-researchcenter-decoded/what-different-survey-modes-and-question-types-can-tell-usabout-americans-views-of-china-4523a47b5d99,...
  • Montagni, I., Cariou, T., Tzourio, C., & González-Caballero, J. (2019). ‘I don’t know’, ‘I’m not sure’, ‘I don’t want to answer?’: a latent...
  • Nicolaas, G., Thomson, K., & Lynn, P. (2000). The feasibility of conducing Electoral Surveys in the UK by telephone. Londres: National...
  • Olson, K., & Smyth, J. D. (2015). The Effect of CATI Questions, Respondents, and Interviewers on Response Time. Journal of Survey Statistics...
  • Olson, K., Smyth, J. D., & Kirchner, A. (2020). The Effect of Question Characteristics on Question Reading Behaviors in Telephone Surveys....
  • O’Muircheartaigh, C., Krosnick, J. A, Helic, A. (mayo de 1999). Middle alternatives, acquiescence, and the quality of questionnaire data....
  • Payne, S. L (1951). The art of asking questions. Princeton: Princeton University Press.
  • Peytchev, A., Couper, M. P., McCabe, S. E., & Crawford, S. D. (2006). Web survey design: Paging versus scrolling. International Journal...
  • Raghunatham, T., Berglund, P. A., & Solenberg, P. W. (2018). Multiple imputation in practice. Londres: Taylor.
  • Roberts, C., Gilbert, E., Allum, N., & Eisner, L. (2019). Research Synthesis: Satisficing in Surveys: A Systematic Review of the Literature....
  • Schaeffer, N. C., & Presser, S. (2003). The science of asking questions. Annual Review of Sociology, 29(1), 65-88. https://doi.org/10.1146/annurev.soc.29.110702.110112
  • Schuman, H., & Presser, S. (1996). Questions and answers in attitudes surveys. Londres: Sage.
  • Schwarz, N., & Bless, H. (1992). Assimilation and contrast effects in attitude measurement: an inclusion/exclusion model. Public Advanced...
  • Schwarz, N., & Sudman, S. (Eds.). (1992). Context Effects in Social and Psychological Research. Nueva York: Springer.
  • Schwarz, N., Hippler, H.-J., & Noelle-Neumann, E. (1992). A Cognitive Model of Response Order Effects in Survey Measurement. En N. Schwarz...
  • Smyth, J. D.; Israel, G. D., Newberry III, M. G., & Hull, R. G. (2019). Effects of Stem and Response Order on Response Patterns in Satisfaction...
  • Sudman, S., & Bradburn, N. (1982). Answering questions. San Francisco: Jossey Baas.
  • Sykes, W., & Goinville, G. (1985). Telephone interviewing on a survey of social attitudes. A comparison with face-to-face procedures....
  • Treier, S., & Hillygus, D. S. (2009). The Nature of Political Ideology in the Contemporary Electorate. Public Opinion Quarterly, 73(4),...
  • Tourangeau, R., Couper, M. P., & Conrad, F. G. (2013). "Up Means Good": The Effect of Screen Position on Evaluative Ratings in...
  • Yu, J. H., Albaum, G., & Swenson, M. (2003). Is a Central Tendency Error Inherent in the Use of Semantic Differential Scales in Different...
  • Truebner, M. (2021). The Dynamics of Neither Agree Nor Disagree Answers in Attitudinal Questions. Journal of Survey Statistics and Methodology,...
  • Wetzelhütter, D. (2020). Scale-Sensitive Response Behavior!? Consequences of Offering versus Omitting a ‘Don’t Know’ Option and/or a Middle...