printThe Structure of the Reasons for Hard Refusals in Mass Telephone Surveys (using the example of surveys on the Russian-Ukrainian conflict)
Zvonovskiy V.B.
Dr. Sci. (Sociol.), Sociologist at the Social Research Institute, Samara, Russia. zvb@socio-fond.com
Khodykin A.V
Cand. Sci. (Sociol.), Lecturer at the Department of Sociology and Psychology, Samara State University of Economics, Samara, Russia. a.khodykin@socio-fond.com
Raskevich A.V.
graduate student at Samara University, Samara, Russia. a.raskevich@socio-fond.com
Zvonovskiy V.B., Khodykin A.V, Raskevich A.V. The Structure of the Reasons for Hard Refusals in Mass Telephone Surveys (using the example of surveys on the Russian-Ukrainian conflict). Sotsiologicheskie issledovaniya [Sociological Studies]. 2025. No 9. P. 23-33
In mass telephone surveys of Russians on political topics, the number of categorical refusals consistently exceeds the number of successful interviews. This poses a threat of systematic bias in the samples, so it is important to study the structure of the causes of severe rejections in the materials of political polls. To do this, we asked the respondents who categorically refused to participate in the survey a question about the reason for their refusal. This question was asked to respondents who received the “hard refusal” status when requesting consent to an interview in five waves of mass telephone surveys on the Russian-Ukrainian conflict conducted from March 10 to July 30, 2022. The total volume of samples amounted to 16479 hard failures. Although the frequency of the reasons for severe refusals cited by respondents differs significantly between the survey waves, the ratio of their prevalence ranks is quite stable, which indicates the stability of the ratio of reasons for unwillingness to participate in interviews. A significant majority of those who are not ready to participate in surveys either do not think about the reasons for their unwillingness to take the questionnaire, or do not articulate these reasons (on average, 69.1 % for all waves). The remaining respondents either cite employment (10.9 %), or are not interested in the topic of the survey or talk about their apolitical nature (7.8 %), or are afraid to participate in political polls (5.9 %). The remaining reasons are indicated by single percentages.
Андреенкова А. В. Щепетильные вопросы в межстрановых сравнительных опросах // Социологические исследования. 2017. № 12. С. 55–64. DOI: 10.7868/S0132162517120066. [Andreenkova A. V. (2017) Sensitive Issues in Cross-Country Comparative Surveys. Sociologicheskie issledovaniya [Sociological Studies]. No. 12: 55–64. DOI: 10.7868/S0132162517120066. (In Russ.)]
Звоновский В. Б., Ходыкин А. В. Восприятие россиянами конфликта с Украиной: проверка гипотезы «спирали молчания» // Социологические исследования. 2023а. № 11. С. 38–50. DOI: 10.31857/ S013216250028531‑7. [Zvonovsky V. B., Khodykin A. V. (2023а) Russians' Perception of the Conflict with Ukraine: Testing the "Spiral of Silence" Hypothesis. Sociologicheskie issledovaniya [Sociological Studies]. No. 11: 38–50. DOI: 10.31857/S013216250028531‑7. (In Russ.)]
Звоновский В. Б., Ходыкин А. В. Стратегии адаптации сторонников и противников спецоперации к жизни в ее условиях (на примере жителей Самарской области) // Социологический журнал. 2023б. Т. 29. № 1. С. 8–35. DOI: 10.19181/socjour.2023.29.1.1. [Zvonovsky V. B., Khodykin A. V. (2023b) Strategies for Adapting Supporters and Opponents of the Special Operation to Life in its Conditions (Using the Example of Residents of the Samara Region). Sociologicheskii zhurnal [Russian Sociological Journal]. T. 29. No. 1: 8–35. DOI: 10.19181/socjour.2023.29.1.1. (In Russ.)]
Звоновский В. Б., Ходыкин А. В. Российское общественное мнение в условиях военного конфликта 2022–2023 гг. Chişinău: Historical Expertise, 2024. [Zvonovsky V. B., Khodykin A. V. (2024) Russian Public Opinion in the Context of the Military Conflict of 2022–2023. Chişinău: Historical Expertise. (In Russ.)]
Звоновский В. Б., Ходыкин А. В. и др. Проявления сенситивности темы российско-украинского конфликта в массовых телефонных опросах россиян: анализ аудиозаписей интервью // Вестник общественного мнения. 2024. № 1 (135). С. 19–36. [Zvonovsky V. B., Khodykin A. V. et al. (2024) Manifestations of the Sensitivity of the Topic of the Russian-Ukrainian
Conflict in Mass Telephone Surveys of Russians: Analysis of Audio Recordings of Interviews. Vestnik obshchestvennogo mneniya [Bulletin of Public Opinion]. No. 1(135): 19–36. (In Russ.)]
Звоновский В. Б., Ходыкин А. В., Раскевич А. В. Причины досрочного прекращения интервью по инициативе респондента в массовых всероссийских опросах на тему российско-украинского конфликта // Социологический журнал. 2024. Т. 30. № 3. С. 31–60. DOI: 10.19181/socjour.2024.30.3.2. [Zvonovsky V. B., Khodykin A. V., Raskevich A. V. (2024) Reasons for Prematurely Terminating an Interview by Respondents in National Polls Regarding the Russian-Ukrainian Conflict. Sociologicheskii zhurnal [Russian Sociological Journal]. Vol. 30. No. 3: 31–60. DOI: 10.19181/socjour.2024.30.3.2. (In Russ.)]
Andreenkova A. V., Javeline D. (2018) Sensitive Questions in Comparative Surveys. In: Comparative Survey Methods: Multinational, Multiregional and Multicultural Contexts (3MC). Ed. by P. Johnson, B.-E. Pennell, I.A.L. Stoop, B. Dorer. John Wiley & Sons, Inc.: 139–160.
Berg N. (2005) Non-Response Bias. In: Encyclopedia of Social Measurement Ed. by K. Kempf-Leonard. Vol. 2: 865–873.
Frye T., Gehlbach S. et al. (2016) Is Putin’s Popularity Real? Post-Soviet Affairs. Vol. 33. No. 1: 1–15. DOI: 10.1080/1060586X.2016.1144334.
Groves R. M., Couper M. P. (2012) Nonresponse in Household Surveys. John Wiley & Sons.
Heckman J. J. (1979) Sample Selection Bias as a Specification Error. Econometrica. No. 47: 153–161.Kalinin K. (2016) The Social Desirability Bias in Autocrat’s Electoral Ratings: Evidence from the 2012 Russian Presidential Elections. Journal of Elections, Public Opinion and Parties. Vol. 26. No. 2: 191–211. DOI: 10.1080/17457289.2016.1150284.
McNeeley S. (2012) Sensitive Issues in Surveys: Reducing Refusals While Increasing Reliability and Quality of Responses to Sensitive Survey Items. In: Handbook of Survey Methodology for the Social Sciences. Ed. by L. Gideon. Springer, New York. DOI: 10.1007/978‑1‑4614‑3876‑2_22.
Reisinger W. M., Zaloznaya M., Woo B. D. (2023) Fear of Punishment as a Driver of Survey Misreporting and Item Non-Response in Russia and its Neighbors, Post-Soviet Affairs. Vol. 39. No. 1–2: 49–59. DOI: 10.1080/1060586X.2022.2150490.
Robertson G. B. (2017) Political Orientation, Information and Perceptions of Election Fraud: Evidence from Russia. British Journal of Political Science. Vol. 47. No. 4: 789–811.
Stoop I. A.L. (2005) The Hunt for the Last Respondent: Nonresponse in Sample Surveys. Amsterdam: Aksant Academic.
Tkachenko A., Vyrskaia M. (2025) Public Opinion and Casualties in Wartime Censorship. URL: https://ssrn. com/abstract=5160862 (accessed: 18.08.2025).
Vyrskaia M., Tkachenko A., Martynova N. (2025). Want to be Heard: Survey Participation in Russia before and during the War. Post-Soviet Affairs, 1–18 (accessed: 25.09.2025).
Yan T. (2021) Consequences of Asking Sensitive Questions in Surveys. Annual Review of Statistics and its Application. Vol. 8. No. 1: 109–127.