Skip to main content
Verify a survey
Probatio Africa

Methods note: survey modes

When can a phone survey stand in for a household visit?

Phone surveys are fast and cheap, and in Nigeria they can reach most households. They miss particular people, and weighting narrows the gap without closing it.

Published October 2026. Sources checked 11 October 2026.

Who has a phone

The 2024 Nigeria DHS found that 90% of households own a mobile phone, but that only 62% of women own one, 30% own a smartphone, and 26% used the internet in the past year1. A phone survey of households can reach most of them; a phone survey of individuals reaches some groups far less than others.

Subscription counts do not answer the question. The Nigerian Communications Commission reported 195,108,814 active telephone subscriptions in July 2026, 194,862,642 of them on the GSM mobile networks, and a teledensity of 90%, which it defines as active telephone connections per 100 inhabitants2. Connections are not people: a teledensity of 90% is compatible with large numbers of people who own no phone, as the DHS figures for women show. We found no authoritative count of unique mobile users in Nigeria.

What Nigeria's pandemic phone survey showed

The National Longitudinal Phone Survey, run by the National Bureau of Statistics with the World Bank from 2020, drew its sample from the GHS-Panel, a face-to-face survey. Of 4,976 panel households, 4,934 (99.2%) had given at least one phone number, but about 10% of these had given only the number of a reference person in close contact with the household, not of a household member3. Of the 3,000 households selected, 69% were reached and 1,950 completed the first interview, 65% of those attempted3,4.

Ambel and colleagues compared who was reached with the full panel in Nigeria, Ethiopia, Malawi and Uganda. The households reached were 'biased toward wealthier households with higher living standards'. Coverage bias was 'not a major concern for Nigeria', but non-response bias was found in all four countries, and reweighting with information from the face-to-face survey produced 'a substantial reduction in bias, although the bias was not fully eradicated'5.

Answers from individuals are harder to correct. In the Nigerian survey, 82% of respondents were household heads and 73% were men, partly because the head was called first4. Brubaker and colleagues found that reweighting moved such estimates closer to the adult population, but that it 'increases the variance of the estimates and, in most cases, fails to overcome selection biases'. Reliable data on men and women, they concluded, need 'random selection of adult interviewees within sampled households'4.

A survey-based sample or random dialling

Across the World Bank-supported high-frequency phone surveys worldwide, first rounds drawn from an earlier face-to-face survey averaged a 73% response rate, against 36% for samples drawn by random-digit dialling6. A sample drawn from a household survey also brings that survey's information on every household, so non-response can be modelled and weighted; Ambel and colleagues note that adjustment is more limited for random-digit dialling or telecom lists5.

The same World Bank review found that non-responding households 'appeared to have characteristics similar to households without access to a phone', and that 'the survey mode effect is still not well understood'6.

Short, and only for what a phone can measure

Guidance from fragile settings is that phone interviews 'typically should not last longer than 20–30 minutes'7. A survey experiment in urban Ethiopia, cited in the World Bank review, found that fatigue set in early when consumption was asked by phone but not face to face, which 'can result in overestimating poverty rates'6.

Our practice

These are the rules every Probatio Africa study follows. Read them as commitments you can hold us to.

  • We draw phone samples from a recent face-to-face probability survey wherever one exists, and adjust for selection into the frame, non-contact and non-response, step by step, as the national phone survey did3.
  • When a study needs answers from individuals, we choose the adult at random within the household, not whoever answers the phone.
  • We keep phone interviews short, and we do not use them to measure household consumption or poverty.
  • We describe frame coverage in plain terms ('gave a phone number', not 'owns a phone') and report the design effect that weighting adds.
  • We do not publish estimates about Nigeria's population from random-digit dialling without its response rate and a statement of what the weights could and could not correct.

What the evidence cannot settle

  • How large mode effects are in Nigeria. We found no Nigerian experiment comparing the same questions by phone and face to face.
  • How many people in Nigeria have at least one phone line. Subscriptions count connections, and we found no authoritative count of unique users.
  • Response rates for random-digit-dialled surveys in sub-Saharan Africa specifically. The averages we cite are global.

Sources

  1. 1.Federal Ministry of Health and Social Welfare, National Population Commission and ICF (n.d.). 2024 Nigeria Demographic and Health Survey: Summary Report.
  2. 2.Nigerian Communications Commission (Figures to July 2026). Industry statistics.
  3. 3.National Bureau of Statistics and World Bank, via the World Bank Microdata Library (Accessed 11 October 2026). COVID-19 National Longitudinal Phone Survey 2020–2021, Phase 1: study description.
  4. 4.J. Brubaker, T. Kilic and P. Wollburg, PLoS ONE 16(11): e0258877 (17 November 2021). Representativeness of individual-level data in COVID-19 phone surveys: findings from sub-Saharan Africa.
  5. 5.A. Ambel, K. McGee and A. Tsegay, World Bank Policy Research Working Paper 9676 (May 2021). Reducing bias in phone survey samples: effectiveness of reweighting techniques using face-to-face surveys as frames in four African countries.
  6. 6.B. Brunckhorst, Y. S. Kim and A. Cojocaru, World Bank Policy Research Working Paper 10585 (October 2023). Tracing pandemic impacts in the absence of regular survey data: what have we learned from the World Bank's high-frequency phone surveys?.
  7. 7.J. Hoogeveen and U. Pape, in Data Collection in Fragile States (World Bank and Palgrave Macmillan) (2020). Fragility and innovations in data collection. Open access.

How to cite this note

Probatio Africa (2026). When can a phone survey stand in for a household visit? Methods note. Sources checked 11 October 2026. https://probatioafrica.com/evidence/methods/phone-surveys.

Our text is licensed under Creative Commons Attribution 4.0 International (CC BY 4.0): you may copy, share and adapt it, including in paid work, if you credit Probatio Africa and link to this page. Quotations from laws, standards and other sources keep their owners' terms; cite the original when you reuse one. If you find an error, write to enquiries@probatioafrica.com. We correct errors quickly and record each correction, with its date, at the foot of the note.