Statistical Institutions of India

(The editorial is based on the article “A short history of data” which appeared in The Hindu for 21st March 2019. In this editorial, we’ll see how Indian national statistics and the organisations that administer them have helped shape data collection methods across the globe.)

Over the past two months, Indian national statistics and the organisations that administer them have faced a volley of criticism. In January, two independent members of the National Statistical Commission resigned in protest, over alleged suppression of economic data by the government.

More recently, amidst growing scepticism regarding India’s official statistics, more than a hundred scholars comprising economists and social scientists released a statement decrying the fall in standards of institutional independence, suggesting political interference as the cause.

Kaushik Basu, a former chief economist of the World Bank, also recently bemoaned the declining credibility of India’s official statistics.

While declining data quality has been an issue for a while, concern over institutional independence is new. What several of these criticisms refer is the fact that India’s national statistics were once internationally renowned among economists and policy professionals for their reliability.

In the decades following World War II, India had reason to be proud not only of the institutional independence of national statistical bodies but also — uniquely among developing countries — of a pioneering history of independent data collection and publication.

Pioneering History of India’s Statistical Enterprise

• The growth of India’s vast national statistical infrastructure dates back to its first decade as an independent country. The birth of a new nation led to an explosion of national statistics, based on the need to plan the economy through Five Year Plans.
• These years would see the establishment of the office of the Statistical Adviser to the Government, bi-annual National Sample Surveys (NSS), the Central Statistical Organisation (CSO), and National Income Committees (that made the estimates similar to GDP measurements).
• The moving spirit behind these developments was Prasanta Chandra Mahalanobis, whom Jawaharlal Nehru described as the “presiding genius of statistics in India,” and the institute that he had founded in Calcutta in 1931, the Indian Statistical Institute (ISI).
• Mahalanobis was also involved in the discussions that led to the establishment of the UN Statistical Commission in New York, a body that he would be voted Chairperson of several times during the 1950s. (As a pioneer in the emerging field of large-scale sample surveys, he would also be the force behind creating the UN Sub-Commission on Statistical Sampling in 1947, co-authoring the textbook on the subject in 1950).
• On the eve of World War II, it had become apparent, both to the colonial government and the Indian National Congress, that any concerted postwar developmental effort would require fine-grained statistical information on the national economy.
• Nehru, Chairman of the Congress’s National Planning Committee, called attention in 1938 to the “fact of the absence of accurate data and statistics.”. Even a decade later, he would admit, “we have no data,” as a result of which, “we function largely in the dark.”
• While the British colonial government had made efforts to collect statistics on the subcontinent from the early 19th century, these were provincially organised and geared towards trade and administration.

Successes of Indian Statistical Endeavours

• The results of the National Sample Survey offered high-definition snapshots of the country’s material life — casting light on cost of living, crop estimates, household consumption, industry, trade, and land holding patterns.
• “No country, developed, under-developed or over-developed, has such a wealth of information about its people as India.” - Edwards Deming (American statistician).
• Singaporean statistician Y.P. Seng observed that by comparison that China had “no genuine statistics” and so India’s example of using surveys would “serve as a guide and an example worthy of imitating”.
• The Planning Commission, beginning in 1962, used the data the National Sample Survey generated by its household surveys to craft the country’s poverty line.
  India was a frontrunner in this regard: the United States developed its own poverty line three years later.
• With their combined influence on the UN Statistical Commission and the UN Sub-Commission on Statistical Sampling, the Indian Statistical Institute and the National Sample Survey continue to have a lasting impact on estimating poverty across the developing world.
• Methods pioneered by the National Sample Survey have become the norm for household surveys across the globe. For example, the Living Standard Measurement Study surveys conducted in several countries by the World Bank can trace their lineage back to the work of Indian statisticians associated with the Indian Statistical Institute and the National Sample Survey.

Conclusion

• This distinguished history, which India can claim with pride, makes the recent undermining of the credibility of our statistical output especially regrettable.
• We can, however, ensure that when we look back on this several years from now, it represents an anomaly rather than a lasting, irreparable loss of institutional credibility.