Home

Sunday, November 25, 2018

Education as a Tool to Build Nations


Imagined Communities


What is a nation? Defining this is harder than it sounds. Nations are not physical objects like trees or mountains. They also seem to be more than the sum of their observable parts. You can conquer a nations’ land, envelop its people, burn its flag and even revoke its legal status without extinguishing it entirely – just ask the people of Kurdistan, Quebec or Palestine.

Nations can be effectively viewed as imagined communities. Though members of even the smallest nation will never know most of their fellowship members, in the minds of each lives the image of their communion. This image can be exceptionally powerful: it can send people to war, paper over societal divisions and help coordinate people en masse.

As a result, nations are malleable constructs that change when the stories that underpin them change as well. This can happen remarkably quickly: for example, the nation of East Germany ceased to exist virtually overnight, as the story behind it was rewritten following the fall of the Berlin Wall. One of the most effective ways to rewrite these stories is through education, via its ability to shape the collective imagination of citizens. In this post, we focus on two comparative case studies to demonstrate this: Tanzania and Kenya and India and Pakistan.

Tanzania and Kenya


At independence, Julius Nyerere’s Tanzania and Jomo Kenyatta’s Kenya were remarkably similar. Both had similar East African geographies, both contained a similarly diverse composition of different ethnic groups and both inherited a similar set of institutions brought about by British colonial rule.

Despite these similarities, the two nations quickly diverged due largely to the disparate personalities of their inaugural leaders. Nyerere was perhaps Africa’s closest approximation to Plato’s ‘philosopher king’: a highly educated visionary committed to the lofty ideals of self-determination, equality and pan-African socialism. These ideals drove Nyerere to pursue an ambitious nation-building programme in which education played a vital role.



Above: Tanzania’s ‘philosopher king’, Julius Nyerere. Source: www.infed.org

For example, via changes to the curriculum, Swahili was institutionalised as the lingua franca of Tanzania. Even students who entered primary school with no knowledge of Swahili soon learned and brought it home to their villages, enabling Tanzanians to communicate with each other in a common tongue. The new curriculum also placed heavy emphasis on ‘civic education’: a subject designed to spread stories about shared Tanzanian identity, ideology and memory. By the 1970s all teachers were required to serve in the paramilitary national service organisation, helping to indoctrinate them into the ideals of the Tanzanian regime. The net result of this was that Tanzanian schoolchildren left school with a common language and a shared idea of their past, present and destiny as fellow Tanzanian citizens.

Across the border, Kenyatta was driven less by ideology and more by the harsh realpolitik of maintaining power in a divided society. Instead of building a nation, he sought to entrench the power of his ethnic group (at the expense of others) by rewarding his fellow Kikuyu with Cabinet positions and lucrative business contracts. This lack of nationalist impetus was reflected in education policy: Swahili competed with English and local languages (e.g. Kikuyu) as the primary mode of instruction in school and the official geography, history and civics curriculum did not study Kenya as a nation until grade 5. As a result, many Kenyans left school without a common language and without a shared idea of what it meant to be Kenyan – in stark contrast to what happened in Tanzania.

The consequences of this have been wide-spread. While Tanzania has experienced virtually no ethnic conflict since independence, Kenya has suffered ethnic violence at every election since Kenyatta’s rule. Moreover, as Miguel (2005) shows, public goods provision is significantly lower in Kenya: people are less willing to give resources to help their fellow citizens. Since their ethnic makeup at independence was virtually identical, these differing experiences can be largely traced to greater nation-building efforts in Tanzania – of which education was an essential component.

Interestingly, Tanzanian nation-building efforts were typically not extended to Zanzibar, the semi-autonomous archipelago off the coast of Dar Es Salaam. Little effort was made to infuse a pan-Tanzanian identity into the curriculum, as the Zanzibar Ministry of Education was left (and remains) largely autonomous of the mainland. As a result, the Zanzibari people have generally not ‘bought in’ to the Tanzanian myth, resulting in a powerful secessionist movement which breeds instability and violence at election times.

India and Pakistan


At Independence in 1947, two new nations of India and Pakistan came into being facing ostensibly similar situations. Both were products of the same colonial project with a broadly coherent education policy: Empire sought to educate a ‘pro-British Indian elite’ through a system that was selective rather than universal, liberal rather than scientific and imperial rather than national. However, colonial educational institutions were unevenly distributed and relied on local collaboration, challenging the idea of initial equivalence. At the time of the first Census in 1950, literacy rates between India (20%) and Pakistan (14%) already exhibited a discrepancy.

India and Pakistan pursued similar educational policies at the outset: a broadly secular education communicated through a unifying language (Hindi for India, Urdu for Pakistan). Both projects expressed a prescriptive vision that was not merely postcolonial but anti-colonial: whilst building on colonial institutions, education offered an opportunity for intellectual decolonisation. 

There were differences, which reflected the different national challenges each country faced. India’s national identity was to be built around a tolerant multiculturalism that explicitly rejected communalism. In recognition of India’s immense linguistic, ethnic and religious diversity, it was hoped that education would serve to enfranchise diverse communities and dismantle identity hierarchies such as caste. Across the border, the ethnic incongruity between East and West made Pakistan an immediately less stable state: the inclusion of Islam in educational policy reflected an urgent need to build a national identity that could make sense of this unique geography.

These initial ideals have not been realised. In addition to failures of policy implementation, both visions of national identity have undergone change almost beyond recognition. In 1977, Zia-ul-Haq launched a coup in Pakistan and sought to legitimise his dictatorship through an agenda of Islamization. As with Jinnah’s vision thirty years previously, education policy was mobilised to express a new national identity. The right to education, contents of curriculum and its purpose were all realigned to the values of the Quran and Sunnah, while national identity was re-expressed along lines of solidarity with the Sunni Middle East, at the expense of cohesion within Pakistan.

In India, Nehru's educational model of secularism and internationalism was consistently rejected by the Bharat Janata Party, whose advocacy of Hindutva, Hindu majoritarianism, became part of educational policy with the advent of their parliamentary majority in 1998. The return of Congress to power in 2004, followed by the subsequent resurgence of the BJP under Narendra Modi, has led to a certain flip-flopping of educational policy: entire textbooks are rewritten according to the ideological bent of the incumbent political party. At government schools, Indian children are taught historical fantasies as facts, as Hindutva legitimises and enforces a national identity that is explicitly anti-Muslim and self-reliant.

From broadly similar starting points, India and Pakistan pursued similar policies at Independence, both of which were undermined by ideological re-conceptualizations of nationhood.  Whilst neither nation has achieved the success seen in East Asia, India’s educational progress has continued to outstrip its neighbour’s. To explain this, we might look to the fact that the ideological reconceptualization of education policy manifested itself in India two decades later than Pakistan. We may also return to the unique strains on Pakistan’s nationhood in 1947 and question whether, as Sen cautiously notes, ‘just as education influences culture, so can antecedent culture have an effect on educational policies’.

[1,296 words]

References


The idea of viewing nations as imagined communities is most commonly attributed to Benedict Anderson. Yuval Harari presents this idea in a more contemporary and accessible fashion, arguing that our ability to believe in ‘imagined communities’ differentiates us from other species in the animal kingdom, and has enabled us to evolve from insignificant apes in the Horn of Africa to the dominant species on Earth.

The Tanzania and Kenya section draws heavily on the work of Ted Miguel, whose work on public good provision helps make tangible the impact of the different commitments to nation-building between the two countries.

The idea of India as an imagined community is best articulated by Sunil Khilnani. Amartya Sen’s coverage of the Subcontinent and development policy is essential reading, not least due to the author’s own experience of Partition. He argues that the current Indian government is repeating some of Pakistan’s mistakes of nation-building, particularly regarding ideological reworkings of nationhood.

  •          Anderson. B, ‘Imagined Communities’
  •          Harari. Y, ‘Sapiens’
  •          Miguel. E, ‘Tribe or Nation? Nation Building and Public Goods in Kenya versus Tanzania’
  •          Khilnani. S, ‘The Idea of India’
  •          Sen. A, ‘Development as Freedom’


Sunday, November 18, 2018

Improving Education Outcomes: What We've Learnt from Randomised Evaluations

In my last post, I discussed the use of Randomised Controlled Trials (RCTs) in Education Economics, focusing on the issues of causal identification they seek to address. If you are unfamiliar with RCTs and have not read that post yet, I would recommend you do so [here].

In this post, I discuss what we have learnt from 20 years of randomised evaluations. I argue that effective interventions (i.e. ones that improve attendance or exam scores) typically do two things well: first, they narrow their focus onto a specific malfunction that is inhibiting education outcomes; second, they do so in a way that properly accounts for the incentives of the agents studied.

What Works


Conditional Cash Transfers


Conditional cash transfers (CCTs) provide a good example of this. CCTs are remarkably simple: participants in the treatment group receive a direct cash transfer (usually ~$50 per month) if their child attains a certain level of attendance in school. CCTs work well as they directly incentivise parents to send their children to school while simultaneously relieving a financial constraint that may have previously prevented them from doing so. In a review article, Glewwe and Muralidharan (2015) outline 27 RCTs to test CCTs, 24 of which produce a statistically significant increase in school attendance. As argued in my last post, the unanimity of these results in a variety of contexts makes the effectiveness of CCTs an extremely robust finding. Of course, CCTs cost money – but the financing could theoretically be provided by donor funding, particularly if it is redirected away from other forms of budgetary support with less proven results.  

Teacher Performance Pay


Another good example is the use of teacher performance pay. Again, performance pay seeks to address a specific malfunction (demotivated teachers) in a way that is appreciative of their incentives. In the same review article, Glewwe and Muralidharan cite 5 high-quality RCTs, all of which show that exam results significantly improve in treatment schools where teachers are paid according to performance. Not only this: Kremer et al. (2005) show that there is a significant positive correlation between teacher performance and the extent of performance pay desired beforehand, suggesting that good teachers ‘know who they are’, implying additional sorting benefits from performance pay (i.e. better quality teachers are attracted in the first place).

What Doesn’t


Discretionary Rewards


However, performance-based interventions fail when insufficient attention is paid to incentives. A good example of this is a study by Kremer and Chen (2001), which gave Kenyan headteachers discretion to award bicycles to pre-school teachers based on good attendance. Somewhat predictably, every teacher was reported to have good attendance and received a bicycle. However, when absence was externally audited, attendance had not changed at all from baseline. The study did not take into account the headmaster’s incentive to collude with his fellow teachers.

CCT programmes must also be mindful of incentives. Suppose you are a farmer with four children who help out with farm work when required. An NGO comes along and offers you money if you send two of your kids to school – how might you respond? A sensible way might be to remove your non-sponsored kids from school completely, to compensate for the shortfall of labour on the farm. Several studies have documented these types of ‘negative spillovers’ to siblings (e.g. Barrera-Osorio et al., 2011); interventions must be wary of these and redesigned accordingly.

More-of-the-same Inputs


Interventions may also fail when inadequate care is taken to understand the fundamental barriers to learning. For example, when it comes to improving test scores, ‘more-of-the-same’ inputs (e.g. more textbooks, stationary and teachers) have proven remarkably ineffective (Kremer et al., 2013). Buying more textbooks may sound sensible, but when children are illiterate, unsupervised and of wildly varying abilities, these textbooks are unlikely to do anything but gather dust. These examples should caution us against ‘lazy’ interventions that throw more of the same ingredients at a problem and expect different results. We need to be more creative. A study by Banerjee et al. (2007) sets a good example: to deal with the problem of ‘left behind’ children, the authors implement and test two novel remedial education programmes. The first hired young women from the community to teach basic literacy and numeracy skills; the second consisted of a computer-assisted learning programme tailored to the child’s ability. On average, the two interventions increased test scores by 0.28 and 0.47 standard deviations respectively.[1] The author’s estimate that extending this programme would be 12-16 times more cost effective than simply hiring more teachers.

The Issue of Scalability


While these are undoubtedly promising, there are numerous difficulties associated with scaling up these interventions to form meaningful policy change. For instance, RCT-based interventions may change market prices or produce negative spillovers when scaled up, both of which may shift the net benefit of the programme or the identities of the beneficiaries. On a more practical level, wide-scale policy change often requires immense political will and capacity – neither of which are required for a successful RCT (Banerjee et al., 2017).

However, these issues are not insurmountable. The experience of Pratham, an Indian NGO, gives cause for hope. In 2004, Pratham ran a successful RCT which grouped children based by ability rather than ages, helping children that had previously been left behind. The Pratham-approach was then integrated into some pilot schools. The intervention had to be adapted to be both feasible and financially viable: several variations were retested by further RCTs to determine the most effective. In the end, the best variation was the adding of a ‘Pratham-specific’ hour to the school day. Today, the additional-hour model exists in 107,921 schools across 13 states of India, reaching nearly five million schoolchildren. Five million children are now being taught daily by a strategy proven to help them learn – the welfare implications of this are staggering. These types of interventions make me excited to work in the education sector, and help convince me that RCTs can be a powerful tool to improve the world we live in.

[998 words]

References

Glewwe and Muralidharan (2015) have a very good review article which outlines the education RCTs that have worked vs. those that haven’t. Banerjee et al. (2017) provide one of the best and most up-to-date discussions of the challenges associated with scaling up successful RCTs to policy change. All cited articles are listed below:

·         Banerjee et al. (2017), ‘From Proof of Concept to Scalable Policies: Challenges and Solutions, with Application’
·         Banerjee et al. (2007), ‘Remedying Education: Evidence from Two Randomised Experiments in India’
·         Barrera-Osorio et al. (2011), ‘Improving the Design of Conditional Transfer Programs: Evidence from a Randomised Education Experiment in Colombia’
·         Glewwe and Muralidharan (2015), ‘Improving School Education Outcomes in Developing Countries: Evidence, Knowledge Gaps, and Policy Implications’
·         Kremer et al. (2005), ‘Teacher Absence in India: A Snapshot’
·         Kremer and Chen (2001), ‘Interim Report on a Teacher Attendance Incentive Program in Kenya’



[1] Standard deviation is a measure of how spread out numbers are. Different contexts have very different data distributions and averages; reporting results in standard deviations is a way to ‘standardise’ this so we can easily compare across contexts

Monday, November 12, 2018

Uncovering Causality I: Randomised Controlled Trials


Causality


For the most part, empirical Economics (or ‘Econometrics’) is concerned with identifying causal relationships in the social world. We often think of causation in terms of the possibility of manipulation. For instance, X can be said to cause Y if when we manipulate X, Y responds in the predicted fashion.

In Economics, we propose causal relationships via hypotheses, which are tested using data and standardised statistical techniques. This deference to an objective scientific method is used to justify Economics’ label as a social ‘science’. It is also used to distinguish Economics from humanities subjects like History, which may speculate causal relationships via theory but make little attempt to validate them in a way that is both objective and generalisable.

This is not to say that Economics is the same as Physics or Chemistry. Of course, physicists and chemists share economists’ commitment to making meaningful causal statements about the world. However, in dealing with more fundamental and discernible laws of nature, natural scientists are able to make near infallible ‘if – then’ statements such as ‘if water reaches 0°C, then it will turn to ice’. Moreover, since their objects of interest are atoms rather than humans, scientists can conduct carefully controlled laboratory experiments to make causal identification easier and more replicable.

In contrast, economists study a messy social world containing a maelstrom of different actors, all of whom interact and react with one another in chaotic and unpredictable ways. For every cause we propose to explain an observed outcome there are myriad other potential causes pushing in the same and opposite directions. Isolating the sole impact of our speculated cause can be very difficult, which makes it a lot harder to make robust causal statements.

Nonetheless, Economists have a variety of tools to help do this. To understand these, a useful starting point is to distinguish between correlation and causation.

Correlation ≠ Causation


Correlation ≠ causation. To see this, suppose I collect data on textbooks per classroom and mean exam scores for 30 schools. The scatterplot might look something like this:



Source: Made up figures

Can we conclude from this that more textbooks cause higher exam scores? No – it may simply be that schools with more textbooks also have lower student-teacher-ratios (STRs), better classrooms and more engaged teachers – all of which could also improve exam performance. We need some way to control for these confounding factors.

Randomised Controlled Trials


Perhaps the simplest way to do this is to conduct a Randomised Controlled Trial (RCT). The basic idea is to take a sample of schools and randomly split them into a treatment and control group. We split the groups randomly to help ensure they are ‘balanced’, meaning the treatment and control group are as similar as possible in terms of STRS, desks, and any other confounding variables we can observe. If the two groups are imbalanced, we can always re-randomise until balance is achieved.

The treatment group is then ‘treated’ while the control group is left untreated (or given a placebo). In this instance, a treatment may be to provide schools with free textbooks for each child. After giving the treatment time to take effect, we then examine children in both groups to test for a ‘treatment effect’. The outcome of interest is the difference in exam score between groups: since the two groups were as similar as possible ex ante, we can assume any difference in exam performance post-treatment is caused by the treatment itself.

The diagram below may help conceptualise this:



Source: Sydney Morning Herald http://www.smh.com.au/

This is an RCT in its simplest form. We can add twists to this basic framework: for example, if we are worried about baseline imbalance, we can examine both groups before the intervention and then again at the end of the treatment window. We then test to see if there is a ‘difference-in-difference’ between the two groups, which effectively nets out any ex ante differences between the two.

RCTs take their intellectual heritage from the field of medical science. When testing a new drug, pharmaceutical companies compare the outcomes of a treatment vs. a control group made to be as similar as possible ex ante. While the first published RCT in medicine took place in 1948, it took until the 1990s for RCTs to become popular in Economics. In just 20 years, RCTs have gone from being a novel econometric technique to being considered the ‘gold standard’ in conducting causal work in social science.

Strengths


There are a number of reasons for this. Most importantly, by controlling for confounding factors at the outset, we get arguably the ‘cleanest’ identification of a causal relationship between X and Y. For me, this is where Economics most lives up to its social science moniker. If we conduct the same RCT in a variety of contexts and get the same result each time, this, I think, is the closest we can get to objective scientific knowledge about the social world. Owing to the simplicity of their methodology, the results from RCTs are also easy to communicate, aiding effective policymaking.

Limitations


However, RCTs are also expensive, time-consuming and often raise a host of ethical questions. Also, as my friend Hannah comments on my first post, there have been difficulties in scaling up the findings from RCTs to meaningful policy change – an issue I discuss further in my next post. These points are all important; but for me the most compelling limitation of RCTs is their inability to answer the really big questions. For example, consider the claim that education causes people to earn higher wages. We cannot, practically or morally speaking, randomly allocate different amounts of education to children. In the same way, we cannot uncover the effect of education on growth by randomising education delivery across different countries. To this extent, it is best to view RCTs as a powerful tool with a well-defined purpose, rather than a ‘silver bullet’ which solves all the issues of causal identification.

[990 words]

References


To learn more about RCTs, a good place to start is ‘Running Randomised Evaluations: A Practical Guide’ by Rachel Glennerster and Kudzai Takavarasha.

In my opinion, there is a gap in the market for a book that explains the principles of econometrics in an intuitive and engaging fashion (the best I can think of is Mostly Harmless Econometrics, but even that gets quite technical). If you know of any, please let me know.

Sunday, November 4, 2018

A Despots Guide to Education


In the past, student activism has been a force to be reckoned with. It helped end Apartheid in South Africa, was the catalyst in the end of the Vietnam War and was the loudest voice in the pro-democracy protests in China in 1989, epitomised by the infamous ‘Tank Man’ protestor of Tiananmen Square. In Malawi and Benin, students at the University of Malawi and Cotonou University led the first anti-government demonstrations in over three decades, hastening the process of democratisation in Africa (Posner, 1995).


Above: ‘Tank Man’ of the Tiananmen Square protests. Source: www.history.com

As these examples show, education can be a powerful force of history. Traditionally, dictators have not sat idly by for this force to determine their fate; on the contrary, they have actively manipulated this force as a means to serve their own ends. To understand how, it makes more sense to view dictators as skilful political agents who deploy a variety tactics to ensure their survival, rather than blundering, Sasha Baron Cohen-style characters.[1] Maintaining power in an autocracy can be viewed as a delicate balancing act: too much repression and dictators risk inciting a revolution; too much liberalisation and they risk losing their iron-grip on power. To keep this balance alive, dictators have used education policy as a vehicle to employ a variety of strongman tactics, including repression, patronage and indoctrination.

Strategy 1: Repression


One way to deal with the threat students pose is to simply intimidate, arrest and even murder prominent activists. A notorious example of this is the case of Steve Biko, the leader of the South African Students’ Organisation. In 1977, Biko was arrested and brutally murdered by the Apartheid regime. To a lesser degree, we can see this tactic in use today in Uganda. President Museveni has actively targeted popular student activists like Kizza Bisigye and consistently shut down peaceful student protests as soon as they start, with the ringleaders arrested and often given lengthy prison sentences (Parkes, 2015).

While this approach is arguably the simplest, an overreliance on heavy-handed repression can produce martyrs and intensify existing grievances. A more subtle form of repression is to simply slash funding to the education sector. This tactic is taken straight from the colonial handbook. For example, in the DRC, Belgian occupiers capped education at the primary level in order to present the emergence of an aspirational and potentially dangerous educated class of Congolese. As a result of this policy, the DRC had just 12 University graduates at the time of independence (Bayart, 1989).

Strategy 2: Patronage


Dictators also use education as a means to distribute favours (or ‘patronage’) to their support base, whilst simultaneously excluding outsiders. The benefits to this strategy are two-fold: support is consolidated amongst the ‘in’ group whilst the ‘out’ group is gradually disempowered. Patronage is often most effective when it is used to exploit pre-existing divisions in a society, such as appealing to the leaders regional, religious or ethnic group.

Education is a popular vehicle to deploy this type of favouritism. As Franck and Rainer (2009) show in Africa, the education enrolment of a particular ethnic group increases when they have 'their man’ in power. Congo-Brazzaville serves as an interesting case study for this phenomena. The country is divided into two main ethnic groups: the Mbochi in the North and the Kongo in the South. From 1960-1968, the country was ruled by ethnic Kongo rulers. This changed in a coup d’état led by Marien Ngouabi in 1968, which installed a series of Mbochi leaders for the next 24 years. The graph below shows that when Kongo leaders ruled the country, the educational completion rate of the Mbochi were significantly lower than that of the Kongo. However, after Ngouabi’s coup, the Mbochi quickly closed this gap and eventually achieved higher rates of primary school completion (and attendance, and female literacy).

Source: Franck and Rainer (2009)

Strategy 3: Indoctrination


Finally, dictators can use education as a means of indoctrination. Similar to patronage, this strategy does more than just allay the threat education can pose. By inculcating in the youth attitudes and beliefs conducive to the ruling party, indoctrination serves as a means to entrench and solidify the regime for many generations to come.

North Korea’s Kim Jong-Un serves as the undisputed poster boy for this tactic. Amidst stories of the glorious defeat of American invaders, North Korean textbooks are also reputedly littered with bizarre claims about the leader himself. Some textbooks claim that Kim Jong-Un learned to drive at age 3, won a yacht race at age 9 and scored 11 hole in ones on his first ever round of golf, only to promptly retire and to never play the sport again (Daily Mirror).


Above: Pages of a North Korea elementary school textbook. Source: http://blog.jinbo.net/

Conclusion


These examples reemphasise the idea that dictators are not simply insensitive thugs who got into power by accident. More often than not, dictators represent rational political actors versed in using the full extent of the state apparatus to ensure the survival of their regime.

Viewing dictatorship in this light confers a number of advantages. First, it guards us against the complacent idea that dictatorships will inevitably unravel due to incompetence at the top. This idea is supported by the history books, which show dictatorship as one of the most durable forms of government that humans have ever invented. Second, this rational actor framework helps explain many things beyond education policy. For example, it can explain why dictators tend to direct a disproportionate amount of public goods towards cities rather than countryside: a phenomena known as ‘urban bias’. Put simply, rioting factory workers pose more of a threat to a regime than disorganised farmers, so are placated with an unequal share of state resources.

[994 words]

References


Thanks for this blog must go to Brian Klaas, my African Politics tutor at Oxford, who encouraged me to ‘see through the eyes of an elite’ when thinking about autocracy in Africa. Brian has a great book called ‘The Despots Accomplice’ which I would recommend to anyone interested in authoritarianism or democratisation around the globe. 

I would also recommend my friend Charlie Parkes’ article in the Huffington Post, which looks at the strongman tactics being deployed by President Museveni in Uganda: https://www.huffingtonpost.co.uk/charles-parkes/uganda_b_8085226.html

Other articles referenced are given below:


[1] There are of course exceptions to this: most notable is perhaps Jean-Bédel Bokassa of the Central African Republic, who reputedly viewed himself as the genuine reincarnation of Napoleon Bonaparte. His coronation alone cost 10% of CAR GDP.