The anonymous review of The Anti-Politics Machine published on Astral Codex X focuses on a case study of a World Bank intervention in Lesotho, and tells a story about it:
The World Bank staff drew reasonable-seeming conclusions from sparse data, and made well-intentioned recommendations on that basis. However, the recommended programs failed, due to factors that would have been revealed by a careful historical and ethnographic investigation of the area in question. Therefore, we should spend more resources engaging in such investigations in order to make better-informed World Bank style resource allocation decisions. So goes the story.
It seems to me that the World Bank recommendations were not the natural ones an honest well-intentioned person would have made with the information at hand. Instead they are heavily biased towards top-down authoritarian schemes, due to a combination of perverse incentives, procedures that separate data-gathering from implementation, and an ideology that makes this seem like the natural and normal thing to do.
Within an evidential framework such as Bayesianism, statistics are a specific type of evidence, drawn from low-dimensional quantitative data, with many more observations than degrees of freedom, collected by an automated process decoupled from the process that uses the evidence to decide and act. Within this framework, the parts of the effective altruist narrative related to global poverty might seem to be claiming that, while of course you can help others somewhat by acting locally, statistics allows us to identify opportunities to do much more good by acting on people very distant from us, because we have much more purchasing power than they do (the implied thesis of GiveDirectly), or have better access to information (the implied thesis of every EA global poverty charity except GiveDirectly).
The review begins by affirming an ideology within which the idea of evidence has been not augmented but replaced by the idea of statistics:
If you want your charitable giving to mean something, you also need to measure your favorite program’s effects with good statistical data.
If only statistics are meaningful, then you do not meaningfully understand the material conditions of your life, your sensorium is not meaningful, you cannot help an individual known to you by using your understanding of your own circumstances, and the only information with meaning is the information endorsed by a mysterious-to-itself process by which a large data collection and interpretation agency such as a modern state socially constructs an opinion using statistical methods. Of course such a position rules out as a meaningful intervention not only feeding a hungry person in front of you, but also long-run AI safety work, since while the former case has too many degrees of freedom and too small a sample size to make statistical inferences, in the latter case the relevant statistics could only possibly be collected after the program decisively succeeded.
The case study begins with three summary facts known to the World Bank staff making recommendations:
- Most of the population in rural Lesotho grew crops, but they did not make very much income from them.
- More than 60% of the area’s young men were working in mines in nearby South Africa and sending back remittances.
- Many families had large flocks of underfed cattle. Even when money was tight, the team rarely observed cattle sales.
The idea is that these facts are true-but-misleading, and a much more extensive up-front ethnographic and historical investigation would be required to act constructively.
As an exercise, I thought about what I might recommend in a situation where all I knew was those three facts.
Most of the population in rural Lesotho grew crops, but they did not make very much income from them.
Conspicuously absent from this is an estimate of how much land the population possesses, and its agricultural potential. The raw acreage per capita can be estimated from population numbers, and one could look at the agricultural yields (and thus revenue) of similar terrain elsewhere. Their actual crop yields can then be compared to the income figures to see whether the problem, if any, is yields or pricing.
If it seems like Lesothans are growing crops just fine, but collecting below-market prices, then they might benefit from better access to global markets via roads or other transportation links, or better information about global markets via telecommunications. It's easy to check if they have cell phones and right-of-way to a nearby large market.
If on the other hand the land seems underexploited, that suggests insufficient access to capital. This could be solved in either of two ways: an outside investor could profitably lend the Lesothans money to invest in agricultural equipment and supplies to improve their yields, or if the Lesothans lack the skills or time to manage that project themselves, they could rent out their land to others willing and able to do so, providing them with direct revenue.
If any of these business opportunities were viable, of course, there would need to be some reason why it hadn't already been exploited. One reason could simply be that no one with access to capital or global markets had put the work into understanding the Lesothans' situation, i.e. that the World Bank has an information advantage it can exploit to broker a deal that otherwise could not happen.
Another reason the deal hasn't happened yet could be that investors are wary of political risk. The World Bank might enable a deal by insuring the investor against expropriation, but if the state's inclined to expropriate from anyone with a visible surplus, then it's not clear that one would be doing the Lesothans a favor by legibly enriching them. The main way I could see an institution like the World Bank being helpful is if they have the leverage to prevent such an expropriation, and therefore collect a profit on the insurance they sold.
More than 60% of the area’s young men were working in mines in nearby South Africa and sending back remittances.
When sending remittances, how much do they lose in fraud or payment processing fees? If a lot, setting up a vouched-for honest intermediary could help. Likewise, do they have access to convenient, cheap transportation?
Another possible problem could be if the young men are capturing only a very small amount of the surplus produced by their labor; if so, helping them bargain with their employers collectively might allow them to earn more.
Many families had large flocks of underfed cattle. Even when money was tight, the team rarely observed cattle sales.
According to what metric are the cattle underfed? Are they yielding less milk, meat, or offspring than they otherwise would under economically optimal feeding? If so, this suggests a profitable investment scheme in which an outside investor either lends the Lesothans the money to feed their cattle adequately, or buys or rents the cattle, feeds them optimally, and gets more out of them than the Lesothans otherwise would.
The above ideas all involve either directly proposing a deal or a specific proposal for further investigation into the Lesothans' circumstances.
The review tells us that the development economists recommended programs that "failed" based on inadequate information, but before actually telling us what they recommended, spends several paragraphs on vague litanies such as:
The World Bank report’s fundamental misdiagnosis of the challenges Lesotho faced formed the basis for a series of failed “development initiatives”, most notably the Thaba-Tseka Development Project, a joint venture funded by the Canadian International Development Agency, the World Bank, the Government of Lesotho, and the UK Overseas Development Ministry.
Finally, a few paragraphs into the second major section of the review, we can read a concrete description of some things that were tried:
the best plots of land in the village had been forcibly confiscated to make room for wood and pony lots, without any sort of compensation
Stealing the locals' land to plant trees and raise ponies is a totally bonkers response to the three summary facts enumerated. If the World Bank bureaucrats were aware of the likely concrete implementation of their recommendations, then they were not making a mistake, they were recommending a campaign of centralization of power similar to Stalin's collectivization of agriculture, albeit an incrementalist one. There may be valid reasons to something like that, e.g. the state might need to extract more resources for use elsewhere, but helping the locals directly affected is not one of them.
If, on the other hand, the system was set up to conceal the implementation details from the World Bank, that would seem to be the root problem - and that is also not the sort of thing that happens purely by mistake.
It's also not a mistake that there seems to have been little overlap between the kinds of ideas I proposed - ideas that respect the autonomy of the people involved, ideas that would occur to anyone who understood the content of introductory college-level courses in microeconomics and finance, ideas that would have occurred immediately to anyone who understood the standard content of an MBA, ideas that I regularly read about implementations of in the pages of The Economist in the '00s - and, on the other hand, the ideas that the World Bank team proposed.
I'm having some difficulty pinning down what the reviewer's diagnosis is, but initially it doesn't seem like they disagree. In the first section, I read:
But even more seriously, the project was so enveloped in “development discourse” that nobody thought to question whether they were working on problems their “recipients” cared about, or merely the ones the “tools of development” were capable of solving. As Ferguson writes, “The promise that crop farming could be revolutionized through the application of a well-known package of technical inputs was so firmly written into the project’s design that it was difficult for those on the scene to challenge it, or even to confront it.”
Part of this, perhaps, comes from the usual overconfidence that other social scientists like to accuse economists of. But there are much bigger systemic problems at play. Development work tends to run on short timelines: grad students and postdocs need to publish quickly for their careers to advance, NGO funding runs on 5-ish year cycles, and charities (particularly in “high-risk” areas) face extremely high employee turnover rates. This simultaneously limits the accumulation of institutional knowledge, while incentivizing practitioners away from the time-intensive process of understanding a particular context in favor of “getting results quick.”
Note that if "results" meant "benefit to the locals," the recommendations would not be the best strategy for "getting results quick" - that would be allocating the development budget to cash transfers to the Lesothans being "helped," which seems like the sort of thing that might be done within a week and could likely be done within a month. In context, "getting results quick" means quickly justifying a project, i.e. a job creation scheme, aka a boondoggle.
Later, in the second section:
Two things stand out to me from this story. First, the “development discourse” lens served to focus the practitioners’ attention on a handful of technical variables (quantity of wood, quality of pony), and kept them from thinking about any repercussions they hadn’t thought to measure.
This is a serious problem, because “negative effects on things that aren’t your primary outcome” are pretty common in the development literature. High-paying medical NGOs can pull talent away from government jobs. Foreign aid can worsen ongoing conflicts. Unconditional cash transfers can hurt neighbors who didn’t receive the cash. And the literature we have is implicitly conditioned on “only examining the variables academics have thought to look at” -- surely our tools have rendered other effects completely invisible!
Second, the project organizers somewhat naively ignored the political goals of the government they’d partnered with, and therefore the extent to which these goals were shaping the project.
This would seem to suggest that the problem is that the World Bank is committed - both through its institutional practices and ideology - to implementing a class of frequently destructive policies, and using statistical evidence to justify the set of actions they already have in mind. This is not a defective form of, but an alternative to, reasoning about the situation implied by their statistical summary, forming specific hypotheses about how to help the locals, and then investigating whether the hypotheses are workable. (First-principles reasoning about cash transfers would immediately identify negative spillover from inflation as a concern, though I don't see how someone would expect that to be a net concern.)
The institutional commitments are similar to the ones described in Moral Mazes - in particular the 5-year cycles remind me of the practice of "milking" a division by deferring maintenance, which makes short-run financial numbers look better, under the assumption that you will be promoted or transferred before anything too bad happens due to neglected maintenance, so you won't be held accountable. Parkinson's Law is even more relevant. I expect that anyone drafting a World Bank recommendation has to follow these rules:
- You mustn't recommend something that would reduce the number of people under your boss's authority.
- You mustn't draw any conclusions that would invalidate an important premise of the World Bank's justification for existence, or your department's.
- You must recommend something that involves the disbursement of funds through a limited set of official structures to do things for the locals.
- Recommendations for further investigation may be used to justify the drafting of another World Bank report, or an expensive formalized RCT or survey, but not someone just going around looking and asking questions.
Such constraints are generally not consciously thought of as restrictions on a larger set of natural possibilities, but instead internalized as limits on which actions are thinkable in the first place. This is part of what makes institutional reform difficult.
The natural conclusion here would simply be to discredit and defund institutions similar to the World Bank relative to other things someone might do to help others, like thinking carefully about decision theory or asking a stranger in distress what sort of help they need. But the reviewer instead proposes funding a larger data-gathering bureaucracy, employing a greater number of experts from a wider variety of fields, to form a more detailed initial picture of local situations, to be fed into the same broken bureaucracy.
I'd like to see a cost-benefit analysis.
Frequent reader, first time commenter - loved this post!!!
Have read partway through so far but.. Glad you are making this stuff more explicit!!! I have a rough self-narrative that over the last several years, I've often been extremely captured by statistics, "believing" (which seems like some kind of ego structure? if I actually fully embodied only trusting statistics, especially in the way I was thinking of them, which was something like "state-endorsed numbers", it seems like I would die. i think accumulation of questions / thoughts like "wait, but how do *they* get the numbers", "how does the data-gathering instrument actually work?", "it doesn't seem like *i* can actually live on just these numbers ... i'm more than what i'm conscious of ... maybe i'm even more than just numbers??" (this last chain, at least consciously/explicitly-ish felt, probably developed over a pretty lengthy period time. David Deutsch's videos about underpinnings of physics, philosophy, Popper, AI, was helpful, I think. I'm still not sure about digital physics vs. continuous, whether our universe is built on math, etc.)) that they were required for certain things. Like I feel like I had (and see below, maybe still have on some level) on a conscious level beliefs resembling "companies are run entirely on statistics, to the extent that they aren't, they aren't companies", which seems to rub up pretty poorly against reality but was I think persistent and in retrospect I think fairly pain-causing belief.
I think Michael Valentine Smith's YouTube videos have been helpful. Lots of clues, gradually reading various folks like you, Michael Vassar, Jessica Taylor, Sarah Constantin, various other Twitter, other sources, thinking, over periods of months/years. think I remember some Twitter responses from Sarah (Constantin) to some math person about phenomenology of mathematics that has stuck in my head (not the exact wording, but ideas that I got from it and iterated on), that was helpful - a clue toward maybe math not just being about churning some axioms through a computer? I'm still not sure about the philosophy of this stuff, but some other sources for this that I remember were I think your Order of the Soul post (I think you talked about "the knowable things"?), Valentine talking about math in his videos (maybe he related it to "the ground" and "mother"?), and something Bryce Hidysmith said in a post about y=mx+b being an AI (perhaps a qualified AI?) for [something]. Valentine talks, I think, about this idea of UFAI having taken over our brains (I think Perri Chase, whom I was rounding off to a sexuality coach-ish in my first attempt to express who she was here, actually said this kind of thing to him) in a more recent (2021? or 2020 maybe?) video. I think the Hidysmith post is the first place I saw it. I'm kind of curious about the genealogy of these somewhat similar ideas. Still feels like a lot of my mental ways of doing math are these (unaligned?) "AI"s rather than something like "true knowledge". Not sure what's true knowledge and what isn't ... it actually could be that I more fundamentally "get" certain combinatorics stuff, for example, than grade school arithmetic algorithms, because the latter were more drilled into me, and the former I think I learned mostly outside of school?? (Math contest problems, Proofs that Really Count by Arthur Benjamin, thinking about stuff myself and with others, maybe some school, maybe some from my job teaching for Art of Problem Solving, which I have learned some mathematical thinking while doing, I think.)
Still sort of feels like I'm "on the path" ... I mean hopefully the quest for knowledge just keeps going, at least for a long time, but the beliefs in this post perhaps still have lots of fruitful propagation to do - just in myself, though, in my writing the just foregoing, I realized that "propagation" could be to other people too, (which realization also led to the qualification to just myself) and now have that wondering in me.
Also a lot of this could be downstream of BeWellTuned and Ziz's stuff ("engineering vs. hacking a mind", possible paraphrase from early sinceriously.fyi) etc. I'm feeling potentially obliged to credit them a lot, but also wondering if I am ascribing too much. They seem to have written up some very fundamental mental frameworks. Not sure what the best way to assign credit for stuff is ... BeWellTuned itself talks about how they're constantly engaging with new ideas, so it's hard to give sources, or sth like that. I still like the idea of credit assignment I think? And feel sort of scrupulous about it, especially commenting on your blog, maybe, because of that post you made about REACH where you mentioned assigning proper credit for emotional labor maybe? But it feels like I can't do a truly accurate job of it in my own mind. Aspirational maybe ... I'm at least trying somewhat I guess, might be doing perverse ascription to some extent.
You could try thinking of credit allocation as part of the means of production, and consider writing up a more detailed and comprehensible-to-an-outsider lit review of the field you're describing here, which ideas are developed where & how they relate to each other. I'd love to see that if you published it somewhere.
By "the field you're describing here", do you mean something like "ideas along the lines of my 2:11 PM comment", or something like "the field of credit allocation" (which would be more in line with my 2:17 PM comment)?
Could you elaborate on "credit allocation as part of the means of production"? I guess I'm thinking of it as something like "how credit creates economic value". At first my thoughts on this felt sort of vague and meaningless, or at least very abstract and hard to verbalize, but maybe I can get a better grasp on things with time.
OK I kept trying to parse your comment and am maybe doing better now? For a bit less than a day I thought you were suggesting that I review the field on credit allocation, which felt confusing and homework-y and frustrating but MAYBE interesting and I was thinking about reviewing literature on economics, machine learning (I think Schmidhuber talks about machine learning being about solving the credit assignment problem ... or maybe I'm conflating a couple of his points), maybe some other stuff, and also wondering what credit even was.
Now it seems more like you're saying something like "credit allocation is useful for creating useful writing", or maybe "credit allocation is useful for creating accurate writing" as a suggestion for how to think about writing up a post on the stuff in my 2:11 PM comment, but it still isn't quite parsing for me. :/ Whatever you actually meant, this hypothesis is the most interesting to me because I'm feel like I don't think about "the means of production" very much? Or maybe I do but not with that term, but it feels like you maybe have some useful thinking tools. This also sounds most exciting to me in terms of actually writing something up.
That's what I meant. You reported feeling scrupulous about credit assignment, and I meant to suggest an alternative opportunity orientation, where it's a positive thing you might do, as applied to the stuff in your comments.
I misparsed the recommendations section as recommendations _from_ the WB, and thought "this all seem reasonable, I wonder what went wrong?", then I got to
> the best plots of land in the village had been forcibly confiscated to make room for wood and pony lots, without any sort of compensation
This is nuts.
Former World Bank Employee stationed in DC and Peace Corps volunteer that worked in East Africa.
Your analysis was well done. World Bank employees are not unlike college professors and administrators. They view the world through the proverbial "poor dad" written about by Robert Kiyosaki. At the top of the World Bank are a few people that make extraordinary incomes, but most of the people doing any kind of field work are just trying to survive in a hyper competitive space because a job with the World Bank offers several benefits that almost no other position in the world has, including preferential visas for yourself and family to much of the Western World.
The Parkinson's law application here was spot on. But it should be noted that the people creating these reports are not capable of seeing themselves through this lens, nor do they see their work as being changed by the system. It only takes about 6 months for an ambitious, sincere person to either be moved to a hall closet where they quickly start looking for another job, or for them to begin to have a change in their perspective where they quit noticing the obscene bureaucracy for what it is, and begin to figure out how to play their part.