5.3 Summarising the 90 Binary Sorts
So which topics should be split up in this way. To answer this, I wanted to look at three questions.
- How confident was the binary sort that it had really found a division in the data?
- What were the subtopics that the binary sort generated?
- Were these subtopics from different categories?
If the answer to 1 is negative, then this technique seems too random to usefully be applied. If the answer to 3 is negative, then splitting the topic into subtopics is more trouble than its worth. And you can’t answer 3 without answering 2. So here’s a summary of what the splits in each topic looked like.
The first column is the topic number, to help line up with the discussion in Chapter 2. The second is the name I gave to the topic. The third is how proportion of articles in the topic that the binary sort put in one or other subtopic with probability at least 0.99. As you can see if you scroll down, or if you sort by that column, these binary sorts are often very decisive.
The next two columns are the keywords for the two subtopics. That is, they are the (relatively common) words with the highest ratio of their probability of being in one subtopic to the probability of being in another. This is enough to get a sense of what division the subtopic is making.
So pretty clearly topic 38 should be split up. The first subtopic is broady speaking in philosophy of biology, and its centerd around issues about animal cognition and Morgan’s Canon. The second subtopic is about some issues in (loosely speaking) Kripkean metaphysics.
And topic 70 looks fairly disjunctive as well. The first subtopic is about applied ethics, the second subtopic is about psychoanalysis. That’s easy enough to split as well.
A lot of the others don’t look like they are dividing across topic bounaries. Both sides of the Speech Acts topic are in philosophy of language, as are both sides of Belief Ascriptions. This was actually a little disappointing about Speech Acts; I was hoping that the model would tease apart the Austin-inspired work from the middle of the 20th century from the Langton-inspired work from more recent years. But it didn’t find that division. (I was hoping this because a few other models I’d run had found this division. But sadly this one didn’t.)
The model splits Decision Theory into two parts, one centered around the Pasadena Problem and the other around the Two Envelope Paradox. It is far from obvious how to categorise Decision Theory, but it doesn’t seem that it would get any easier by following this division. So I’ll leave that in one piece.
The really complicated one here is Arguments. The keywords of the first subtopic suggest it is primarily about conceivability arguments for dualism. The second subtopic is a bit more of a mixture. There is a hint (backed up by looking at the articles) that it includes some articles about arguments for incompatibilism. But the big thing about this binary sort is that it is very asymmetric. The reason it has such a high confidence measure is that most of the articles are firmly in the second subtopic.
In fact of the 122 articles, 65 of them have a probability greater than 0.99 of being in the second subtopic. So a better way to think about what’s happening here is that the binary sort didn’t so much split the topic in two, as carve out a distinctive subset from the whole. So I’ll treat the first subtopic as being about conceivability arguments in particular, and the second as being about arguments in general.
Let’s look at the rest of the topics that I decided to split up into subtopics
Ordinary Language is a mess, and the Confidence measure isn’t as high as I’d like to make a division, but the subtopics look pretty clearly disjoint. The first is about Ethics, the second is about Mind. And since we already have a separate topic for contemporanous British philosophy of language, splitting this topic into Ethics and Mind seems like a sensible plan.
Freedom and Free Will is really the one case where the model got thrown by the fact that two different philosophical debates use a common word. But the subtopics bail us out here, splitting it into debates about free will and debates about political freedom.
Crime and Punishment could arguably have been left alone. But it looked to me like the first subtopic concerns issues in Ethics, and especially about forgiveness as an inter-personal relationship, and the second is about Social and Political Philosophy.
I’ve already gone over Sets and Grue at some length.
I don’t quite know what happened in the original model with Frankfurt Cases. Most of the models I built had a topic centered around Frankfurt cases. (And the ones that didn’t had a distinct topic for free will, it was just that Frankfurt wasn’t especially central to them.) But no model other than this one threw stuff about fiction in with them. (There was one time when the model insisted on putting works about fiction in with philosophy of biology work on function. And I spent a lot of time worrying that it was being overly influenced by the overlapping letters.) Anyway, the subtopics bail us out here - philosophy of fiction has little to do with the free will debates that this topic is primarily about.
Races and DNA makes a bit more sense as a topic, but is still hard to classify. But the subtopics are easy to classify; the first is about Philosophy of Science, the second about Social and Political Philosophy.
And the work on Norms divides reasonably neatly into Language norms and Ethical norms. Possibly if we ran the clock forward and included papers after 2013 we’d see more papers on epistemic norms here, and that would complicate the neat division.
So those are the divisions I made. It’s helpful to have them as a table, not least because I’ve already been using their names in the previous chapter.
| Topic | Subject | First Subtopic | Second Subtopic |
|---|---|---|---|
| 24 | Ordinary Language | OLP Ethics | OLP Mind |
| 35 | Freedom and Free Will | Political Freedom | Free Will |
| 36 | Crime and Punishment | Forgiveness | Law |
| 37 | Sets and Grue | Grue | Sets |
| 38 | Origins and Purposes | Teleology | Origin Essentialism |
| 55 | Arguments | Conceivability Arguments | Arguments |
| 70 | Medical Ethics and Freud | Medical Ethics | Freud |
| 77 | Frankfurt Cases | Frankfurt Cases | Fiction |
| 79 | Races and DNA | DNA | Race |
| 90 | Norms | Language Norms | Moral Norms |
There is one last technical point to notice. The binary sort tells us how to divide the articles that are in a topic into one or other subtopic. But to calculate the weighted sums, we also have assign some weights to the articles that are primarily in other topics, but which have some probability of being in this topic. (This is especially pressing for the Ordinary Language and Arguments topics.)
Happily there is a way to handle this. The topicmodels package lets you apply an LDA model out of sample. That is, once you have a model, you can ask it how probable it is that some new article, which wasn’t used for generating the model, falls in one topic or another. So for each of these 10 topics, I went back and looked at all 32183 articles, and asked for how probable it is that they are in one of these subtopics or another. I then multiplied that probability by the probability that they were in the original topic to get the probability that they landed in a subtopic. And those probabilities are what went into the weighted sum graphs you saw in the last chapter.