The PhD Metagame
The Cursed Word "Interesting"
People calling ideas âinterestingâ was perhaps the greatest challenge I regularly faced in communicating about research.
This wouldnât matter so much if coming up with good ideas wasnât arguably the most important part of research itself.
Hereâs how it goes. Youâre talking to someone about research ideas, and they say âI find X interestingâ or âX would be interesting.â They almost certainly mean that they think X has never been done before. They might be claiming that their new idea X is:
- just something they cooked up, it may not even be worth pursuing research-wise
- a fun application of an existing idea
- a fun application with a fundamentally new idea
- an incremental tweak
- a clever idea (i.e., an incremental tweak people will like)
- a potential component of a research paper
- a potential entire research paper
- a potential research redirection
- a total moonshot project
- research-adjacent, but not paper-driven; a more fundamental issue that they like to think about and discuss
(The above ordered from least to most dramatic.)
This challenge is exacerbated if youâre talking with people who arenât actively publishing, or who are publishing-adjacent. If youâre in the research world, youâre hungry to publish, so all ideas pass through this âis it novel enough for a research paperâ filter. If youâre not, your novelty or excitement filters arenât calibrated the same way. Plus, before youâre a bit seasoned, most research ideas you have are incremental, hacks, boring, too out-there, dead ends, or repetitions of old patterns from five or forty years ago.
Back to the conversation. You might reply, âInteresting!â and mean one of:
- Iâm not paying attention and maybe want to leave the conversation.
- I donât actually understand what youâre saying.
- I get the gist, but you didnât use any examples / talked too fast / I havenât thought about the problem enough, so I need time to process.
- I think youâre proposing category Y (above), but I think itâs actually a lower category Z (above), or itâs been done before.
- Most common scenario here: I think that you are claiming this is a novel idea worthy of a research paper, but itâs actually almost the same thing as Foo et al. (2019), so I donât think itâs worth pursuing.
- I think youâre proposing category Y (above) and I agree.
- I think youâre proposing category Y (above), but I actually think it could be upgraded to a higher category (Z) above.
- This one is really fun and one of the best parts of research conversations.
Because people publish so much, the scenario of âthat actually exists, see Foo et al. (2019)â is super common. But, it is socially exhausting to keep telling someone thatâyou seem like an annoying know-it-all. And if you donât know them well, or you arenât sure what category theyâre aiming for, it might not feel worth it.
Even worse, if the idea is fun and novel and exciting to them, what kind of monster could tell them that itâs stupid, incremental, a dead-end, and oh by the way has been done before by fourteen papers?01
This leads to a common failure mode, which is people just talking past each other saying the word âinteresting.â The idea-giver hasnât made clear what category they think the idea is, and the idea-receiver isnât able to disambiguate and respond in a non-annoying way.
As usual with research, you might not even realize this is all going on for a couple years. Once you do, you might be tempted to start replying with:
âActually, you said âinteresting,â but really itâs a boring ideaâwe could spend six months doing that and nobody would even yawn at it.â
But, of course, you canât go around doing that. (Plus, you might be wrong.) So we end up in a weird Nash equilibrium of people going around saying âinterestingâ to each other and nobody quite knowing whatâs going on.02
Success here is fascinating to observe.
Find really effective communicators, usually people who fit the criteria of (a) professors, (b) people like their research, (c) people like them personally. (Not all three are required, but each is a strong signal boost.) Listen to them have a conversation where a junior researcher is learning to talk about research. Watching the junior researcher feels like watching someone try to wobble down the road on their first bicycle, fresh off of training wheels.
What the effective person does is:
- Model where the junior person is coming from â what category of âinterestingâ are they proposing the idea is?
- Then, validate the way that they found the idea interesting. This can be quick, and is more common if the effective communicator has higher emotional intelligence. If the next step is carried out well, itâs actually optional.
- Mold the proposed ideaâwhich is probably badâinto a direction worth pursuing. This might be the nugget of a research paper, or maybe a research direction. Here comes the wild part: this molding will ideally have two additional characteristics:
- It will fit in the effective communicatorâs research agenda.
- They will make it seem like the junior person had the idea in the first place.
If youâre following so far, this feat of accomplishment is totally wild.
Once I understood this was happening, I spent years trying to replicate it. But trying to do this by imitation is almost impossible, like trying to ride a bike based on imitating someoneâs movements. I eventually realized that most profs are using a much simpler heuristic to achieve results almost the same as the above:
- Donât worry too much about where the person is coming from, especially if you understand the idea.
- Be kind. You can say something generic and warm here, like âinteresting!â
- Always be cooking up research ideas. You probably have a dozen or so youâd like to work on, and another few dozen you find interesting. Any opportunity like this, find the nearest neighbor idea to what the person is talking about, and segue into it. Because of various factors (read: immense social pressure), the person probably wonât even notice if itâs a pretty big jump.03
This is goal-oriented, and I wouldnât say constitutes exactly having a âconversation,â but itâs an effective way to handle an input of an onslaught of wet-behind-the-ears folks saying the word âinteresting,â and your output needing to be research papers.
Thank you for reading, I hope you found this interesting.
Footnotes
This happens quite a lot, and Iâve seen people take it hard. Itâs challenging for people to pull this off well, especially in the (computer) sciences with a lot of high technical intelligence and lower emotional intelligence floating around, and also especially semi-junior people trying to navigate through the research social hierarchy. Donât take it personally, folks! â©ïž
This might be one of the many reasons everyoneâs favorite stories of their times at conferences are going to bars in the evening. Alcohol lets us break out of these bizarre stalemates into new topics and conversational strategies. â©ïž
Plus, because ideas are so multi-dimensional, thereâs always the chance that you saw a similarity on a dimension that they didnât, and theyâll give you the benefit of that doubt. â©ïž