Category Archives: academia

Tim Hunt and Academic Freedom

If you listen to the mewling of elite scientists and the hand-wringing of the conservative media, academic freedom is once again under attack by the gangs of social-media-wielding PC conformity enforcers. This week’s victim is Nobel laureate Tim Hunt, following his comments about the dangers of mixed-sex scientific laboratories.

If you haven’t been following this story, here’s a brief timeline of events to catch you up:

  • 1943: Richard Timothy Hunt is born in the small town of Neston, located in Cheshire, England.
  • 1982: Hunt discovers the first cyclin molecule while studying the cell cycle of sea urchins
  • 2001: Hunt shares the Nobel Prize in Physiology or Medicine with Paul Nurse and Leland Hartwell for discovering the molecular mechanisms that control progression of the cell cycle (e.g., cyclins).
  • 2015: Hunt attends the World Conference of Science Journalists is Seoul, South Korea.
    • June 9: Hunt gives a speech to a lunch for female scientists and journalists, during which he says, “Let me tell you about my trouble with girls. Three things happen when they are in the lab. You fall in love with them, they fall in love with you, and when you criticize them, they cry”.
    • June 10: Hunt resigns from his position at University College London
    • June 13: Hunt said in an interview with the Guardian that he had been forced out without having an opportunity to defend himself or present his side
    • June 15: UCL issued a dubious statement, citing Hunt’s “personal decision to offer his resignation” and claiming that the media response had no influence on their decision to accept it

Since then, a number of prominent scientists have gone to the press to criticize UCL’s firing of Hunt (e.g., here, here, and here, all paywalled). The defenses of Hunt involve the typical overwrought rhetoric. For example, Andre Geim claimed that Hunt had been “crucified”, while Richard Dawkins referred to “the baying witch-hunt that it unleashed among our academic thought police”. (Aside to Dawkins: it is tacky to refer to a backlash against sexism as a witch hunt, for much the same reason that it is tacky to refer to a backlash against racism as a lynch mob.) But behind the rhetoric, there are basically two complaints. One, that UCL’s firing of Hunt was a disproportionate response, given the nature of the transgression, and two, that the response would have a “chilling effect” on academic speech.

I actually agree with the first point. It strikes me that a more appropriate response would be some combination of public shaming and sensitivity training. According to many of the people who have come forward to support Hunt, he is an intelligent, kind-hearted person. If that is true, then someone needs to make sure he understands how comments like this — even made as jokes — contribute to a culture of sexism, doing real, if indirect, harm to scientists and to science. (And if it’s true, he should be invested in learning this lesson.)

On the other hand, maybe this is just the most recent incident in a longstanding pattern of sexist behavior. If so, Hunt should absolutely be fired, as should every administrator who ignored that behavior up until June 9.

I suspect the truth is somewhere in the middle. Hunt jokingly refers to himself as a chauvinist, and many of the defenses have accused people of “not getting” his sense of humor. That suggests that he has probably been making mildly sexist, mildly harmful comments for decades, and the he has probably been approached about it many times in the past. In the manner of successful people of a certain age, he may have blithely disregarded that criticism, implicitly assuming that there was absolutely nothing he needed to change about his own behavior. If that’s right, maybe this will serve as a wake-up call — unless he gets seduced by the appeal of wallowing in his own victimhood.

No matter what the actual story is, though, UCL’s response was terrible, and would be galling if it were not so depressingly familiar. The fact is, this is the sort of scapegoating that institutions — including universities — do all the time. Despite UCL’s disingenuous protestations to the contrary, it seems clear that Hunt was fired not for sexist beliefs or behaviors or comments, but for embarrassing UCL. By firing Hunt, UCL is able to make a big show of standing up for equality, while avoiding doing the much harder work of addressing systematic sexism in science.

The formula is this:

  1. Let systematic unfairness persist, because addressing it involves effort and risks alienating powerful people who currently benefit from that unfairness
  2. If anything goes wrong, deny that there is a problem and cover things up
  3. If media attention makes strategy unsustainable, blame the individual, distancing your institution from them and disparaging them however possible
  4. Claim that the problem was “a few bad apples”, and now the institution is 100% cured
  5. Repeat

It’s the same formula for sexual harassment and scientific misconduct in universities, for insider trading and market manipulation in financial firms, and for fabrication of evidence and murder of civilians in police departments. The only somewhat surprising thing here was the speed with which UCL skipped from stage 1 to stage 3.

What is Academic Free Speech?

The issue of free expression is more complicated. As everyone should know by now, freedom of speech does not mean freedom from consequences. The fact that you have a right to say something does not mean that you have a right not to be criticized. And, even in the US, where free speech has explicit constitutional protection, you can be lose your job if you say something that causes embarrassment for your employer.

But for freedom of academic expression to be meaningful, it has to be subject to a higher level of protection. As an academic, your job is to seek truth and to share it. Your job must be protected if, in the course of your truth seeking, you say something that is embarrassing or distasteful to your department or university. Without that protection, any claims of academic freedom are hollow.  And it does not matter if we are talking about tenured professorships, or honorary appointments, like Hunt’s position at UCL. While these distinctions may affect the legality of firing someone for something they say, it doesn’t change the ethical considerations.

The question then becomes, What is academic speech? Is it any statement made by an academic? Any public statement? It can not be either of these, because then we would be providing protections not to a particular class of speech, but to a particular class of people — people who, by the way, already occupy a position of relative privilege. Instead, we need to limit these protections to speech that is intended as a contribution to academic discourse.

Were Tim Hunt’s comments academic speech, then? It depends. If, as some have suggested, these comments were “just a joke”,  then no. A joke that you make at a scientific conference is just regular speech. If you make an offensive joke at a conference, and you are punished for it, your academic speech has not been curtailed. If he was not being serious, then UCL does not owe him any special consideration.

On the other hand, we can interpret the comments as an articulation of the potential negative consequences of male-female dynamics in a laboratory setting. How the composition of a lab group affects the process and progress of science is certainly a legitimate subject of academic inquiry. We could say that Hunt has put forward the following hypothesis: Due to the complications that arise from romantic feelings, as well as systematic differences in the ways that men and women communicate, mixed-sex laboratories are less desirable than single-sex laboratories.

If we say no, you are not allowed to discuss or investigate that hypothesis, because challenges an inviolable assumption that men and women are equal, or even interchangeable, we would absolutely be constraining academic freedom. If we care about academic inquiry, we have to stand together and defend the right of Tim Hunt — or anyone else — to ask questions like this.

But . . .

If we agree to treat and defend Hunt’s statements as a form of academic speech, we also have to evaluate it as academic speech. The problem is, as academic speech, it is appalling — not because of its conclusions, but because of its profound lack of adherence to the most basic scholarly standards. This is a vague interpretation of anecdotal evidence, presented and interpreted in a vacuum that ignores any cultural context or consequences. Worse, from a purely academic perspective, it completely ignores any and all prior scholarship on the topic. If I got this in an undergraduate paper, I would probably give it a C+ — in the context of contemporary grade inflation.

To claim that mixed-sex labs are bad because you have had unpleasant (and perhaps inappropriate) interactions with women is not intellectually very different from claiming that global warming is not real because you were cold last winter.

It is 100% legitimate to ask about the consequences of having men and women working together in the same laboratory. But if you are going to ask about that, here are at least a few of the things you need to consider before you open your mouth.

  • What does the empirical data say about scientific productivity, or career success, as a function of the composition of males and females in a laboratory?
  • If we accept the assertion that women cry more. . . Is crying necessarily a bad thing? Is it because they respond more emotionally than men do to the same criticism, or is it because they receive harsher criticism? If women cry when you criticize them, why do you seem to assume that the women have a responsibility to toughen up, and not that you have a responsibility to be less abrasive?
  • Given that getting a good postdoc or faculty position depends substantially on connections and letters of recommendation, wouldn’t segregation perpetuate any historical inequalities?
  • If we accept the idea that men and women think and behave in systematically different ways . . . Does the benefit of avoiding the occasional uncomfortable situation outweigh the benefits of having a more diverse set of brains thinking about scientific questions?
  • How does your analysis change when you consider the fact that not all scientists are heterosexual?

I’m sure there are plenty more considerations. This isn’t my field, so I don’t really know what they all are. The point is, it’s not Tim Hunt’s field either. That does not mean that he could not make a legitimate contribution. After all, he seems to be a very intelligent person, and he has decades of personal experience in the laboratory setting. But if he legitimately wants to contribute to this discussion, he has a responsibility to think deeply about it, and to grapple with the decades of work by other very intelligent people who have thought deeply about it. If he is having trouble, a little time on Google Scholar or a stroll over to one of the many Sociology departments in London would set him on the right track.

I’ve never met Tim Hunt. I’ve met a few of the people who have defended him, but I don’t know any of them well. So, I’m not in a good position to judge what he is like as a person. However, the picture seems to be of a smart, decent human being who has done a lot of good. It would be a damn shame if the outcome of this was that he was excluded from science. It would also be a damn shame if the take-home lesson from this was that academic freedom is only safe if treat the ill-considered opinions of senior academics with a sort of breathless reverence.

Jerry Coyne sees a picture of my poster on twitter, is a dick

Last week I was in Raleigh, NC for Evolution 2014, this year’s edition of the annual joint meeting of the Society for the Study of Evolution, the Society of Systematic Biology, and the American Society of Naturalists. I brought a poster that presented some work I’ve been doing on how noise (e.g., environmental fluctuation) can select for epistasis (non-linear interactions among different genes). On Monday evening, when I was hanging out by my poster, someone showed me that my Acknowledgements section had made it to twitter:

Screen Shot 2014-06-29 at 7.52.48 PMNow, this is what you might call an underdetermined tweet. Not knowing Alex, I was not sure what the intent was. Was this a sanctimonious evolutionary biologist expressing outrage about the fact that I had funding from the Templeton Foundation, which is viewed skeptically by many biologists because of its interest in religious topics? Or was it someone who thought it was unacceptable to include jokes in your acknowledgement section?

Fortunately, it turns out to be the only answer that won’t make you lose faith in humanity: it was someone being ironic. Alex Stewart is a postdoc working with Josh Plotkin at U Penn. Last year Alex and Josh published a paper in the Proceedings of the National Academy of Sciences, and in their acknowledgements section they thanked a number of funding sources, including the “Foundational Questions in Evolutionary Biology Fund”.

Through some mechanism that appears to be named “Todd”, this paper was brought to the attention of Jerry Coyne, evolutionary biologist at U Chicago and blogger at Why Evolution is True.  Along with people like PZ Myers and Richard Dawkins, Coyne is a prominent and vocal critic of Intelligent Design and of the efforts by religious groups to undermine the teaching and study of evolution.

So why did Coyne care about this paper? Because apparently, if you look into the Foundational Questions in Evolutionary Biology Fund, it is a big pot of money at Harvard Univeristy, which was put there by the John Templeton Foundation. Coyne gets mad whenever anyone has anything to do with Templeton. And, in this case, he professed outrage over the fact that they had “disguised” their funding source.

Now, I’m guessing that when Coyne saw Alex’s picture, he did not notice or recognize the name, as he seems to have read the comment as straight-up, unironic outrage, and he jumped on the bandwagon with his own short post, summed up by his comment, “Unacceptable indeed!” He goes on:

Okay, who are these miscreants?

The good news is that scientists clearly recognize the woo-ish nature of Templeton, as well as its nefarious mission to pollute science with religion. (Note, though that, contra the slide, Templeton has disavowed all forms of creationism, including intelligent design.)

The bad news is that four collaborators on this project took Templeton money anyway.

This is pretty awesome. I don’t think I’ve ever been called a miscreant before.

The rest of this is sort of weird, though. I think it is fair to say that the scientists recognize the fact that Templeton is perceived as “woo-ish” by many in the evolutionary biology community. However, most of their funding these days, including this grant, is pretty much straight-up science. Also, if you read the acknowledgements, which state that the work is not creationist, and then read Coyne’s comment, it makes you wonder if he knows what contra means.

That is, the point here is not to say, “This is not creationism, unlike most of what Templeton funds”. The point is to say, “This is not creationism, despite what you might wrongly assume about what Templeton funds.”

Most of the comments go back and forth on the issues you’d expect, so I’ll limit myself to Coyne’s. His first is this:

Would you take money from the Council of Conservative Citizens (a segregationist organization), or the Tea Party to do pure science? How about the Nazi Party? Is there no organization so nefarious that you wouldn’t take their money?

Really, people take it not to further the science, but to further their careers, because you need funding to get tenure, promotions, and so on.

I do fault those who take Templeton money, for they’re lending their imprimatur to an organization whose aim is the corruption of science. That’s precisely why Templeton funds “pure” science–to give them cover for their investigations of “spirituality and science”–the so-called “Big Questions.”

That’s some classic straw-man bullshit right there, although you have to give him credit for going full Godwin in his first comment, thereby saving his community the embarrassment of being the first to bring up a bogus Nazi analogy. That’s leadership!

And while I can be (and have been) accused of many things, compromising my principles to get tenure may be the least valid.

As for my imprimatur, I can’t lend it to Templeton, because back when I was in Santa Fe, I loaned it to Jeremy Van Cleve, and he never returned it!

And how do you take money from an organization like that without compromising “all principles”? The same way you take money from The Council of Conservative Citizens without compromising all principles?

The fact is that you’ve compromised principles simply by taking the money.

First off, again, the analogy with segregationist or racist organizations (which, to the best of my knowledge, are not major sources of science funding anyway), is ridiculous and seems disingenuous. Or maybe Jerry Coyne honestly believes that Templeton is a force for evil on the level of The Council of Conservative Citizens or the Nazi Party, but I think that’s a position that would be hard to find much support for, even among evolutionary biologists.

So we’re left with what, a slippery slope argument, maybe? Or a one-drop argument?  There’s two problems with that. First, whether or not you let your scientific conclusions be influenced by your funder’s (perceived) agenda is up to you. If you’re an honest scientist, you do your work and say what you believe to be true. If some agency or foundation won’t fund you in the future because they don’t like what you said, so be it.

Second, the same argument applies to all sources of funding. For example, the funding structure at NIH strongly rewards confirmation bias and the overinterpretation of marginally significant statistics. As a consequence, the biomedical literature is riddled with unreproducible results. The funding, hiring, and promotion structures in academia have done far more to corrupt science than even the bogeyman version of Templeton that inhabits Jerry Coyne’s mind.

Maybe the intent [of the acknowledgement] is a bit nebulous, but it’s factually incorrect (Templeton doesn’t fund crea[ti]onism or ID any longer), and unprofessional as well. If you’re going to take money from someone, you don’t diss them in public. I bet if Templeton found out about this (I won’t tell them!) they wouldn’t give any more $$.

I love this last one, as it concisely captures the angry incoherence of the argument. First, it accuses me (inaccurately) of claiming that Templeton funds creationism. Second, it accuses me (inaccurately) of dissing them. Third, it suggests that if Templeton found out they had been dissed (which they weren’t), they would spitefully refuse funding in the future (which they probably wouldn’t).

Note that the overarching theme here is that I am bad and foolish, but for contradictory reasons:

I’m bad for taking money from an organization with an alleged religious agenda. But look! I’m foolish, because they have actually renounced that agenda! Gotcha!

I’m bad for taking money from an organization with an agenda, because I will constrain what I say, for fear of losing future funding. But look! I’m foolish, because I did not constrain what I said! Gotcha!

So, if I may build on Coyne’s Nazi analogy, the morality being proposed seems to be something like this: Jerry Coyne would never take money from the Nazi Party, but if he did, he would never publicly criticize the Nazis!

But, to be fair, these comments were probably never meant to support such a close reading. A more accurate characterization might be that Coyne starts from the ideological position that no one should ever take money from Templeton. As someone who has received funding from Templeton, I am therefore someone who is bad and foolish. Starting from this “bad and foolish” conclusion, Coyne works backwards, using whatever evidence and arguments will get him from my poster to that conclusion. This includes misinterpreting my statement (through disingenuousness, carelessness, or a combination of the two) as well as employing arguments that seem logically inconsistent.

Or maybe this is a Colbert-like performance piece, where he takes on the persona of “Jerry Coyne” to illustrate how dogmatically espousing an ideology corrupts the reasoning process. If that’s the case, my hat is off to you, Professor Coyne! Well played!

Hauser Report Confirms What Everyone Already Thought

Last Friday, the Boston Globe brought us an update on everyone’s favorite data-falsifying former Harvard psychology professor, the man who put the a** in a**ertainment bias, Marc Hauser. The story summarizes a report prepared by Harvard and submitted to the Office of Research Integrity back in 2010, and which the Globe got hold of via a FOIA request. You can look at the 85-page report for yourself, if you like that sort of thing.

The basic story is that Hauser was not fabricating data the way one might fabricate results to show a connection between vaccination and autism when no such connection exists. Instead, he repeatedly made small tweaks to data in order to push the results towards his preferred conclusion. And then, also repeatedly, when someone would raise a question, he would be sort of a dick about it. One example from the Globe’s story:

In a second, related experiment, a collaborator asked to be walked through the analysis because he or she had obtained very different results when analyzing the raw data. Hauser sent back a spreadsheet that he said was simply a reformatted version, but then his collaborator made a spreadsheet highlighting which values had apparently been altered.

Hauser then wrote an e-mail suggesting the entire experiment needed to be recoded from scratch. “Well, at this point I give up. There have been so many errors, I don’t know what to say. . . . I have never seen so many errors, and this is really disappointing,” he wrote.

In defending himself during the investigation, Hauser quoted from that e-mail, suggesting it was evidence that he was not trying to alter data.

The committee disagreed.

“These may not be the words of someone trying to alter data, but they could certainly be the words of someone who had previously altered data: having been confronted with a red highlighted spreadsheet showing previous alterations, it made more sense to proclaim disappointment about ‘errors’ and suggest recoding everything than, for example, sitting down to compare data sets to see how the ‘errors’ occurred,” the report states.

Ah, yes, the old “mistakes were made” gambit.

The 2010 report was the culmination of a three-year investigation into Hauser’s lab. Hauser was suspended from teaching, and then resigned from Harvard in 2011. He currently devotes his time to working with at-risk youth on Cape Cod. The youths are presumably at risk of not having their papers published in high-impact journals, due to the fact that their results are not statistically significant when accurately reported.

On Schekman’s Call to Boycott the “Luxury” Science Journals

So, over at the Ronin Blog, I have posted my thoughts on the column written by new Nobel Laureate Randy Schekman where he urges all of us to boycott the journals Science, Nature, and Cell.

The basic argument is that the core problem is not these journals, but the use of publication in these journals (and other, equally superficial metrics) as proxies for quality.

Read it. Read It! READ IT!

Five Reasons Biologists Should Use Preprint Servers

So, following my previous post, I got some interesting feedback from a couple of biologists who were not completely sold on the idea of posting preprints of your work to the arXiv (or, now, the bioRxiv). Or, rather, they were not convinced that the cost-benefit calculus worked out in favor of posting. After all, as one person pointed out, there are already a bunch of hoops to jump through on the way to publication, what with formatting, revising, angrily cursing reviewer number 2, reformatting, resubmitting, and whatnot. What does posting to a preprint server do for you, beyond adding another step?

Well, it occurs to me that this is probably a question shared by a lot of biologists out there, so I thought I would share the reasons I’ve come up with.

  1. Open Access. You want your work to be available to the widest possible audience, right? When some enthusiastic young researcher is searching the literature, and they stumble across your seminal work on tribble parthenogenesis, you don’t want them getting Spock-blocked by some crappy paywall. Sure, maybe their University has an overpriced subscription to the obscure journal you published in, but maybe it doesn’t. Or maybe it’s a pain for them to access it via the proxy server when they’re off campus. Or maybe this young researcher doesn’t have access because he and/or she is an independent scholar, because they’re actually too smart and creative to work for The Man. Maybe they’ll just scroll down the search results page until they find another paper by your grad-school nemesis — the one who never chipped in his fair share for pizza — and you’ve lost another citation. Don’t let this happen to you! Make sure that your work is freely, and easily, accessible to everyone everywhere.
  2. Speed. You’ve finished your research, you’ve blindly written down the p-value that the software you downloaded from the internet spit out — er, I mean, “double-checked the statistics”, and you’ve written a beautiful discussion section that skillfully implies that your results are going to revolutionize not only your own field, but any field whose scientists have sufficient foresight to follow in your footsteps. But now you have to wait for six months or a year, or maybe longer, before your paper appears in print, and, of course, by that time, even you will have moved on to more interesting problems. If you post to a preprint server, though, your work is available immediately. And, if you make revisions in response to reviewer comments, you can post the revised version there, too. Some journals (e.g., Evolution) will even let you post the final, published, journal-formatted PDF to the preprint server after some time (12 months following publication for Evolution). So, the fact that you’re getting your work out there early does not mean that you’re committing to something less than the final version.
  3. Normalization. At this point, most biology journals are okay with authors posting their manuscripts to preprint servers, but some still are not. Not to name names (*cough* Elsevier *cough*), but some publishers would still like to hold on to an outdated publishing model where they can earn obscene profits through ownership of a product to which they contribute little to no value. The more biologists publish preprints — and commit to publishing only in journals that permit prepublication — the more pressure it places on publishers to stop rent-seeking. Basically, it is a really easy way to nudge the world of academic publishing in the direction of justice. Or, you know, if you prefer, you can keep feeding those paywall parasites like the rest of your Vichy scientist colleagues. No judgment here.
  4. Feedback. When you’re desperately worried about getting out publications so that you can get your degree, or get tenure, or whatever, it is easy to forget the real purpose of peer review. In an ideal world, peer review means that experts in your field look closely at your work and help you to make it better. By posting a preprint, you are able to get comments from the entire community — at an early enough stage that those comments might actually help you to improve the paper before it fossilizes.
  5. The Left Side of History. Look, the fact is, this is the direction that everything is moving. And you need to ask yourself, years from now, do you want to be the stodgy, old, out-of-touch professor who doesn’t post preprints, and who has to get their grad students to help set their powerpoint presentation to full-screen mode? Or do you want to be the super-cool hipster prof, who could say things like, “I’ve been posting on bioRxiv since you were in diapers”, but who would never actually say that, because it would make you sound like a total dickhead? At future Thanksgiving dinners, do you want to be your field’s Liz Cheney, or its Mary Cheney?*

* Answer: You want to be your field’s Lon Chaney.

Enter the bioRxiv

So, if you are a Physicist, or if you know a Physicist and are very patient, you’ve heard all about the arXiv, the preprint server that kicked off the open-access publication movement. If not, here’s what you need to know. The idea is that when you write up a paper, you post it online, where it becomes immediately and freely available to the world. If you revise, you can post the revised paper. And, even if you go on to publish the work traditionally, there will be a version out there that is not behind some journal’s paywall.

Most arXiv users do, in fact, go on to publish their work in traditional, peer-reviewed journals. But by posting to the arXiv first, you get your work out quickly. If you’re a naive idealist, this lubricates the flow and speeds the creation of knowledge. If you’re a paranoid careerist, it allows you to date-stamp your ideas to guard against being scooped.

While the arXiv has a “Quantitative Biology” section, preprint culture has never really taken hold in the Biology community the way it has in Physics. But here’s something that will maybe help to push things in the right direction: bioRxiv, Biology’s very own preprint server! The server features twenty-four sub-fields of Biology, and, as of this writing, Evolutionary Biology is WINNING with eight posted manuscripts.

If you’re worried about whether posting a preprint of your manuscript might interfere with your ability to publish in a traditional journal:

  1. Grow a pair of non-gender-specific gonads!
  2. Look into the pre-publication policies of various publishers here. (And, if you’re planning to publish somewhere that prohibits preprints, rethink your priorities, you collaborator!)

Now get to posting!

Student Loans Driven by Professor Salaries? Bullshit.

So, over at the Jubilee Now blog, there’s a new post that calls bullshit on the idea that skyrocketing college tuitions and student loans are driven by (the completely understandable and unavoidable) rise in faculty salaries.

Of course, there is a much more straightforward connection between tuition and the availability of student loans. The post includes a nice explanatory analogy:

You don’t need a smoking gun to understand the relationship between access to loans and rising tuition prices. It’s not necessary to prove that colleges made the decision to raise tuition because they knew students could just take out loans. You can see it all right there in the market incentives. It goes back to the concept of “third-party payments”  – that is, that if there’s a third party involved a transaction, someone other than the buyer and the seller, it’s going to skew the incentives influencing both.

To see how, let’s do a what-if. Imagine you took an 18-year-old into a grocery store and said, “Okay, you have to decide right now what food to buy for the next four years. Now keep in mind that without food, you’ll die. And that the best food, though it may be expensive, will keep you the healthiest in the long run. If you’re super-healthy, you’ll be successful and paying off the cost of the food will be easy.  Here’s a big bucket of money. Now, what do you want to buy?”

What do you think this would do to the cost of food? Do you think stores would rush to stock rice and beans so as to efficiently meet the demand for healthy food? Or would we see a proliferation of gently braised filet of farm-coddled salmon, garnished with an aggression of hand-picked asparagus and a frisson of Himalayan fennel?

An aggression of hand-picked asparagus, indeed! Preach it!

At the Ronin Blog: An Outsider’s Theory of Everything

So, there’s been some buzz in the news the past few days about Eric Weinstein, a non-academic, who presented a lecture at Oxford on a mathematical theory that he has been working on for years. The theory aims to provide a “grand unification” for physics. The lecture and press coverage surrounding it have already received some negative reactions from academic scientists and science writers. Over at the Ronin Blog, I’ve tried to break down and evaluate those criticisms.

Basketball, Fraud, and the Broken University Incentive System

So, in 2005, Nature published a study by a group of researchers at Rutgers University showing that Jamaican teenagers who exhibited a high degree of body symmetry were judged (by other teenagers) to be better dancers than those with less symmetrical bodies. The study was an exploration of the idea that physical symmetry might be a trait subject to sexual selection — with “good dancers” serving as a proxy for “attractive mates.”

In 2013, Rutgers basketball coach Mike Rice received a $475,000 severance after video footage surfaced showing Rice pelting his players with basketballs, grabbing and shoving them, and shouting obscenities at them.

What do these two stories have in common? The stories reveal how Universities are not motivated by their stated missions (truth, education, etc.), so much as by a drive for money and prestige. As a friend of mine recently put it, “Pursuing truth is great, just don’t let it get in the way of your careerism.”

Now, you may be wondering how you can get a job at a University where you get to abuse students, and if you get caught and fired, you still walk away with nearly half a million dollars. I mean, you probably thought you could only get a job like that in an S & M dungeon, or maybe the CIA.

Here’s what pisses me off about the whole thing. Rice did not lose his job for abusing his players. He lost his job for embarrassing the University. When the video first surfaced, everything was handled in house. Rice was given a three-game suspension and a $50,000 fine — secretly. Then, when the video showed up on line, he was fired, along with an assistant coach and the athletic director (who received a $1.25 million severance package). (Here‘s one version)

Some players have argued that Rice’s behavior was not as bad as it appears on the video, and David Plotz argued in Slate that this type of behavior from his own high-school coach made him “a better player and a better man.” Maybe they’re right. Maybe we would all be better off if we were berated regularly for our shortcomings. There’s a balance in there somewhere between “preventing bullying” and raising a generation of hothouse flowers, and I’m not always convinced that we, as a society don’t veer too far in the direction of kid gloves.

The point is, you can imagine defending having a coach like Mike Rice. Likewise, you can imagine arguing that behavior like Rice’s is absolutely unacceptable in a University setting. What is bullshit is internally saying, yes, Mike Rice is great, he just needs to tone it down a notch, and then, when the public finds out, being all, “Oh my god! I can’t believe this was happening!” Basically, the sense you get is that no one was interested in figuring out what the right thing to do was. Everyone was motivated by protecting their own careers, and deflecting embarrassment away from the University.

So how does this relate to dancing teenagers in Jamaica?

The 2005 paper had seven co-authors, but the three key players are Robert Trivers and Lee Cronk, both from the Rutgers Anthropology Department, and William Brown (a postdoc at the time, now in the Psych department at University of Bedfordshire).

A couple of years after the paper came out, Trivers started to suspect that Brown had manipulated the data to make the results more compelling than they actually were. He went on to detail his analysis in a book published in 2009.

So what happens when one of the authors of a high profile paper comes out and claims that the results presented in the paper were not just wrong, but fraudulent? A news piece just out at Nature notes that Trivers approached Nature in 2008 about retracting the paper, but they were not interested. After all, why would they be? Nature’s business plan hinges on publishing studies that are exciting — studies that will be cited by a lot of other papers, and that will attract a lot of attention from the popular press.

This means that Nature (and other high-impact journals like Science) are particularly prone to a few types of bad papers. One is the shocking result that would lead to a major paradigm shift if it were true — but it is not true. One is the paper that seems to represent a huge advance, but is a modest advance that seems bigger than it is because it fails to cite much of the relevant literature. And one is the type we’re potentially talking about here, where a paper presents some really beautiful results, which are beautiful because the data has been manipulated in some way.

The problem is that this business model works great. The upsides of citations and press coverage apparently far outweigh the downsides of publishing incorrect, or incorrectly presented results. In general, there is not that much effort that goes into replicating results in science (arguably, a lot less than there should be). And even if a study fails to be replicated, and is shown to have been wrong, this typically happens years later, when no one is paying attention to the original study anymore.

That means that Nature and Science tend to have this funny status. In biology, anyway, everyone dismisses them as “magazines” or “tabloids.” At the same time, everyone is desperate to publish there.

DarwinEatsCake0085

 

So what do you do if you’re one of these journals? Well, if you are driven by a moral principle of promoting truth and spreading the best information possible, you put more effort into vetting papers up front, and when a paper is shown to be wrong, you actively try to correct the misperceptions stemming from the fact that people are saying, “Well, this was published in Nature, so it must be right.” On the other hand, if you are driven by the financial health of your corporation, you continue to publish things that will attract attention, and you retract or correct only when you absolutely have to, and you do it as quietly as possible, so as not to harm your brand.

Similarly, what do you do if you are a University associated with publishing a fraudulent paper? Again, if your guiding principles are truth and honest scholarship . . . oh, who am I kidding, those have not been the guiding principles of Universities for decades. As a University, your guiding principle is to maximize your money and prestige (to the extent that prestige begets money). That means that you will promote truth to the extent that you are required to do so, in order to maintain your brand as an important “research” and “education” institution. But what you really want is to keep the accusations of fraud as quiet as possible.

According to Trivers’s account of events, his going public with his book detailing the case for fraud, Rutgers was forced to undertake an investigation, since the work was supported in part by a grant from the NSF. Had they failed to do so, they might have become ineligible for NSF funds. When they completed their investigation in 2012, the University refused to make the results public. Trivers has posted the report on his own site (here). In brief, the report says that, yes, there is evidence for fraud in the paper (although the Nature news piece notes that Brown still denies having manipulated the data).

There’s another part of the story, though, that is much more disturbing. Trivers tells of an incident where he went to confront co-author Lee Cronk in his office about the situation. Trivers felt that Cronk had backed Brown’s version of events, and that the Rutgers report had vindicated his position over theirs, and he called Cronk a “punk.” Cronk then reported the incident to the campus police, and Trivers wound up getting banned from campus for alleged violation of the University’s anti-violence policy.

Now, clearly, I was not there, and so I have no independent source of knowledge about what happened that day. However, the version of event related by Trivers (read the whole thing here), sounds completely consistent with my own interactions with him. His version of the story suggests motivations and actions on the part of others:

It suggests that Cronk overreacted / acted punitively when Trivers confronted him. Maybe he was embarrassed and angry, and pretended to have felt physically threatened by Trivers in order to get back at him. Maybe he really did feel physically threatened, because, maybe, like most academics, he’s sort of a wuss. Maybe he overreacted in the heat of the moment, later wishing that he had not gotten the police involved. I don’t know. I’ve never met him, but this does pass the sniff test as the type of thing I can imagine a lot of Professor types doing.

It suggests that Rutgers sided against Trivers in the incident, perhaps out of retaliation for his original whistleblowing about the paper and the embarrassment and financial cost his actions imposed on the University. After all, if he had kept his mouth shut, they would not have had to undertake the whole fraud investigation, which I’m sure cost a bundle, and they would not have had the embarrassment of national press coverage. Again, clearly, I have no privileged details here, but this sounds like something you would do if you were a University that

I don’t want to pick on Rutgers in particular here. I think that this is the course of action that would have been taken by any University. That does not make it right, though.

I also don’t want to pick on Brown and Cronk, both of whom I suspect are perfectly bright and competent researchers. Even if Brown did actively manipulate the data, I see that as a pathology of the system, where getting a Nature paper can mean the difference between getting a job and not getting a job. If we didn’t hand out jobs and funding and promotions based on numbers of publications and citations — but rather on the quality and rigor of people’s research — there would not be incentives to manipulate or fabricate data. Even if Cronk maliciously got the Rutgers police to ban Trivers from campus, he did so in the context of a system that almost never rewards standing up and saying, “You know what, I was wrong.”

I know a lot of great scientists, people who are their own harshest critics, who are reluctant to publish results until they are 100% certain, who view even critical reviews of their manuscripts as good opportunities to make their work better. I also know a lot of scientists who are happy to cut corners, exaggerate the significance and importance of their results, and promote themselves, even, sometimes, at the expense of the truth.

Unfortunately, the way the current incentive system works, the latter group tend to have much better jobs than the former.

Until we can fix that, everything is going to conspire to encourage researchers to exaggerate, manipulate, and even fabricate their data. And everything is going to conspire to discourage Universities and journals from addressing and correcting fraudulent and erroneous results.

We have to reward honest, serious work that is not necessarily flashy. And we have to reward people who are willing to admit and correct mistakes.

Most of all, we have to reassert the principle of “truth” as our highest value in academia, and fight against its erosion by the secondary values of fame, prestige, and, most importantly, funding.

––––––––––––––––––––––––

Disclosure statements.

Since 2011, I have had an unpaid adjunct / visiting scholar position at Rutgers in the Genetics Department. During that time, I have gotten to know Trivers a bit, and we, in fact, have plans to work on a project together. In my experience, he is brilliant, boisterous, foul-mouthed, politically incorrect, and honest to a fault — exactly the sort of person all academics should aspire to be. Unfortunately, in their current incarnation, Universities much favor mediocre minds and personalities who will toe the corporate line, and who will bring funding to the University without inconvenient things like “truth” get in the way.

In elementary school, I was once on the losing side of a full-length, YMCA-league basketball game that ended 6 to 5. In junior high, I once attended a week-long basketball camp at the end of which I received the Orwellian “Most Improved Player” award.

E. O. Wilson is Wrong Again — not About Math, but About Collaboration

So, stop me if you’ve heard this one.

Q: What’s the difference between E. O. Wilson and a stopped clock?

A: A stopped clock does not have unlimited access to a national media platform to push its ridiculous ideas on the public.

Bazinga!

A couple of weeks ago, E. O. Wilson published a piece in the Wall Street Journal, where he argued that you don’t need math to be a great scientist. There are two parts of the argument. First, that science is more about conceptual thinking that does not require mathematical formalism to get at great ideas. Second, that when it comes time to mathematize, you can always find a mathematician to collaborate with.

He has already been taken to task in places like Slate and Huffington Post. The criticism in these pieces and most of the grumbling I’ve heard around the internet has been something along the lines of, “Nuh uh! Math is too important!” More specifically, that the era of math-free scientific discovery is over. That to operate at the frontier of science in the twenty-first century, you have to be able to grapple with the mathematical and statistical concepts required in the days of big data.

There’s something to that.

On the other hand, I’m sympathetic to what Wilson is trying to do here. I would hate to see anyone drop out of science because they don’t feel that they can keep up with the math. Of course, that’s partly because I think most people can do more math than they think they can, if you know what I mean.

But what I want to focus on here is Wilson’s view of collaboration. This, even more than math, is going to be the must-have talent of the twenty-first-century scientist. The thing about science is, an awful lot of it has been done. To get to the frontiers of human knowledge requires years of study, and, for those of us without super powers, a lot of specialization. At the same time, the most interesting and important problems often lie between areas of specialization, and require contributions from more than one area. Those most interesting and important problems are going to be solved by teams and networks of people who bring different skills to the table, and who are able to integrate their skills in a way that leads to a whole that is greater than the sum of the parts.

It’s that integration bit, I think, that Wilson does not really get. Wilson’s view of collaboration seems to go something like this: you make some observations about some biology, come up with some ideas, then you go find someone who can translate those into the language of mathematics.

Here’s the thing about translation, though. It can’t be unidirectional, or rather, it shouldn’t be unidirectional. At the risk of something or other (obscurity? pretentiousness?), I’m going to dip into poetry here. Robert Haas (Poet, Berkeley Professor, and Occupy hero), in addition to writing a bunch of his own extraordinary verse, has translated seven volumes of poetry by Czech Nobel laureate Czesław Miłosz. Or, more accurately, he collaborated with Miłosz to produce those translations.

After Miłosz’s death, Haas included their translation of Czesław Miłosz’s poem “O!” in his own volume Time and Materials. The poem is prefaced with this note about the translation process:

In his last years, when he had moved back to Kraków, we worked on the translation of his poems by e-mail and phone. Around the time of his ninetieth birthday, he sent me a set of poems entitled “Oh!” I wrote to ask him if he meant “Oh!” or “O!” and he asked me what the difference was and said that perhaps we should talk on the phone. On the phone I explained that “Oh!” was a long breath of wonder, that the equivalent was, possibly, “Wow!” and that “O!” was a caught breath of surprise, more like “Huh!” and he said, after a pause, “O! for sure.”  Here are the translations we made:

Now, if you’re not a writer and/or avid reader of poetry, it may seem strange to fuss over the difference between “Oh!” and “O!” But worrying about the difference between “Oh!” and “O!” is precisely the sort of thing that differentiates poetry from other forms of writing. Robert Frost famously defined poetry as “what gets lost in translation.” One way to unpack that statement is to say that translation can typically capture the basic meaning of words and phrases, but the part of writing that is poetry is the part that goes beyond that basic meaning. Poetry is about subtle differences in meaning. It is about connotation and cultural resonance. It is about the sounds that words make and the emotional responses that they trigger in someone who has encountered that word thousands of times before, in a wide variety of contexts.

These things almost never have simple one-to-one correspondences from one language to another. That means that a good translation of poetry requires a back-and-forth process. If you have a translator who is truly fluent in both languages — linguistically and culturally — this back-and-forth can happen within the brain of the translator. But, if your translation involves two people, who each bring their expertise from one side of the translation, they have to get on the phone every so often to discuss things like the difference between “O!” and “Oh!”

Doing mathematical or theoretical biology is exactly like this.

The theories and observations that build up in the biological domain exist in a language that is profoundly different from the language of mathematics. For theory in biology to be both accurate and relevant, it has to stay true to both of these languages. That means there has to be a vibrant, even obsessive, back-and-forth between the biological observations and concepts and the mathematical representations that attempt to capture and formalize them.

As in the poetry case, if you, as an individual scientist, have a deep understanding of the biology and a fluency in the relevant mathematics, that back-and-forth can happen in your own brain. Where E. O. WIlson is right is in his assertion that, if you don’t have the math, you can still make a contribution, by focusing on building your deep understanding of the biology, and then by finding yourself a mathematician you can collaborate with.

But there’s a trick.

If you’re going to follow this route, you have to sit down with your mathematician, and you have to walk through every single equation. You have to press them on what it means, and you have to follow the thread of what it implies. If you’re the mathematician, you have to sit down with your biologist and say, “If we assume A, B, and C, then mathematically that implies X, Y, and Z.” You have to understand where, in the biology, A, B, and C come from, and you have to work together to discover whether or not X, Y, and Z make any sense.

Basically, each of you has to develop some fluency in the other’s language, at least within the narrow domain covered by the collaboration. If you’re not willing to put in this level of work, then yes, you should probably consider a different career.

Now, maybe you think I’m being unfair to Wilson here. After all, he doesn’t explicitly say that you should hand your ideas over to the mathematicians and walk away. And obviously, I don’t have any privileged access to the inner workings of Wilson’s brain or the nature of his collaborations.

But let’s go back to a couple of years ago, when he collaborated with Martin Nowak and Corina Tarnita to write a controversial paper in which they argued that modeling the evolution of social behaviors based on “kin selection” was fundamentally flawed. That paper elicited a response from the community that is rare: multiple responses criticizing the paper on multiple fronts, including one letter (nominally) co-authored by nearly 150 evolutionary biologists.

I won’t go into the details here, as I have written about the paper and the responses multiple times in the past (here and here, in particular, or you can just watch my video synopsis of the criticism here).

Briefly, the controversial article (published in Nature, arguably the most prestigious journal for evolutionary biologists), completely misinterprets, misrepresents, and/or ignores the work done by other people in the field. It’s a little bit like if you published a physics paper where you said, “But what if the speed of light is constant in different frames of reference? No one has ever thought of that, so all of physics is wrong!” That’s an exaggeration, of course, but the flaws in Wilson’s paper are of this general type.

The weird thing about the paper is that it includes an extensive supplement, which cites much of the literature that is disregarded by the main text of the paper. It is exactly the sort of error that happens when you have something that is written by a disconnected committee, where the right hand does no know what the left hand is doing. Basically, it is hard to imagine a scenario in which someone could actually have understood the papers that are cited and discussed in the supplementary materials, and then turned around and, in good faith, have written that paper.

That leaves us with a few possible explanations. It could be that the authors were just not smart enough to understand what they were talking about. Or it could be that they deliberately misrepresented prior work to make their own work seem more original and important. For the purposes of our discussion here, let’s assume that neither of these explanations is accurate.

Instead, let’s assume that everyone involves is fundamentally competent, and was acting in good faith. In that case, perhaps the problem came from a failure of collaboration. E. O. Wilson probably knows more than just about anyone else in the world about the biology underlying the evolution of social behavior — especially among eusocial insects. Martin Nowak is a prominent and prolific mathematical biologist. Corina Tarnita was a postdoc at the time, with a background primarily in mathematics.

Wilson, as he acknowledges, lacks the mathematical skills required to really understand what the models of kin selection do and do not assume and imply. Tarnita, I imagine, has these skills, but as a young researcher coming out of math, perhaps lacked the biological knowledge and the perspective on the field to understand how the math related to the prior literature and the state of the field. Nowak, in principle, had both the mathematical skills and the biological experience to bridge this gap. He’s a curious case, though, as he, rather famously in the field, is interested in building and solving models, and has little interest in what has been done by other people, or in chasing down the caveats and nuanced implications of his work.

Among the three of them, Wison, Nowak, and Tarnita have all of the skills and knowledge required to write an accurate analysis of models of kin selection. But if assembling the requisite skills was all that was necessary, that Nature paper would have been very different — in much the same way that you could dump a pile of gears, shafts, and pistons in my driveway, and I could drive away in a Camaro.

The challenge of interdisciplinary collaboration is to combine your various skills in a way that creates something greater than the sum of the parts. If you can master this, you’ll be able to make great contributions to whatever field you apply your skills and interests to.

In the case of Wilson’s disastrous paper, what we got was a situation where the deficits that each of the researchers brought to the table combined to create something greater than the sum of the parts. Sadly, I get the feeling that Wilson does not understand this difference, that he thinks collaborating with mathematicians means explaining your intuition, and then waiting for them to “prove” them.

So, yes, you can be a great scientist in the twenty-first century, even if you don’t have great mathematical skills yourself. But, just as Robert Haas called up Czesław Miłosz on the phone to discuss the difference between “O!” and “Oh!” maybe you’re going to have to call up your mathematician collaborators to talk about the difference between O(x) and o(x). You don’t necessarily have to understand the difference in general, but you do need to understand the difference and its implications in the context of the system you’re studying, otherwise you’re not really doing science at all.