Friday, August 04, 2017
Meiosis kills! (Now in print, and video)
Thursday, November 17, 2016
How not to respond to unhelpful peer reviewers
There are a great many ways in which that ideal can fail. I draw a great deal of schadenfreude from reading Retraction Watch, which is effectively a blog about cases where peer review failed in one of many ways, something was published, and mistakes or misdeed were later found out. I, like most scientists, know a few people whose work may show up all over Retraction Watch some day.
Which brings me to the fact that I am currently figuring out how to respond to a review that has failed with regards to independence, expertise, detail, fact, specificity and constructiveness. I would have suggested to the journal that this person could not be an independent reviewer, except that it never occurred to me that anyone would consider him to know anything about the topic of the paper. Explaining the long history of this interaction to the journal, we have now been assured that our re-submission would be sent out to different reviewers. Even so, in resubmitting, I have to respond to all the reviewer's comments, even those that are wildly counterfactual, have nothing to do with the current manuscript, or are just complaints about the reviewer's own work not being cited more extensively. And it has to be done politely and factually. So one must never include responses like these:
- This highlights a fundamental difference in approach to science. Reviewer's comment, and publications, suggest that scientific papers should be fishing expeditions in which everything that can be gotten out of a data set is analyzed and those results that test significant published breathlessly. We started with one, a priori original question, gathered all of the available data to address it, and got a clear result, which we state concisely. While some authors would stretch the results section out to numerous exploratory paragraphs, expounding upon questions that were tailored to fit the results of the numerous analyses, that would surely be a disservice to science.
- It is not clear what this means. Perhaps the reviewer did not find our Methods section. It is in there between the Introduction and the Results.
- It does not seem that the Reviewer has any idea what kind of data we are using, despite the six paragraphs on the topic.
- Furthermore, a reading of the manuscript would have revealed that no matrix models are employed. Reviewer's comments would seem to be hastily copied and pasted from review of an unrelated paper.
- The Reviewer's publications are not relevant or useful here. Perhaps they were relevant to the paper for which most of this review was written?
- This is counterfactual and the Reviewer has excellent reason to know that.
- These quotes of the journal's rules are from an entirely different journal that the Reviewer often reviews for.
- Not only can we find no mention of this statistical rule anywhere, we note that Reviewer's own papers don't follow it. We asked an expert in these methods about this 'rule.' She called it, "hilariously made up."
Wednesday, November 16, 2016
Ghosts of papers that may some day be
Friday, June 12, 2015
Back to posting: Seastar Video
Olsen, T. B., Christensen, F. E. G., Lundgreen, K., Dunn, P. H., & Levitis, D. A. (2015). Coelomic Transport and Clearance of Durable Foreign Bodies by Starfish (Asterias rubens). The Biological Bulletin, 228(2), 156-162.
If you want to hear more about this process and how awesome my students are, see this post and this post and this post. Oh, and especially this post here.
Monday, March 16, 2015
Progress
For years, I've been worrying about about my chronic backlog of papers I should have written a long time ago and just haven't had time for. I'm very happy to report that my to-write list is getting a lot shorter. Three of the papers on that list will come out in the first half of this year. Number four is currently out for review, 5&6 need to be revised and resubmitted, a seventh is written and currently with colleagues awaiting their comments. The eighth has figures made and large chunks of text in their second or third drafts. If all goes well, all eight should be at least submitted by the end of the year, and I'm guessing that six will have come out. Of course there are several more that I need to get to, and new projects being planned, but it feels good to be clearing the backlog a bit. Especially nice is that after spending too long on methods papers, incidental discoveries and other tangents, the manuscripts I am working on now actually address the central points that motivated the research in the first place.
5. On raven populations in the Eastern US. One reviewer loved it just as it was, the other made numerous (and useful) comments on how to improve the analysis. Being worked on by my colleagues who are primarily responsible for the analysis.
6. Part of the same ontogenescence collaboration as #4, this was just rejected by a high impact journal on the basis that they rejected it (no reason or feedback given, as is common with such journals) and will be submitted to another in April.
7. Another ontogenescence paper, this time in a marine ecology context. Our plan is to submit in May. Between now and then the main order of business is to get feedback from colleagues and use it to improve the text.
8. Same project as #s 4 and 6.
9. On post-reproductive lifespan, building on the papers and methods that came out of my dissertation. We have cool results proving an interesting point, but it still needs a fair bit of work.
They probably won't be submitted in exactly this order, as a lot of it depends on factors beyond my control, but this is more or less the order I'm prioritizing them in. Beyond that it is hard to predict. Some older things I still do really need to write up, some fruitful student projects on post-reproductive lifespan that are looking good, some vague ideas.
One thing I've decide is that at least for the moment, no papers that are outside the main foci of my research program (evolution of pre-reproductive mortality and post-reproductive survival) are going to make the list. Numbers 1-3 & 5 above don't directly address either of these topics, and 4 is tangential. That is a bad habit, and one I'm going to break.
Saturday, January 24, 2015
Choosing peer reviewers
Now, journal editors can decide to ignore these recommendations, and those invited to review can say no, but in a large portion of cases (I have no data, this is simply a strong impression), some or all of those recommended end up writing reviews. The reason journals ask for such recommendations is to help the journal editors quickly find people who are highly qualified to review. I already know who is very knowledgeable about my specific topic, while the journal editors may not. Many journals have editors who are not paid anything for their service, and all have editors whose time is limited. Asking for and using these recommendations saves time, and probably helps avoid unqualified reviewers.
Doing so, however, has some pretty clear corrupting influence. Those who are good at this game pay great attention to whom they recommend, not only carefully considering the knowledge, viewpoints and interests of those they will recommend, but crafting the paper to raise as few objections as possible from these individuals. Papers that defy much of what is well established in one field regularly are published based on the recommendations of reviewers whose knowledge comes from another branch, and this fact is not ignored in making these recommendations. If the paper is very likely to be sent to a particular reviewer, that person's terminology and definitions will be used and his or her papers referenced. At scientific meetings, people will say, "I like this idea, list me as a reviewer." At its worst, peer review is reduced to a popularity contest, with well established authors having their work (not only journal articles, but also grant applications) evaluated mostly by their friends and allies.
Mixing moral distaste, political naivity, and hurry, I have generally spent no more than a few minutes on the question of who my recommended reviewers will be. The latest iteration of this came with a paper on which two of my undergraduate students are lead authors. We submitted it to one journal with a recommended list of reviewers that was hastily thrown together, experts on the organism we were working on but not necessarily interested in our particular topic. They trashed it solely on the basis that no one cared. We submitted the same manuscript, with very few edits, to another journal, listing reviewers with some knowledge of the organism, but a strong interest in questions related to our own. We got back three extremely positive reviews, praising our highly original and relevant work, recommending several very minor changes and urging the editors to publish this paper. Yesterday morning we submitted these revisions, and yesterday evening this journal officially accepted our paper.
So I've not only learned my lesson, but decided to heed it. Whom I ask to review a paper is (depressingly) almost as important as the quality of the work. I see truly terrible papers come out in excellent journals, presumably approved by carefully chosen reviewers, and some very good papers get rejected by less selective journals, in part because of poorly considered recommendations. From now on, I will put my qualms aside and think carefully, early in the process, about whom I will recommend as reviewers. After all, everybody else is doing it.
Friday, January 23, 2015
Very pleasing
Wednesday, January 21, 2015
Good practice
Wednesday, September 24, 2014
Rejection
The starfish paper I wrote with my students documents something that hasn't been documented before, but is certainly not the world's most important paper. It doesn't fit neatly into any field or derive from the pressing questions in any literature. So we sent it to a journal that explicitly says they don't care if it is important, so long as it is original, technically sound research. The reviewers agree that is passes these hurdles, but question its importance to their field. On this basis alone, the academic editor rejected it. I can't say I'm entirely surprised, as PLOS ONE has become a relatively high-impact journal. That type of success naturally brings them to function like a more traditional print journal competing for the flashiest papers. I filled out their feedback form to suggest that they update their stated criteria for acceptance, but won't otherwise protest.
There are two upsides to all this. The reviewers found the paper convincing and novel, with no technical or language faults. So we just need reformat for another journal and submit it there. Perhaps more importantly, this gives my student co-authors a window into yet another aspect of the scientific process that most of their peers never see.
Monday, August 04, 2014
To-write-list
Thursday, July 17, 2014
Too consise?
Thursday, May 08, 2014
One way to avoid writing negative reviews is to decline to act as reviewer
I am afraid I am unable to decipher the meaning of even the title of this paper, and the abstract implies a communicative style that could charitably be called idiomatic. I know all the words being used, (and am familiar with the probable subject matter) but couldn't tell you what most of them mean in this context. Were I to review a paper written in this manner I would spend an excessive amount of time on these linguistic issues, and might or might not ever get around to figuring out the embedded science.
Monday, February 11, 2013
Better measures of tiny bits of living jelly
Forthcoming in "Marine and Freshwater Research"
The consistent, non-destructive measurement of small proteiform aquatic animals with application to the size and growth of hydra
Daniel Levitis and Josephine Goldstein
Abstract: Hydra (Cnidaria), the basal metazoan most often studied in cellular, molecular and developmental biology, is difficult to measure because it is small, proteiform and aquatic. To facilitate broader organismal and ecological study of Hydra, we evaluate three methods whereby a polyp's body column can be measured by means of photomicroscopy. The volume, cylindrical surface area and surface area corrected for changes in body shape are all highly repeatable methods (r=0.97) when shape varies little. However, shape changes alter volume and cylindrical surface area. Repeated corrected surface area measures of the same individuals in markedly different positions yield standard deviations that are less than 5% of the mean measured area. This easy, non-lethal means of individual size measurement explicitly accounts for the flexible morphology of a polyp's hydrostatic skeleton. It therefore allows for the elucidation of how growth and size vary over time, age and food intake. We find that hydra change size dramatically day to day, and that while food level influences adult size, it has little effect on the early growth of recently detached buds. Finally, we discuss ecological and biological applications of this method.
Part of why I like this paper so much is that my student did most of the hard parts, and the reviewers didn't ask for a lot of changes, and the editor (Dr. Russell Death) moved things along quickly and efficiently, so it is the first paper I've published that didn't feel like pulling my own teeth. It is a solid methods paper. It says, "here is a method for doing something that many scientists may want to do, that we didn't know a good way to do before."
In particular, it is a simple way to accurately and easily measure a tiny transparent aquatic animal with no hard parts or consistent shape without harming it. Take a picture of it and with a bit of simple math calculate its surface area. Simple, elegant, inexpensive, non-invasive, biologically meaningful, everything I hoped it would be.
But the method presented in the paper is a substantially different, and better, method than the one we started out with. In fact, we were almost ready to submit the paper when we changed the method drastically.
I started out just wanting to measure a hydra polyp because it was necessary for another research project. Nobody had a method that worked halfway decently without killing the hydra. A hydra's body, although it shortens and lengthens, bends and twists is almost always roughly a deformed cylinder. So I said, "Hey Josi" (that's my student), why don't we develop a method to measure a hydra by photographing it and estimating its volume as though it was cylinder?" She agreed, and off we went, taking photos of hydra during our whole research project, for almost two years. We finished gathering our data, and found that indeed we could measure hydra this way. It didn't work great, but it kinda worked. You could use it to tell the difference between a really huge hydra and one that was just kind normal. Viola, unimpressive but probably publishable methods paper.
We wrote it up and were pretty close to submitting when I decided to see what hydra focussed papers had come out recently, and found that someone else had just published almost the exact same method in a nice paper with an interesting biological point. Our formulation of that method didn't work any better than hers did, and we had no point beyond "here is how to measure." We couldn't publish the same method again, even if we came up with it independently. After some cursing and self-recriminations for being so slow, I decided to see if it was possible to salvage anything of the methods paper. Josi took another set of photos and I used them to repeatedly adjust my formula, with limited biological reasoning, until something worked better than the formula just published. In fact, one formula I came up with by eyeballing my graphs worked much better than the method just published. So much better that the calculated value hardly changed at all even when the shape of the hydra changed drastically.
Now you are probably saying to yourself that this is blatant cheating. Trying different formulas (perhaps 100 of them) until something gives you the result you want is a pretty sure way to get the result you want, if you are persistent enough. But two things combined to make this not just okay, but beautiful. First, the formula I stumbled upon made obvious biological sense, even before I knew it worked. This formula represents a hydra as a roughly cylindrical bag whose skin stretches as it elongates itself, or folds and ripples as it contracts. In other words, it describes a hydra accurately and reveals something I didn't previously know about the way a hydra moves. Secondly, and as importantly, when I applied the formula to the main data set, which I didn't use to develop the formula, it still gave a highly consistent measurement for any individual, even as the shape of the individual changed. The method in fact works for completely different populations of hydra. You could take two hydra that looked the same size under the microscope and conclusively decide that one was bigger than the other. You could tell how much a young hydra grew each day. You could really measure the buggers, eliminating most of the noise inherent to previous methods.
Still more lovely, the method Josi and I had just developed could make use of the photos and measurements we had already taken, so redoing all our calculations and figures required Josi to write only a few extra lines of code (Thank you Josi, thank you R). We did a little rewriting to compare our method favorably to our other method,
Wednesday, December 12, 2012
Unbe-fricken-lievable incom-shitforbrains-petence
Monday, October 15, 2012
In which I use some strong words on the topic of a botched editing job
Tuesday, April 03, 2012
Accepted, but...
The good news is that all the reviewers seemed to like it, and the editor knows which issue of the journal he wants to put it in, which we take as the paper being accepted. The bad news (or at least time-consuming news) is that all of the several and several reviewers made long lists of things they would like to see changed, added, clarified or reorganized. I have not yet finished reading all these comments, but I don't see a lot of repetition, meaning that we have hundreds of distinct comments and criticisms to deal with. In the months we were waiting, we also showed the draft to a couple of colleagues, who gave us still different but also very useful comments. The good news is that the editor has given us permission to go well beyond the usual page limit for this journal in order to deal with all the reviewer comments. The bad news is that we now can't use space limitations as an excuse for not dealing with relevant points or citing relevant literature. So we have a great deal of rewriting to do.
Part of the problem with writing an article pointing out places where other people's thinking or language has been unclear is that one has to live up to very high standards for clarity in one's thinking and language. We've already extensively rewritten this paper a few times, and each time it has gotten clearer. Nevertheless, a large portion of the reviewers' comments are right on, and further clarification is needed. By the time this thing comes out it will either be brilliant or a total muddle. I'm not clear which.
Thursday, January 05, 2012
Authorship code
I'm writing a paper with two of my students. Well, I'm writing it with one of them and another one did a lot of work on the statistics. But today we had to straighten out the order that the authors would be listed in on the paper. This can be a contentious issue, and I know of cases in which papers did not getting written at all because the authors couldn't agree on who got to be listed first. Some big multi-author papers simply list everyone in alphabetical order to avoid the fuss, but then Dr. Aardvark always gets to be first author. Some journals have a little section where each author's contribution is described, but they usually end up saying something uninformative and false like "all authors contributed equally."
I came up with most of the ideas in the current paper, put things together, decided who would do what, etc. My student did much of the lab work and is doing much of the actual writing. Given this, most biologists would propose what I did, and what my student objected to: She (as the person doing the writing) should come first, I (as the senior person on the paper) should come last, and everyone else (in this case meaning the statistics student) gets sandwiched in between. This was very counterintuitive for my student; she thought I was trying to minimize my own role by putting myself last. In fact, it is a step up for me to be writing papers in which I am in that last position. I remember this being counterintuitive for me the first time it was explained to me. I was a college student, and a boss said that he'd make me second author on a paper. I said something to the effect that I'd be glad to be even last author, which I thought was being humble, but he took it as me saying the paper had been my idea. We straightened out the miscommunication but I didn't end up being listed as author on the paper. That the last author spot (at least in biology) signifies the senior author is a code biologists internalize, and I had to think back a long way to figure out why my student objected to me being last author. I explained, she reluctantly believed, and now it is settled.
Sunday, December 18, 2011
The end is neigh!
Thursday, March 31, 2011
Skipping that hard middle part
I can do lab work, I can program a simulation, I can edit bibliography formats in citation management software, and all those other jobs that require extensive attention to details beyond the scientific concepts. But by preference I'm really a concept guy. If I had collaborators who wanted to do every part of the process between the planning and writing the rough draft, I'd be thrilled.
This is why I'm writing a Forum piece, to submit to a journal that responded positively to my pre-submission inquiry. (A positive response means they are willing to look at it, not that they promise to publish it.) Their Forum section is designed for short papers of about a 1000 words, in which the author makes a relatively simple point or poses a question without a lot of new data. I've finished a rough draft of 1100 words in the last two days. Now comes the less fun part of editing it for clarity, making sure all the papers I cite actually say what I claim they say, getting feedback from colleagues and editing it again. A more adulterated and repetitive form of creativity. Still, I think I would be inclined to write more papers in this format, as it makes a nice compact project.
Sunday, March 27, 2011
What to do?
The question then is what, if anything, should I do about this? I don't really want to waste a lot of my time, but this is fairly serious misconduct. I could write to him and request copies of the papers, or an explanation of Figure 2 in the Nature paper. I could tell his boss on him, assuming he actually works where he says he does. I could simply reject the application. I'm not certain what, if anything, is the standard response to this situation. There are confidentiality rules that apply to job applications, even fraudulent ones, so public humiliation is out of the question.