Content of review 1, reviewed on October 15, 2018
I've read the manuscript about the ascend R package. It is very well written and everything is explained. However, my major concern is that in terms of applications it is not really different from the already published scater package. The only real difference I can see is that the log is also stored in the data object. Therefore, since the developers of scater tried to optimise it very much by using C code where possible, it would be important to compare the running times of ascend and scater on some of the common functions and to show in which cases it is more advantageous to use either ascend or scater.
In addition, I don't fully agree with the argument in the Introduction that all of the analysis tools should be part of the same package. I think that common data structures, such as SingleCellExperiment class give the developers freedom to develop various algorithms without worrying too much about compatibility and therefore there is no real need of having all methods used for the analysis in just one package.
Declaration of competing interests Please complete a declaration of competing interests, considering the following questions: Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold or are you currently applying for any patents relating to the content of the manuscript? Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript? Do you have any other financial competing interests? Do you have any non-financial competing interests in relation to this paper? If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below. I declare that I have no competing interests.
I agree to the open peer review policy of the journal. I understand that my name will be included on my report to the authors and, if the manuscript is accepted for publication, my named report including any attachments I upload will be posted on the website along with the authors' responses. I agree for my report to be made available under an Open Access Creative Commons CC-BY license (http://creativecommons.org/licenses/by/4.0/). I understand that any comments which I do not wish to be included in my named report can be included as confidential comments to the editors, which will not be published. I agree to the open peer review policy of the journal.
Source
© 2018 the Reviewer (CC BY 4.0).
Content of review 2, reviewed on May 06, 2019
The authors have addressed my concerns.
Declaration of competing interests Please complete a declaration of competing interests, considering the following questions: Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold or are you currently applying for any patents relating to the content of the manuscript? Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript? Do you have any other financial competing interests? Do you have any non-financial competing interests in relation to this paper? If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below. I declare that I have no competing interests.
I agree to the open peer review policy of the journal. I understand that my name will be included on my report to the authors and, if the manuscript is accepted for publication, my named report including any attachments I upload will be posted on the website along with the authors' responses. I agree for my report to be made available under an Open Access Creative Commons CC-BY license (http://creativecommons.org/licenses/by/4.0/). I understand that any comments which I do not wish to be included in my named report can be included as confidential comments to the editors, which will not be published. I agree to the open peer review policy of the journal.
Authors' response to reviews: Reviewer #1: The authors have addressed my concerns.
Reviewer #2: It is good to have alternative workflows for single-cell analysis, and I am glad to see the authors have submitted the package to Bioconductor. I hope the authors maintain the package and update with new methods as necessary such as if new normalizations or batch corrections are developed. I only have two comments that I hope the authors try to clarify further.
- The statement starting with "Optionally, after batch-to-batch normalisation, we also…" should not be in that location. It seems to suggest to readers that this is the recommended method, whereas later that is not the case. In these sentences the manuscript also claims that this normalization approach is more "robust" without providing any evidence or citation.
Thank you for highlighting this. We have amended this section, removing mention of the batch-batch normalisation method here.
- It's still not completely clear to me how the authors extension of the sc-qPCR method is different from MAST. The same authors of the qPCR method extended it here: "MAST: a flexible statistical framework for assessing transcriptional changes and characterizing heterogeneity in single-cell RNA sequencing data". MAST is also an LRT, but I am assuming that here you are not using the detection rate as a covariate? That's OK if true, it just needs to be clear to the reader. I imagine this could be a frequently asked question by users down the road, so even a sentence on how it is different from (or similar to) MAST would help.
We have amended this section to include a couple of sentences on the relationship of the LRT we use to that in MAST. LRT applies Chi-Square approximation for likelihood differences and thus is fast and less memory-intensive. A similar LRT test approach that optimizes a two-part general linearized model to estimate parameters that account for bimodality and stochastic dropout (cell detection rate) implemented in the MAST package is more computationally intensive, especially for datasets with large cell numbers. The LRT applied in ascend does not model cell detection rate to use as a covariate when comparing subpopulations.
- Suggestion only: I may have missed it, but it might be helpful to include a statement that says something like "Statistical methods for single-cell analysis are constantly evolving. Here we have implemented XX. The flexibility of ascend allows it to adapt as future methods are developed and prove useful".
Thank you for this suggestion, we have included the following sentence in the conclusion stating “Statistical methods for single-cell analysis are constantly evolving. Here we have implemented a series of current cutting-edge approaches, although the flexibility of ascend allows it to adapt as future methods are developed”
Source
© 2019 the Reviewer (CC BY 4.0).
References
Anne, S., W., L. S., Alquicira, H. J., B., A. S., Xin, M., H., N. Q., E., P. J. ascend: R package for analysis of single cell RNA-seq data. GigaScience.