Content of review 1, reviewed on December 11, 2018

In this paper the authors present both a quality measure for biclusters and a tunable biclustering algorithm, in the context of gene expression data. The paper is well organized and the contents include an extensive analysis on different datasets. Since biclustering has been largely applied to gene expression analysis recently, in this work I miss a more in depth comparative analysis regarding other techniques. Although background section present a wide variety of previous works in this field, TuBA has only been compared to Qubic algorithm. In the same way, their proximity measure has not been fully analysed. In Quality Measures for Gene Expression Biclusters (https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0115497) it is possible to find a comparative analysis among different evaluation measures for biclusters. It would be a good idea to perform a similar study using the proximity measure.

Declaration of competing interests Please complete a declaration of competing interests, considering the following questions: Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold or are you currently applying for any patents relating to the content of the manuscript? Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript? Do you have any other financial competing interests? Do you have any non-financial competing interests in relation to this paper? If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below. I declare that I have no competing interests.

I agree to the open peer review policy of the journal. I understand that my name will be included on my report to the authors and, if the manuscript is accepted for publication, my named report including any attachments I upload will be posted on the website along with the authors' responses. I agree for my report to be made available under an Open Access Creative Commons CC-BY license (http://creativecommons.org/licenses/by/4.0/). I understand that any comments which I do not wish to be included in my named report can be included as confidential comments to the editors, which will not be published.
I agree to the open peer review policy of the journal.

Authors' responses to reviews: (https://drive.google.com/open?id=1Opuc4BLagbgGxigy4sSyI-c7AeX35BTQ)

Source

    © 2018 the Reviewer (CC BY 4.0).

Content of review 2, reviewed on April 04, 2019

In this paper the authors present a tunable biclustering algorithm (TuBA), based in the use of a proximity measure. TuBA has been applied to Breast Cancer Analysis. The paper is well organized and the contents include an extensive analysis on different datasets. Nevertheless, I have the following concerns regarding its appropriateness for being accepted: - In section METHODS, subsection "Proximity Measure" does not provide enough details in order to reproduce its computation. It is not easy to understand how it does evaluate biclusters. - In section METHODS, subsection "Datasets" it is not clear how many datasets have been finally analysed. Although in line 248 it is said that "we applied TuBA to three BRC datasets", TCGA, METABRIC and GEO, from line 258 some other datasets are introduced: Bicmix or GTEx. - In section RESULTS, subsection "Benchmarkig TuBA's Proximity Measure", proximity measure has been checked against correlation coefficients such as Pearson or Spearman, but not against other evaluation measures specific for biclusters. - In section RESULTS, subsection "Choice of parameters for TuBA" it not specified a clear strategy for choosing the parameter values when analysing a new dataset. Furthermore, being the results section so large, I also suggest to include a summary table or diagram in order to provide the reader with a quick snapshot of the results.

Declaration of competing interests Please complete a declaration of competing interests, considering the following questions: Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future? Do you hold or are you currently applying for any patents relating to the content of the manuscript? Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript? Do you have any other financial competing interests? Do you have any non-financial competing interests in relation to this paper? If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below. I declare that I have no competing interests.

I agree to the open peer review policy of the journal. I understand that my name will be included on my report to the authors and, if the manuscript is accepted for publication, my named report including any attachments I upload will be posted on the website along with the authors' responses. I agree for my report to be made available under an Open Access Creative Commons CC-BY license (http://creativecommons.org/licenses/by/4.0/). I understand that any comments which I do not wish to be included in my named report can be included as confidential comments to the editors, which will not be published.
I agree to the open peer review policy of the journal.

Authors' responses to reviews:

Reviewer 3: In this paper the authors present a tunable biclustering algorithm (TuBA), based in the use of a proximity measure. TuBA has been applied to Breast Cancer Analysis. The paper is well organized and the contents include an extensive analysis on different datasets. Nevertheless, I have the following concerns regarding its appropriateness for being accepted.

Response: We thank the reviewer for their positive comments and hope that in the revised manuscript, we have clarified and addressed these concerns.

Reviewer 3: In section METHODS, subsection "Proximity Measure" does not provide enough details in order to reproduce its computation. It is not easy to understand how it does evaluate biclusters.

Response: TuBA’s proximity measure is based on computing the significance of the overlap between the samples that exhibit high (or low) expression of any given gene pair. As noted in lines 110-114, “The number of samples shared between any pair of percentile sets follows the hypergeometric distribution; therefore, we can compute the significance (p-value) of overlaps between pairs of percentile sets based on the numbers of shared samples by using the one-sided Fisher's exact test.” The lower the p-value of overlap, the stronger is the association between the gene-pair. We illustrate the basic idea and the setup of the test underlying our proximity measure in Figure 1.

Reviewer 3: In section METHODS, subsection "Datasets" it is not clear how many datasets have been finally analysed. Although in line 248 it is said that "we applied TuBA to three BRCA datasets", TCGA, METABRIC and GEO, from line 258 some other datasets are introduced: Bicmix or GTEx.

Response: The primary and clinically relevant results of the paper are based on the application of TuBA to three large breast cancer (BRCA) datasets – TCGA, METABRIC, and GEO. We additionally used the Genotype-Tissue Expression (GTEx) and ESTIMATE datasets to reaffirm that some of our biclusters from the three BRCA datasets were associated with normal/stromal tissue gene expression signatures. Moreover, for comparing TuBA with the Bicmix algorithm, we applied TuBA to the breastCancerNKI dataset. We have now separated this subsection in Methods to clearly indicate primary and validation datasets (lines 248-289).

Reviewer 3: In section RESULTS, subsection "Benchmarking TuBA's Proximity Measure", proximity measure has been checked against correlation coefficients such as Pearson or Spearman, but not against other evaluation measures specific for biclusters.

Response: TuBA’s proximity measure, like Pearson’s and Spearman’s correlation coefficients, is a pairwise measure of proximity. It enables us to identify gene-pairs that show strong association by virtue of a significant overlap in their top (or bottom) samples. Such gene-pairs are represented graphically as a pair of nodes linked together; the link represents the set of samples that are shared in their respective top (or bottom) percentile sets. Thus, our proximity measure provides the basis for the generation of graphs that are subsequently analyzed by our iterative graph-based approach to identify biclusters. By itself, the proximity measure does not evaluate biclusters.

We should note that TuBA does not involve modeling of gene expression data in order to identify biclusters. Thus, bicluster evaluation measures based on models of patterns of gene expression data are not applicable to its results. However, in the Enrichment of bicluster samples in top (bottom) sample sets of bicluster genes subsection of Results, we are now proposing a simple metric to assess the overall quality of the biclusters discovered by TuBA (Lines 404-412): “… the FDR values for each gene (sample) in any given bicluster can be viewed as their scores – the closer the value of the FDR is to zero for a gene (sample), the stronger is the association of the gene (sample) to the bicluster. We used the FDR values for the genes and samples within bicluster i to evaluate its overall quality, Q(Bi), defined as the minimum of the fraction of the genes in the bicluster with FDR < 0.05 or the fraction of samples in the bicluster with FDR < 0.05. Q(Bi) takes values between 0 and 1, where values close to zero indicate weak associations between the constituent genes and samples within the bicluster, while values close to one would indicate strong associations.” Supplementary Table 5 is now updated to include these quality scores for the biclusters.

Reviewer 3: In section RESULTS, subsection "Choice of parameters for TuBA" it not specified a clear strategy for choosing the parameter values when analysing a new dataset.

Response: We have discussed the considerations that underlie the choices for TuBA’s parameters in the Tuning TuBA subsection of Methods, also illustrated in Figure 3. For the choice of the second parameter (Overlap significance cutoff), we proposed the following heuristic in the same section: “the cutoff for the significance level of overlap should be such that a decrease in the significance level by an order of magnitude leads to an 40-60% increase in the number of edges that get added to the graph.” (Lines 233-237)

Reviewer 3: Furthermore, being the results section so large, I also suggest to include a summary table or diagram in order to provide the reader with a quick snapshot of the results.

Response: We have summarized the key results and discussions in Supplementary Figure 10.

Source

    © 2019 the Reviewer (CC BY 4.0).