Content of review 1, reviewed on December 16, 2018
In this manuscript, Sempere and colleagues presented Gigwa v2, an update of their previous version of the genotype investigator for genome wide analyses. During my brief test of Gigwa v2, I found that it was easy to use, did everything smoothly, and could everything they authors promised; the interface was smooth, informative and intuitive.
In principle, I would have no reason to turn down such a good tool. However, it worries me that the previous version got only six citations (or four according to ISI) since its publication in 2016. Although citations do not necessarily reflect the quality of a work, for a tool, it often means we got the audiences wrong. We made similar mistakes in the past in our lab, that is, we made a few tools that we thought would be useful to experimental biologists. However, very often, experimental biologists often found our tools very difficult to use; at the meantime, bioinformaticians were also reluctant to use them because they were more comfortable with command-line tools.
Here are some tips (that helped us greatly in the past) to attract audiences (experimental biologists in this case if I understand it correctly) : 1. to provide very detailed documentations for the tool, and 2. provide annotated screenshots whenever possible.
Declaration of competing interests
Please complete a declaration of competing interests, considering the following questions:
Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future?
Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future?
Do you hold or are you currently applying for any patents relating to the content of the manuscript?
Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript?
Do you have any other financial competing interests?
Do you have any non-financial competing interests in relation to this paper?
If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below.
I declare that I have no competing interests.
I agree to the open peer review policy of the journal. I understand that my name will be included on my report to the authors and, if the manuscript is accepted for publication, my named report including any attachments I upload will be posted on the website along with the authors' responses. I agree for my report to be made available under an Open Access Creative Commons CC-BY license (http://creativecommons.org/licenses/by/4.0/). I understand that any comments which I do not wish to be included in my named report can be included as confidential comments to the editors, which will not be published.
I agree to the open peer review policy of the journal.
AUthors' response to reviews. Reviewer #1
We are grateful for sharing your experience with us.
A PDF documentation was available on the project homepage, but probably not so easy to find. We took the following steps to improve documentation visibility and help users understand how to use Gigwa:
we converted the existing documentation to HTML, enriched it by adding further explanation and inserting screenshots where it seemed relevant, and embedded it within the web application so that it can be opened at any time from the main menu.
we created 4 demonstration videos with embedded comments showing how to import data, filter data, manage outputs and efficiently use the phenotype-based discrimination feature.
we mentioned the availability of those videos at the top of the HTML documentation where we also provided a link to the homepage.
we also improved the Swagger documentation page by providing the full relative path to mentioned calls and adding a table providing terminology correspondence between the internal data model and those of the REST APIs.
Since the review, Gigwa V2 was presented at the International Plant and Animal Genome conference (PAG), and aroused interest of scientists from various countries and institutes. Since then we are having feedback from people installing it, so we are confident that the number of users is going to grow significantly.
Regarding the number of citations, we are aware of this concern and therefore we applied the following changes to V2:
we added a reference to the original publication on the web application's homepage
we made the system include a HOW_TO_CITE.txt file in each exported archive
We hope that all these improvements will help our tool gain visibility in the near future.
Reviewer #2
(1) Thank you for this suggestion. We removed the 3 occurrences of the word "ergonomic" and replaced them with "easy to use", "straightforward" and "user-friendly".
(2) We added the following sentence to the "Description" paragraph of the Abstract: "The project home page http://www.southgreen.fr/content/gigwa provides a list of live instances allowing to test the system on public data (or reasonably-sized user-provided data)."
(3) The Gigwa V1 manuscript explains this in the following terms: "VCFtools excels here because it is a C++ program working on flat files, which means that the time needed to access each record is negligible, whereas database engines need to obtain/deflate objects before manipulating them". An additional reason is that Gigwa being a 3-tier application, the application server (Java code) is at all time exchanging data with either the client-side UI (Javascript code) or the database server (MongoDB). Reducing this data exchange to a minimum is one of the main aspects on which we focused when optimizing our code. In other words, not being as fast as highly specific command-line tools is the downside of providing a web interface on top of structured data. In order to make this clearer to readers, we split apart Benchmark results and Benchmark discussion. In the latter, we referenced the explanation made in the previous article. We also mentioned in that paragraph a separate investigation focused on estimating the benefit of deploying MongoDB as a sharded cluster.
(4) The live Gigwa instance mostly put forward is the one hosted by CIRAD, on the southgreen.fr domain. Since South Green, our platform and network of bioinformaticians, focuses on tropical and Mediterranean crops, including human data there would not have made much sense. However, the instance hosted by the IRD institution (http://gigwa.ird.fr/) is more suitable for this kind of data as some teams there work on human health. So, we listed all live instances hosted by our network on the application's homepage, mentioned that in the abstract, and imported the Hapmap project's phase2+3's data into the IRD instance. This dataset was annotated using snpEff, linked to the UCSC genome browser, and enriched with individual's metadata to help users make the best of it.
Source
© 2018 the Reviewer (CC BY 4.0).
Content of review 2, reviewed on March 06, 2019
all my previous concerns have been addressed.
Declaration of competing interests
Please complete a declaration of competing interests, considering the following questions:
Have you in the past five years received reimbursements, fees, funding, or salary from an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future?
Do you hold any stocks or shares in an organisation that may in any way gain or lose financially from the publication of this manuscript, either now or in the future?
Do you hold or are you currently applying for any patents relating to the content of the manuscript?
Have you received reimbursements, fees, funding, or salary from an organization that holds or has applied for patents relating to the content of the manuscript?
Do you have any other financial competing interests?
Do you have any non-financial competing interests in relation to this paper?
If you can answer no to all of the above, write 'I declare that I have no competing interests' below. If your reply is yes to any, please give details below.
I declare that I have no competing interests.
I agree to the open peer review policy of the journal. I understand that my name will be included on my report to the authors and, if the manuscript is accepted for publication, my named report including any attachments I upload will be posted on the website along with the authors' responses. I agree for my report to be made available under an Open Access Creative Commons CC-BY license (http://creativecommons.org/licenses/by/4.0/). I understand that any comments which I do not wish to be included in my named report can be included as confidential comments to the editors, which will not be published.
I agree to the open peer review policy of the journal.
Authors' response to reviews. We re-uploaded the manuscript file with only two modifications :
- an update of reference number 12 (recently accepted paper)
- the insertion of the RRID reference in the Availability and requirements section
Source
© 2019 the Reviewer (CC BY 4.0).
