Biology:Biocuration

From HandWiki

Biocuration is the field of life sciences dedicated to organizing biomedical data, information and knowledge into structured formats, such as spreadsheets, tables and knowledge graphs.[1][2] The biocuration of biomedical knowledge is made possible by the cooperative work of biocurators, software developers and bioinformaticians and is at the base of the work of biological databases.[1]

Biocuration as a profession

Articles about biocuration on PubMed per year since the first mention in 2006 up to the end of 2022.

A biocurator is a professional scientist who curates, collects, annotates, and validates information that is disseminated by biological and model organism databases.[3][4] It is a new profession, with the first mentions in the scientific literature dating of 2006 in the context of the work in databases like the Immune Epitope Database and Analysis Resource.[5][6] Biocurators usually are PhD-level with a mix of experiences in wet lab and computational representations of knowledge (e.g. via ontologies).[7]

The role of a biocurator encompasses quality control of primary biological research data intended for publication, extracting and organizing data from original scientific literature, and describing the data with standard annotation protocols and vocabularies that enable powerful queries and biological database interoperability. Biocurators communicate with researchers to ensure the accuracy of curated information and to foster data exchanges with research laboratories.[6]

Biocurators are present in diverse research environments, but may not self-identify as biocurators. Projects such as ELIXIR (the European life-sciences Infrastructure for biological Information) and GOBLET (Global Organization for Bioinformatics Learning, Education and Training)[8] promote training and support biocuration as a career path.[9][10]

In 2011, biocuration was already recognized as a profession, but there were no formal degree courses to prepare curators for biological data in a targeted fashion.[11] With the growth of the field, the University of Cambridge and the EMBL-EBI started to jointly offer a Postgraduate Certificate in Biocuration,[12] considered as a step towards recognising biocuration as a discipline on its own.[13] There is a perceived increase in demand of biocuration, and a need for additional biocuration training by graduate programs.[14]

Organizations that employ biocurators, like Clinical Genome Resource (ClinGen), often provide specialized materials and training for biocuration.[15]

Biological knowledgebases

Main pages: Biology:Biological database and Biology:Model organism database

The role of biocurators is best known among the field of biological knowledgebases. Such databases, like UniProt[16] and PDB[17] rely on professional biocurators to organize information. Among other things, biocurators work to improve the data quality, for example, by merging duplicated entries.[18]

An important part of those knowledgebases are model organisms databases, which rely on biocurators to curate information regarding organisms of particular kinds. Some notable examples of model organism databases are FlyBase,[19] PomBase,[20] and ZFIN,[21] dedicated to curate information about Drosophila, Schizosaccharomyces pombe and zebrafish respectively.

Curation and annotation

Biocuration is the integration of biological information into on-line databases in a semantically standardized way, using appropriate unique traceable identifiers, and providing necessary metadata including source and provenance.

Ontologies, controlled vocabularies and standard names

Main page: Organization:OBO Foundry

Biocurators commonly employ and take part in the creation and development of shared biomedical ontologies: structured, controlled vocabularies that encompass many biological and medical knowledge domains, such as the Open Biomedical Ontologies. These domains include genomics and proteomics, anatomy, animal and plant development, biochemistry, metabolic pathways, taxonomic classification, and mutant phenotypes. Given the variety of existing ontologies, there are guidelines that orient researchers on how to choose a suitable one.[22]

The Unified Medical Language System is one such systems that integrates and distributes millions of terms used in the life sciences domain.[23]

Biocurators enforce the consistent use of gene nomenclature guidelines and participate in the genetic nomenclature committees of various model organisms, often in collaboration with the HUGO Gene Nomenclature Committee (HGNC). They also enforce other nomenclature guidelines like those provided by the Nomenclature Committee of the International Union of Biochemistry and Molecular Biology (IUBMB), one example of which is the Enzyme Commission EC number.

More generally, the use of persistent identifiers is praised by the community, so to improve clarity and facilitate knowledge [24]

DNA annotation

Main page: Biology:DNA annotation

In genome annotation for example, the identifiers defined by the ontologists and consortia are used to describe parts of the genome. For example, the gene ontology (GO) curates terms for biological processes, which are used to describe what we know about specific genes.

Annotations of a biomedical text in the Europe PMC SciLite platform

Text annotation

As of 2021, life sciences communication is still done primarily via free natural languages, like English or German, which hold a degree of ambiguity and make it hard to connect knowledge. So, besides annotating biological sequences, biocurators also annotate texts, linking words to unique identifiers. This aids in disambiguation, clarifying the meaning intended, and making the texts processable by computers. One application of text annotation is to specify the exact gene a scientist is referring to.[25]

Publicly available text annotations make it possible to biologists to take further advantage of biomedical text. The Europe PMC has an Application Programming Interface which centralizes text annotations from a variety of sources and make them available in a Graphic User Interface called SciLite.[26] The PubTator Central also provides annotations, but is fully based on computerized text-mining and does not provide a user interface.[27] There are also programs that allow users to manually annotate the biomedical texts they are interested, such as the ezTag system.[28]

International Society for Biocuration (ISB)

Main page: Organization:International Society for Biocuration

The International Society for Biocuration (ISB) is a non-profit organisation "promotes the field of biocuration and provides a forum for information exchange through meetings and workshops." It has grown from the International Biocuration Conferences and founded in early 2009.[4]

The ISB offers the Biocuration Career Award to biocurators in the community: the Biocurator Career Award (given annually) and the ISB Award for Exceptional Contributions to Biocuration (given biannually).

The official journal of the ISB, Database, is a venue specialized in articles about databases and biocuration.[29]

Community curation

Traditionally, biocuration has been done by dedicated experts, which integrate data into databases. Community curation has emerged as a promising approach to improve the dissemination of knowledge from published data and provide a cost-effective way to improve the scalability of biocuration. In some cases, community help is leveraged in jamborees that introduce domain experts to curation tasks, carried during the event,[30] while others rely on asynchronous contributions of experts and non-experts.[31]

Biological databases

Community curation portal of WormBase
Community curation portal of WormBase[32]

Several biological databases include author contributions in their functional curation strategy to some extent, which may range from associating gene identifiers with publications or free-text, to more structured and detailed annotation of sequences and functional data, outputting curation to the same standards as professional biocurators. Most community curation at Model Organism Databases involves annotation by original authors of published research (first-pass annotation) to effectively obtain accurate identifiers for objects to be curated, or identify data-types for detailed curation. For example:

  • WormBase successfully solicits first-pass annotation from users and has integrated author curation with the micropublication process.[33] WormBase also integrates text-mining to its platform, providing suggestions to community curators.[32]
  • FlyBase sends email requests to authors of new publications,[34] inviting them to list the genes and data types described via an online tool and has also mobilized the community to write gene summary paragraphs.[35]

Other databases, such as PomBase, rely on publication authors to submit highly detailed, ontology-based annotations for their publications, and meta-data associated with genome-wide data-sets using controlled vocabularies. A web-based tool Canto;[36] was developed to facilitate community submissions. Since Canto is freely available, generic and highly configurable, it has been adopted by other projects.[37] Curation is subjected to review by professional curators resulting in high quality in-depth curation of all molecular data-types.[38]

The widely used UniProt knowledgebase has also a community curation mechanism that allows researchers to add information about proteins.[39]

Wiki-style resources

Bio-wikis rely on their communities to provide content and a series of wiki-style resources are available for biocuration.[40][41] AuthorReward,[42] for example, is an extension to MediaWiki that quantifies researchers' contributions to biology wikis. RiceWiki was an example of a wiki-based database for community curation of rice genes equipped with AuthorReward.[43][44] CAZypedia is another such wiki for community biocuration of information on carbohydrate-active enzymes (CAZys).[45]

The WikiProteins/WikiProfessional was a project to semantically organize biological data led by Barend Mons.[46][47] The 2007 project had direct contributions of Jimmy Wales, Wikipedia co-founder, and took Wikidata as an inspiration.[46] A currently active project that runs on an adaptation of mediawiki software is WikiPathways, which crowdsources information about biological pathways.[48]

Wikipedia

There is some overlap between the work of biocurators and Wikipedia, with boundaries between scientific databases and Wikipedia becoming increasingly blurred.[49][41][50] Databases like Rfam[51][52] and the Protein Data Bank[53] for example make heavy use of Wikipedia and its editors to curate information.[54][55] However, most databases offer highly structured data that is searchable in complex combinations, which is usually not possible on Wikipedia, although Wikidata aims at solving this problem to some extent.

The Gene Wiki project used Wikipedia for collaborative curation of thousands of genes and gene products, such as titin and insulin.[56] Several projects also employ Wikipedia as a platform for curation of medical information.[31]

One other way that Wikipedia is used for biocuration is via its list articles. For example, the Comprehensive Antibiotic Resistance Database integrates its assessment of databases about antibiotic resistance to a particular Wikipedia list.[57]

Wikidata

The Wikimedia knowledge base Wikidata is increasingly being used by the biocuration community as an integrative repository across life sciences.[58] Wikidata is being seen by some as an alternative with better prospects of maintenance and interoperability than smaller independent biological knowledge bases.[59][60]

Wikidata has been used to curate information on SARS-CoV-2 and the COVID-19 pandemic[61][62] and by the Gene Wiki project to curate information about genes.[63] Data from biocuration on Wikidata is reused on external resources via SPARQL queries.[64] Some projects use curation via Wikidata as a path to improve life-sciences information on Wikipedia.[65]

Gamified resources

An approach to involve the crowd in biocuration is via gamified platforms that use game design principles to boost engagement. A few examples are:

  • Mark2Cure, a gamified platform for community curation of biomedical abstracts[66][67][68]
  • Cochrane Crowd,[69] a platform by Cochrane for curation of clinical trials and to categorize and summarize biomedical literature.[70]
  • CIViC, a portal for annotation of genomic variants related to cancer[71] which tracks scores and keeps leaderboards.[72]
  • APICURON, a database to credit and acknowledge the work of biocurators, that collects and aggregates biocuration events from third party resources and generates achievements and leaderboards. [73]

Computational text mining for curation

Example of extraction of a biomedical statement from unstructured language [74]

Natural-language processing and text mining technologies can help biocurators to extract of information for manual curation.[75] Text mining can scale curation efforts, supporting the identification of gene names, for example, as well as for partially inferring ontologies.[76][77] The conversion of unstructured assertions to structured information makes use of techniques like named entity recognition and parsing of dependencies.[78] Text-mining of biomedical concepts faces challenges regarding variations in reporting, and the community is working to increase the machine-readability of articles.[79]

During the COVID-19 pandemic, biomedical text mining was heavily used to cope with the large amount of published scientific research about the topic (over 50.000 articles).[80]

The popular NLP python package SpaCy has a modification for biomedical texts, SciSpaCy, which is maintained by the Allen Institute for AI.[81]

Among the challenges for text-mining applied to biocuration is the difficulty of accessing full texts of biomedical articles due to pay wall, linking the challenges of biocuration to those of the open-access movement.[82]

A complementary approach to biocuration via text mining involves applying optical character recognition to biomedical figures, coupled to automatic annotation algorithms. This has been used to extract gene information from pathway figures, for example.[83]

Suggestions to improve the written text to facilitate annotations range from using controlled natural languages[84] to providing clear association of concepts (such as genes and proteins) with the particular species of interest.[84]

While challenges remain, text-mining is already an integral part of the workflow of biocuration in several biological knowledgebases.[85]

Biocreative challenges

Main page: BioCreative

The BioCreAtivE (Critical Assessment of Information Extraction systems in Biology) Challenge is a community-wide effort to develop and evaluate text mining and information extraction systems for the life sciences. The challenge was first launched in 2004 and has since become an important event in the biocuration and bioinformatics communities. [86] The main goal of the challenge is to foster the development of advanced computational tools that can effectively extract information from the vast amount of biological data available.

Typical pipeline for biological curation[86]

The BioCreative Challenge is organized into several subtasks that cover various aspects of text mining and information extraction in the life sciences. These subtasks include gene normalization, relation extraction, entity recognition, and document classification. Participants in the challenge are provided with a set of annotated data to develop and test their systems, and their performance is evaluated based on various metrics, such as precision, recall, and F-score.[86]

The BioCreative Challenge has led to the development of many innovative text mining and information extraction systems that have greatly improved the efficiency and accuracy of biocuration efforts. These systems have been integrated into many biocuration pipelines and have helped to speed up the curation process and enhance the quality of curated data.

See also

References

  1. 1.0 1.1 "What is biocuration? | International Society for Biocuration". https://www.biocuration.org/dissemination/who-are-we/. 
  2. "Big data: The future of biocuration". Nature 455 (7209): 47–50. September 2008. doi:10.1038/455047a. PMID 18769432. Bibcode2008Natur.455...47H. 
  3. "Biocurators and biocuration: surveying the 21st century challenges". Database 2012: bar059. 2012-03-20. doi:10.1093/database/bar059. PMID 22434828. 
  4. 4.0 4.1 "Curators of the world unite: the International Society of Biocuration". Bioinformatics 26 (8): 991. April 2010. doi:10.1093/bioinformatics/btq101. PMID 20305270. 
  5. "Biocurators: contributors to the world of science". PLOS Computational Biology 2 (10): e142. October 2006. doi:10.1371/journal.pcbi.0020142. PMID 17411327. Bibcode2006PLSCB...2..142B. 
  6. 6.0 6.1 "The biocurator: connecting and enhancing scientific data". PLOS Computational Biology 2 (10): e125. October 2006. doi:10.1371/journal.pcbi.0020125. PMID 17069454. Bibcode2006PLSCB...2..125S. 
  7. Biocuration, International Society for (2018-04-16). "Biocuration: Distilling data into knowledge." (in English). PLOS Biology 16 (4): e2002846. doi:10.1371/JOURNAL.PBIO.2002846. PMID 29659566. PMC 5919672. https://www.wikidata.org/wiki/Q52586099. 
  8. "GOBLET | The Global Organisation for Bioinformatics Learning, Education & Training" (in en-US). https://www.mygoblet.org/. 
  9.  , Wikidata Q101217428
  10. EMBL-EBI. "Biocuration | EMBL-EBI Training" (in en). https://www.ebi.ac.uk/training/online/courses/biocuration-collection/. 
  11. Sanderson, Katharine (February 2011). "Bioinformatics: Curation generation" (in en). Nature 470 (7333): 295–296. doi:10.1038/nj7333-295a. ISSN 1476-4687. PMID 21348148. 
  12. Anonymous (2019-10-30). "Postgraduate Certificate in Biocuration" (in en). https://www.ice.cam.ac.uk/course/postgraduate-certificate-biocuration. 
  13. "Ten quick tips for biocuration". PLOS Computational Biology 15 (5): e1006906. May 2019. doi:10.1371/journal.pcbi.1006906. PMID 31048830. Bibcode2019PLSCB..15E6906T. 
  14. Harper, Lisa; Campbell, Jacqueline D.; Cannon, Ethalinda K. S.; Jung, Sook; Poelchau, Monica F.; Walls, Ramona L.; Andorf, Carson M.; Arnaud, Elizabeth et al. (2018-01-01). "AgBioData consortium recommendations for sustainable genomics and genetics databases for agriculture" (in English). Database 2018: 1–32. doi:10.1093/DATABASE/BAY088. PMID 30239679. PMC 6146126. https://www.wikidata.org/wiki/Q56655129. 
  15. "Biocurator - ClinGen | Clinical Genome Resource". https://www.clinicalgenome.org/working-groups/biocurators/. 
  16. "UniProt: the universal protein knowledgebase". Nucleic Acids Research 45 (D1): D158–D169. 2016-11-29. doi:10.1093/nar/gkw1099. ISSN 0305-1048. PMID 27899622. PMC 5210571. http://dx.doi.org/10.1093/nar/gkw1099. 
  17. Berman, Helen M.; Westbrook, J.; Feng, Z.; Gilliland, G.; Bhat, T. N.; Weissig, H.; Shindyalov, Ilya; Bourne, Philip (2000-01-01). "The Protein Data Bank" (in English). Nucleic Acids Research 28 (1): 235–242. doi:10.1093/NAR/28.1.235. PMID 10592235. PMC 102472. https://www.wikidata.org/wiki/Q24515306. 
  18. Chen, Qingyu; Britto, Ramona; Erill, Ivan; Jeffery, Constance J.; Liberzon, Arthur; Magrane, Michele; Onami, Jun-Ichi; Robinson-Rechavi, Marc et al. (2020-07-08). "Quality Matters: Biocuration Experts on the Impact of Duplication and Other Data Quality Issues in Biological Databases" (in English). Genomics Proteomics and Bioinformatics 18 (2): 91–103. doi:10.1016/J.GPB.2018.11.006. PMID 32652120. PMC 7646089. https://www.wikidata.org/wiki/Q97537095. 
  19. Flybase, Consortium (1998-01-01). "FlyBase: a Drosophila database. Flybase Consortium". Nucleic Acids Research 26 (1): 85–88. doi:10.1093/nar/26.1.85. ISSN 1362-4962. PMID 9399806. PMC 147222. http://dx.doi.org/10.1093/nar/26.1.85. 
  20. Lock, Antonia; Rutherford, Kim; Harris, Midori A; Hayles, Jacqueline; Oliver, Stephen G; Bähler, Jürg; Wood, Valerie (2018-10-13). "PomBase 2018: user-driven reimplementation of the fission yeast database provides rapid and intuitive access to diverse, interconnected information". Nucleic Acids Research 47 (D1): D821–D827. doi:10.1093/nar/gky961. ISSN 0305-1048. PMID 30321395. PMC 6324063. http://dx.doi.org/10.1093/nar/gky961. 
  21. Ruzicka, Leyla; Howe, Douglas G.; Ramachandran, Sridhar; Toro, Sabrina; Slyke, Ceri E. Van; Bradford, Yvonne M.; Eagle, Anne; Fashena, David et al. (2019-01-01). "The Zebrafish Information Network: new support for non-coding genes, richer Gene Ontology annotations and the Alliance of Genome Resources" (in English). Nucleic Acids Research 47 (D1): D867–D873. doi:10.1093/NAR/GKY1090. PMID 30407545. PMC 6323962. https://www.wikidata.org/wiki/Q58587083. 
  22. "Ten Simple Rules for Selecting a Bio-ontology". PLOS Computational Biology 12 (2): e1004743. February 2016. doi:10.1371/journal.pcbi.1004743. PMID 26867217. Bibcode2016PLSCB..12E4743M. 
  23. "The Unified Medical Language System (UMLS): integrating biomedical terminology". Nucleic Acids Research 32 (Database issue): D267-70. January 2004. doi:10.1093/nar/gkh061. PMID 14681409. 
  24. "Identifiers for the 21st century: How to design, provision, and reuse persistent identifiers to maximize utility and impact of life science data". PLOS Biology 15 (6): e2001414. June 2017. doi:10.1371/journal.pbio.2001414. PMID 28662064. 
  25. "Which gene did you mean?". BMC Bioinformatics 6 (1): 142. June 2005. doi:10.1186/1471-2105-6-142. PMID 15941477. 
  26. "SciLite: a platform for displaying text-mined annotations as a means to link research articles with biological data". Wellcome Open Research 1: 25. 2016-12-12. doi:10.12688/wellcomeopenres.10210.1. PMID 28948232. 
  27. "PubTator central: automated concept annotation for biomedical full text articles". Nucleic Acids Research 47 (W1): W587–W593. July 2019. doi:10.1093/nar/gkz389. PMID 31114887. 
  28. "ezTag: tagging biomedical concepts via interactive learning". Nucleic Acids Research 46 (W1): W523–W529. July 2018. doi:10.1093/nar/gky428. PMID 29788413. 
  29. Landsman, D.; Gentleman, R.; Kelso, J.; Francis Ouellette, B. F. (2010-01-05). "DATABASE: A new forum for biological databases and curation". Database 2009: bap002. doi:10.1093/database/bap002. ISSN 1758-0463. PMID 20157475. PMC 2790300. http://dx.doi.org/10.1093/database/bap002. 
  30. Naithani, Sushma; Gupta, Parul; Preece, Justin; Garg, Priyanka; Fraser, Valerie; Padgitt-Cobb, Lillian K; Martin, Matthew; Vining, Kelly et al. (2019-01-01). "Involving community in genes and pathway curation". Database 2019. doi:10.1093/database/bay146. ISSN 1758-0463. PMID 30649295. PMC 6334007. http://dx.doi.org/10.1093/database/bay146. 
  31. 31.0 31.1  , Wikidata Q85632863
  32. 32.0 32.1 "Text mining meets community curation: a newly designed curation platform to improve author experience and participation at WormBase". Database 2020. January 2020. doi:10.1093/database/baaa006. PMID 32185395. 
  33. "WormBase 2017: molting into a new stage". Nucleic Acids Research 46 (D1): D869–D874. January 2018. doi:10.1093/nar/gkx998. PMID 29069413. 
  34. "Directly e-mailing authors of newly published papers encourages community curation". Database 2012: bas024. 2012. doi:10.1093/database/bas024. PMID 22554788. 
  35. "Building a pipeline to solicit expert knowledge from the community to aid gene summary curation". Database 2020. January 2020. doi:10.1093/database/baz152. PMID 31960022. 
  36. "Canto: an online tool for community literature curation". Bioinformatics 30 (12): 1791–2. June 2014. doi:10.1093/bioinformatics/btu103. PMID 24574118. 
  37. "pombase/canto". PomBase. 25 September 2020. https://github.com/pombase/canto. 
  38. "Community curation in PomBase: enabling fission yeast experts to provide detailed, standardized, sharable annotation from research publications". Database 2020. January 2020. doi:10.1093/database/baaa028. PMID 32353878. 
  39. "UniProt: the universal protein knowledgebase". Nucleic Acids Research 45 (D1): D158–D169. 2016-11-29. doi:10.1093/nar/gkw1099. ISSN 0305-1048. PMID 27899622. 
  40. Khare, Ritu; Good, Benjamin M.; Leaman, Robert; Su, Andrew I.; Lu, Zhiyong (2016-01-01). "Crowdsourcing in biomedicine: challenges and opportunities" (in English). Briefings in Bioinformatics 17 (1): 23–32. doi:10.1093/BIB/BBV021. PMID 25888696. PMC 4719068. https://www.wikidata.org/wiki/Q19857267. 
  41. 41.0 41.1 "Making your database available through Wikipedia: the pros and cons". Nucleic Acids Research 40 (Database issue): D9-12. January 2012. doi:10.1093/nar/gkr1195. PMID 22144683. 
  42. "AuthorReward: increasing community curation in biological knowledge wikis through automated authorship quantification". Bioinformatics 29 (14): 1837–9. July 2013. doi:10.1093/bioinformatics/btt284. PMID 23732274. 
  43. "RiceWiki: a wiki-based database for community curation of rice genes". Nucleic Acids Research 42 (Database issue): D1222-8. January 2014. doi:10.1093/nar/gkt926. PMID 24136999. 
  44. "Os01g0883800 - RiceWiki". 2017-10-20. http://ricewiki.big.ac.cn/index.php/Os01g0883800. 
  45. Consortium, CAZypedia (2017-10-11). "Ten years of CAZypedia: a living encyclopedia of carbohydrate-active enzymes.". Glycobiology 28 (1): 3–8. doi:10.1093/GLYCOB/CWX089. PMID 29040563. 
  46. 46.0 46.1 "Calling on a million minds for community annotation in WikiProteins". Genome Biology 9 (5): R89. 2008-05-28. doi:10.1186/gb-2008-9-5-r89. PMID 18507872. 
  47. "Key biology databases go wiki". Nature 445 (7129): 691. February 2007. doi:10.1038/445691a. PMID 17301755. Bibcode2007Natur.445..691G. 
  48. "WikiPathways - WikiPathways". https://www.wikipathways.org/index.php/WikiPathways. 
  49. "Topic pages: PLOS Computational Biology meets Wikipedia". PLOS Computational Biology 8 (3): e1002446. 2012. doi:10.1371/journal.pcbi.1002446. PMID 22479174. Bibcode2012PLSCB...8E2446W. 
  50. "Linking NCBI to Wikipedia: a wiki-based approach". PLOS Currents 3: RRN1228. March 2011. doi:10.1371/currents.RRN1228. PMID 21516242. 
  51. "Rfam: Wikipedia, clans and the "decimal" release". Nucleic Acids Research 39 (Database issue): D141-5. January 2011. doi:10.1093/nar/gkq1129. PMID 21062808. 
  52. "The RNA WikiProject: community annotation of RNA families". RNA 14 (12): 2462–4. December 2008. doi:10.1261/rna.1200508. PMID 18945806. 
  53. "A biocurator perspective: annotation at the Research Collaboratory for Structural Bioinformatics Protein Data Bank". PLOS Computational Biology 2 (10): e99. October 2006. doi:10.1371/journal.pcbi.0020099. PMID 17069453. Bibcode2006PLSCB...2...99B. 
  54. "Ten simple rules for editing Wikipedia". PLOS Computational Biology 6 (9): e1000941. September 2010. doi:10.1371/journal.pcbi.1000941. PMID 20941386. Bibcode2010PLSCB...6E0941L.  open access
  55. "Publish in Wikipedia or perish: Journal to require authors to post in the free online encyclopaedia". Nature. 2008. doi:10.1038/news.2008.1312. 
  56. "The Gene Wiki: community intelligence applied to human gene annotation". Nucleic Acids Research 38 (Database issue): D633-9. January 2010. doi:10.1093/nar/gkp760. PMID 19755503. 
  57. Alcock, Brian P.; Raphenya, Amogelang R.; Lau, Tammy T. Y.; Tsang, Kara K.; Bouchard, Mégane; Edalatmand, Arman; Huynh, William; Nguyen, Anna-Lisa V. et al. (2020-01-01). "CARD 2020: antibiotic resistome surveillance with the comprehensive antibiotic resistance database" (in English). Nucleic Acids Research 48 (D1): D517–D525. doi:10.1093/NAR/GKZ935. PMID 31665441. PMC 7145624. https://www.wikidata.org/wiki/Q91006744. 
  58. "Wikidata as a knowledge graph for the life sciences". eLife 9: e52614. March 2020. doi:10.7554/eLife.52614. PMID 32180547. 
  59. Rutz, Adriano; Sorokina, Maria; Galgonek, Jakub; Mietchen, Daniel; Willighagen, Egon; Gaudry, Arnaud; Graham, James G; Stephan, Ralf et al. (26 May 2022). "The LOTUS initiative for open knowledge management in natural products research". eLife 11: e70780. doi:10.7554/eLife.70780. PMID 35616633. 
  60. Rutz, Adriano; Sorokina, Maria; Galgonek, Jakub; Mietchen, Daniel; Willighagen, Egon; Gaudry, Arnaud; Graham, James G.; Stephan, Ralf; Page, Roderic; Vondrášek, Jiří; Steinbeck, Christoph; Pauli, Guido F.; Wolfender, Jean-Luc; Bisson, Jonathan; Allard, Pierre-Marie (24 December 2021). "The LOTUS Initiative for Open Natural Products Research: Knowledge Management through Wikidata". pp. 2021.02.28.433265. bioRxiv 10.1101/2021.02.28.433265.
  61. Turki, Houcemeddine; Taieb, Mohamed Ali Hadj; Shafee, Thomas; Lubiana, Tiago; Jemielniak, Dariusz; Aouicha, Mohamed Ben; Gayo, José Emilio Labra; Youngstrom, Eric et al. (2021-02-18). "Representing COVID-19 information in collaborative knowledge graphs: the case of Wikidata". in Haller, Armin. http://www.semantic-web-journal.net/system/files/swj2736.pdf. 
  62. Waagmeester, Andra; Willighagen, Egon L.; Su, Andrew I.; Kutmon, Martina; Gayo, Jose Emilio Labra; Fernández-Álvarez, Daniel; Groom, Quentin; Schaap, Peter J. et al. (2021-01-22). "A protocol for adding knowledge to Wikidata: aligning resources on human coronaviruses". BMC Biology 19 (1): 12. doi:10.1186/s12915-020-00940-y. ISSN 1741-7007. PMID 33482803. 
  63. "Wikidata as a semantic framework for the Gene Wiki initiative". Database 2016: baw015. 2016. doi:10.1093/database/baw015. PMID 26989148. 
  64. Willighagen, Egon; Martens, Marvin; Yasunori; Lubiana, Tiago; Nunogit; Mietchen, Daniel; Addshore (2020-08-09), egonw/SARS-CoV-2-Queries: Edition 1, doi:10.5281/zenodo.3977414, https://zenodo.org/record/3977414, retrieved 2021-04-14 
  65.  , Wikidata Q21503276
  66. "Citizen Science for Mining the Biomedical Literature". Citizen Science 1 (2): 14. 2016-12-31. doi:10.5334/cstp.56. PMID 30416754. 
  67. "Applying citizen science to gene, drug and disease relationship extraction from biomedical abstracts". Bioinformatics 36 (4): 1226–1233. February 2020. doi:10.1093/bioinformatics/btz678. PMID 31504205. 
  68. "Play Mark2Cure, help identify key terms in biomedical research abstracts" (in en-US). https://citizensciencegames.com/games/mark2cure/. 
  69. "Cochrane Crowd". https://crowd.cochrane.org/. 
  70. "Single-reviewer abstract screening missed 13 percent of relevant studies: a crowd-based, randomized controlled trial". Journal of Clinical Epidemiology 121: 20–28. May 2020. doi:10.1016/j.jclinepi.2020.01.005. PMID 31972274. 
  71. Griffith, Malachi; Spies, Nicholas C; Krysiak, Kilannin; McMichael, Joshua F; Coffman, Adam C; Danos, Arpad M; Ainscough, Benjamin J; Ramirez, Cody A et al. (2017-01-31). "CIViC is a community knowledgebase for expert crowdsourcing the clinical interpretation of variants in cancer". Nature Genetics 49 (2): 170–174. doi:10.1038/ng.3774. ISSN 1061-4036. PMID 28138153. PMC 5367263. http://dx.doi.org/10.1038/ng.3774. 
  72. "CIViC - Clinical Interpretation of Variants in Cancer". https://civicdb.org/community/main. 
  73. Hatos, András; Quaglia, Federica; Piovesan, Damiano; Tosatto, Silvio C. E. (2021-04-21). "APICURON: a database to credit and acknowledge the work of biocurators". Database: The Journal of Biological Databases and Curation 2021: baab019. doi:10.1093/database/baab019. ISSN 1758-0463. PMID 33882120. 
  74. Percha, Bethany; Altman, Russ B. (2018-08-01). "A global network of biomedical relationships derived from text" (in en). Bioinformatics 34 (15): 2614–2624. doi:10.1093/bioinformatics/bty114. ISSN 1367-4803. PMID 29490008. PMC 6061699. https://academic.oup.com/bioinformatics/article/34/15/2614/4911883. 
  75. "Text mining for the biocuration workflow". Database 2012: bas020. 2012. doi:10.1093/database/bas020. PMID 22513129. 
  76. Ananiadou, Sophia; Kell, Douglas B.; Tsujii, Jun-ichi (December 2006). "Text mining and its potential applications in systems biology". Trends in Biotechnology 24 (12): 571–579. doi:10.1016/j.tibtech.2006.10.002. ISSN 0167-7799. PMID 17045684. http://dx.doi.org/10.1016/j.tibtech.2006.10.002. 
  77. Winnenburg, R.; Wachter, T.; Plake, C.; Doms, A.; Schroeder, M. (2008-07-11). "Facts from text: can text mining help to scale-up high-quality manual curation of gene products with ontologies?" (in en). Briefings in Bioinformatics 9 (6): 466–478. doi:10.1093/bib/bbn043. ISSN 1467-5463. PMID 19060303. 
  78. Percha, Bethany; Altman, Russ (2018-02-27). "A global network of biomedical relationships derived from text." (in English). Bioinformatics 34 (15): 2614–2624. doi:10.1093/BIOINFORMATICS/BTY114. PMID 29490008. PMC 6061699. https://www.wikidata.org/wiki/Q52681328. 
  79.  , Wikidata Q96032351
  80. Wang, Lucy Lu; Lo, Kyle (2020-12-07). "Text mining approaches for dealing with the rapidly expanding literature on COVID-19". Briefings in Bioinformatics 22 (2): 781–799. doi:10.1093/BIB/BBAA296. PMID 33279995. PMC 7799291. https://www.wikidata.org/wiki/Q104079663. 
  81. "ScispaCy: Fast and Robust Models for Biomedical Natural Language Processing" (in en). Proceedings of the 18th BioNLP Workshop and Shared Task (Florence, Italy: Association for Computational Linguistics): 319–327. 2019. doi:10.18653/v1/W19-5034. https://www.aclweb.org/anthology/W19-5034. 
  82. "Text mining for biology--the way forward: opinions from leading scientists". Genome Biology 9 (Suppl 2): S7. 2008. doi:10.1186/gb-2008-9-s2-s7. PMID 18834498. 
  83. Hanspers, Kristina; Riutta, Anders; Summer-Kutmon, Martina; Pico, Alexander R. (2020-11-09). "Pathway information extracted from 25 years of pathway figures". Genome Biology 21 (1): 273. doi:10.1186/S13059-020-02181-2. PMID 33168034. PMC 7649569. https://www.wikidata.org/wiki/Q101473819. 
  84. 84.0 84.1 Kuhn, Tobias; Royer, Loïc; Fuchs, Norbert E.; Schröder, Michael (2006-01-01). "Improving Text Mining with Controlled Natural Language: A Case Study for Protein Interactions" (in English). Data Integration in the Life Sciences. Lecture Notes in Computer Science. 4075. pp. 66–81. doi:10.1007/11799511_7. ISBN 978-3-540-36593-8. https://www.wikidata.org/wiki/Q57402195. 
  85. Singhal, Ayush; Leaman, Robert; Catlett, Natalie; Lemberger, Thomas; McEntyre, Johanna; Polson, Shawn; Xenarios, Ioannis; Arighi, Cecilia et al. (2016). "Pressing needs of biomedical text mining in biocuration and beyond: opportunities and challenges". Database 2016: baw161. doi:10.1093/database/baw161. ISSN 1758-0463. PMID 28025348. PMC 5199160. http://dx.doi.org/10.1093/database/baw161. 
  86. 86.0 86.1 86.2 "Overview of BioCreAtIvE: critical assessment of information extraction for biology". BMC Bioinformatics 6 (Suppl 1): S1. 2005. doi:10.1186/1471-2105-6-s1-s1. PMID 15960821. 

External links