Resources for books by Jules Berman

<body bgcolor="#ffffff" text="#000000" link="#ff0000" vlink="#0000ff" alink="#00ff00"> <br> <center> <a href="http://www.julesberman.info/figs/all_book.htm"> <IMG width="50%" alt="Books by Jules J. Berman, covers" SRC="http://www.julesberman.info/figs/bookthmb.jpg"> </a> </center> <br> <ul> <li><b>Author Information</b> <br> <ul> <li>Contact <a href="mailto:jjberman@alum.mit.edu"><b>Jules J. Berman</b></a> by email. <br> <li><a href="http://www.julesberman.info/pubs.htm"><b>Publications</b></a> of Jules J. Berman.  <br> <li>Jules J. Berman's <a href="http://julesberman.blogspot.com"><b>blog.</b></a> <br> <br> </ul>  <li>Corrections site for <a href="http://www.julesberman.info/neo2fix.htm"><b>Neoplasms: Principles of Development and Diversity</b></a> <br> <br> <li>Approximately <a href="http://www.julesberman.info/lists.htm"> <b>240 lists</b></a> from<a href="http://www.jbpub.com/catalog/0763741353/"> <b><i>Biomedical Informatics</i></b></a> <br> <br> <li><a href="http://www.julesberman.info/post.htm"><b>Phylogeny (class hierarchy) construction</b></a> for any of over 400,000 organisms. <br> <br> <li><b>White paper: Jules J. Berman and G. William Moore. <a href="http://www.julesberman.info/spec2img.htm"> Implementing an RDF Schema for Pathology Images</a></b>, September 10, 2007. <br> <br> <li><b>Essay on <a href="http://www.julesberman.info/species.htm"> Tumor Speciation</a></b>, February 19, 2009. <br> <br> <li><b>Developmental Lineage Classification and Taxonomy of Neoplasms</b> <br> <br> The Developmental Lineage Classification and Taxonomy of Neoplasms is an open source computer-parsable data set that can be used to organize, collect, merge, share, analyze, understand, develop hypotheses, and test hyposthese, and discover new information related to neoplasia. The classification is used extensively in software projects featured elsewhere on this page. <br> <br> The Developmental Lineage Classification and Taxonomy of Neoplasms is available as a free, open source document available in several different file formats at: <a href="http://www.julesberman.info/devclass.htm">http://www.julesberman.info/devclass.htm</a> <br> <br> The ontology for the The Developmental Lineage Classification and Taxonomy of Neoplasms is illustrated in the schematic below. <br> <br> <center> <a href="http://www.jbpub.com/catalog/0763741353/"> <IMG border="5" alt="biomedical informatics cover" SRC="http://www.julesberman.info/neo1.png"></a> </center> <br> <br> The classification and taxonomy contains about 6,000 classified types of neoplasms and over 130,000 neoplasm names. It is the largest cancer nomenclature in existence. <br> <br> The classification has been used to generate a list of inherited medical conditions that are associated with neoplasms, available at: <br><a href="http://www.julesberman.info/omimneo.htm"> http://www.julesberman.info/omimneo.htm</a> <br> <br> The classification also serves as the dataset underlying a neoplasm search engine that provides synonyms and related terms for phrases entered into a query box. This is available at: <br><a href="http://www.julesberman.info/neoget.htm"> http://www.julesberman.info/neoget.htm</a> <br> <br>  <li><b>Parsable Doublets List</b> <br><br>Word doublets are two-word phrases that appear in text (i.e., they are not randomly chosen two-word sequences.) <br><br>Doublets can be used in a variety of informatics projects: indexing, data scrubbing, nomenclature curation, etc. <br><br>The <a href="http://www.julesberman.info/doublets.htm"> available public domain doublet list </a> was generated from a large narrative pathology text. Thus the doublets included here would be particularly suitable for informatics projects involving surgical pathology reports, autopsy reports, pathology papers and books, and so on. <br> <br> <li><b>De-identifier for confidential medical records.</b> <br><br>A scrubber (deidentification) use-case for the doublets list is <a href="http://www.julesberman.info/pathol5.htm">available</a>. It consists of scrubbed output for over 15000 citations of pathology papers (from PubMed) <br><br>A <a href="http://www.julesberman.info/pathol6.htm">slightly more complex scrubber </a> (deidentification) that preserves punctuation in the original narrative textuse. <br><br>A <a href="http://www.julesberman.info/pathol7.htm"> scrubber </a> (deidentification) that parses a public domain book. <br><br>The scrubber, which is distributed under a GNU license, uses the doublet method (described in all two of my previously published books). It parses through any text, matching doublets from the text against an external identifier-free doublet list, preserving all matching doublets from the text, and blocking all non-matching words with an asterisk. If your list of doublets contains no identifiers, the scrubbed output should be perfectly de-identified. Though perfection can never be guaranteed, I have never encountered any "missed" identifiers in a text that was parsed under these conditions. <br><br>The doublet scrubber is small (just a few dozen lines of code) and fast. It took approximately 2 seconds to parse the 15000 citations using a Perl script with access to a list of about 200,000 identifier-free doublets. I used my home computer (2.8 GHz, 512 MByte RAM). This is a scrubbing rate of 1 MegaByte per second. At this speed, a 1 GByte file could be parsed in about 15 minutes. It can parse a 1 Terabyte file in about a week. Large hospitals produce about 1 Terabyte of data each week, so this scrubber can, for now, "keep up" with the vast load of data produced by many hospital on a modest desktop computer. <br><br>The only limitation that I have found for the doublet scrubber is that it scrubs too much, blocking all doublets not found in the external doublet list. You can be the judge by studying the scrubbed output files: <br><br><a href="http://www.julesberman.info/pathol6.htm"> Over 15000 PubMed Citations, scrubbed </a> <br><br><a href="http://www.julesberman.info/aacom10.htm"> Anomalies and Curiosities of Medcine (scrubbed output) </a> <br><br><li>Medical Autocoding: A <b>Ruby</b> <a href="http://www.julesberman.info/rubycode.htm"> medical autocoder </a>, a <b>Perl</b> <a href="http://www.julesberman.info/coded.htm"> medical autocoder </a> and a <b>Python</b> <a href="http://www.julesberman.info/coded.htm"> medical autocoder.</a> <br><br><li>Prime number generation: A <b>Ruby</b> <a href="http://www.julesberman.info/prime.htm"> prime number generator </a>, a <b>Perl</b> <a href="http://www.julesberman.info/prime.htm"> prime number generator </a> and a <b>Python</b> <a href="http://www.julesberman.info/prime.htm"> prime number generator.</a> <br><br><li>A phylogeny annotator for taxonomy.dat, the European Bioinformatics Institute's 100+ Mbyte list of species, in <a href="http://www.julesberman.info/taxon.htm"> <b>Ruby</b> </a>, <a href="http://www.julesberman.info/taxon.htm"> <b>Perl</b>, </a> and <a href="http://www.julesberman.info/taxon.htm"> <b>Python</b></a>. <br><br><li>A <a href="http://www.julesberman.info/mesh.htm"> MeSH Tree (more precisely MeSH ontology) climber in Perl </a>, which produces a full listing of the term relationships for every entry in MeSH (the U.S. National Library of Medicine's Medical Subject Headings). <br><br><li><a href="http://www.julesberman.info/tu_both.htm">Combined Autocoded and Scrubbed output </a> for 95,260 PubMed Citations (computed in under a minute) <br><br><li>Berman JJ. Nomenclature-based data retrieval without prior annotation: facilitating biomedical data integration with fast doublet matching. <br><a href="http://www.bioinfo.de/isb/2005/05/0029/"><b> In Silico Biology 5, 0029 (2005)</b></a> <br> <br> <li>Approximately 18,000 biomedical <a href="http://www.julesberman.info/factoids/f001.htm"><b>factoids</b></a> (distributed in 180 information pages). <br> <br> <li>Over 12,000 biomedical <a href="http://www.julesberman.info/abbtwo.htm"><b>abbreviations.</b></a> <br> <br> <li><a href="http://www.julesberman.info/chronos.htm"><b>Chronology of Earth</b> </a>(important events in the history of science, medicine, informatics, and society). <br> <br> <li> <a href="http://www.julesberman.info/misspell.htm"> <b>Common misspellings</b></a> in medicine and pathology. <br> <br> <li><a href="http://www.julesberman.info/confused.htm"> <b>Confusing terms</b></a> in medicine and pathology. <br> <br> <li><a href="http://julesberman.blogspot.com"> <b>Specified Life Blog:</b></a> Devoted to the topic of data specification (including data organization, data description, data retrieval and data sharing) in the life sciences and in medicine. <br> <br> <li>Perl script, <a href="http://www.julesberman.info/omim_4.htm"> <b>omim_4.pl</b></a> extracts classified neoplasm terms from OMIM (Online Mendelian Inheritance in Man). Described in Chapter 19, of <a href="http://www.jbpub.com/catalog/9780763743338/"> <i><b>Perl Programming for Medicine and Biology</b></i></a> <br> <br> <li>SEER AND CDC documents <br> <br> <ul> <li>Compilation of age distributions (raw data and graphs) for hundreds of types of cancers, using the SEER (Surveillance Epidemiology End Result) public-use data records: <br><a href="http://www.julesberman.info/seerdist.pdf"><b>PDF document</b></a> <br> <br> <li>Compilations (raw data and graphs) for cancers that have multimodal distributions (two or more peaks in ages of occurrence data) in (Surveillance Epidemiology End Result) public-use data records: <br><a href="http://www.julesberman.info/bimode.pdf"><b>PDF document</b></a> <br> <br> <li>General instructions for acquiring and using the SEER (Surveillance Epidemiology End Result) public-use data records: <br><a href="http://www.julesberman.info/seer2.htm"><b>Web page</b></a> <br> <br> <li>SEER sample projects: <br><a href="http://www.julesberman.info/seerwhbl.htm"><b>Web page</b></a> <br><a href="http://www.julesberman.info/seer_all.htm"><b>Web page</b></a> <br> <br> <li>Tutorial on data analysis techniques and projects for the CDC (Centers for Disease Control and Prevention) public use data sets: <br><a href="http://www.julesberman.info/cdc_ch.pdf"><b>PDF document</b></a> </ul> <br> <li><b>Ruby Scripts</b> <ul> <li>Basics of <a href="http://www.julesberman.info/rubyhome.htm"><b>image display</b></a> in Ruby <li>Using <a href="http://www.julesberman.info/rubyshow.htm"><b>RMagick</b></a>, Ruby's interface to ImageMagick <li>Creating and displaying a <a href="http://www.julesberman.info/rubydisp.htm"><b>simple image</b></a> in Ruby using Tk and RMagick. <li>Extracting and displaying a section of a <a href="http://www.julesberman.info/rubycrop.htm"><b>simple image</b></a> in Ruby using Tk and RMagick. <li><a href="http://www.julesberman.info/taxon.htm"><b>Ruby script</b> </a> extracts a hierarchy for each individual organism listed in taxonomy.dat <li>Ruby script, <a href="http://www.julesberman.info/rubyemb.htm"> <b>embryo.rb</b></a> for building an anatomic hierarchy from an embryological nomenclature <li>Ruby script, <a href="http://www.julesberman.info/coded.htm"> <b>combo.rb</b></a> for autocoding narrative medical text. <li>Another <a href="http://www.julesberman.info/rubycode.htm"><b>Ruby medical autocoder</b></a>. <li>A <a href="http://www.julesberman.info/prime.htm"><b>prime number generator in Ruby</b></a>. <br> </ul> </ul> <br> <center> <a href="http://www.julesberman.info/figs/all_book.htm"> <IMG width = "50%" alt="Books by Jules J. Berman, covers" SRC="http://www.julesberman.info/figs/bookthmb.jpg"> </a> </center> <br> <br> Last modified: October 24, 2009, Jules Berman <br>