“In health care, everyone is talking about these models. GatorTron and GatorTronGPT are unique AI models that can power many aspects of medical research and health care. Yet, they require massive data and extensive computing power to build. We are grateful to have this supercomputer, HiPerGator, from NVIDIA to explore the potential of AI in healthcare,” Wu said.
For this research, published in the journal npj Digital Medicine, the team developed a large language model that allows computers to mimic natural human language.These models work well with standard writing or conversations, but medical records bring additional hurdles, such as needing to protect patients’ privacy and being highly technical.
Advertisement
Digital medical records cannot be Googled or shared on Wikipedia. To overcome these obstacles, the researchers used health medical records of two million patients while keeping 82 billion useful medical words.Combining this set with another dataset of 195 billion words, they trained the GatorTronGPT model to analyse the medical data with GPT-3 architecture, or Generative Pre-trained Transformer, a form of neural network architecture.
Of the many possible uses for a medical GPT, one idea involves replacing the tedium of documentation with notes recorded and transcribed by AI. For an AI tool to reach such parity with human writing, programmers spend weeks programming supercomputers with clinical vocabulary and language usage based on billions upon billions of words.
Source: IANS
