As interest around large AI models \u2014 particularly large language models (LLMs) like OpenAI\u2019s GPT-3 \u2014 grows, Nvidia is looking to cash in with new fully managed, cloud-powered services geared toward enterprise software developers. Today at the company\u2019s fall 2022 GTC conference, Nvidia announced the NeMo LLM Service and BioNeMo LLM Service, which ostensibly make it easier to adapt LLMs and deploy AI-powered apps for a range of use cases including text generation and summarization, protein structure prediction and more.<\/span><\/p>\n The new offerings are a part of Nvidia\u2019s NeMo, an open source toolkit for conversational AI, and they\u2019re designed to minimize \u2014 or even eliminate \u2014 the need for developers to build LLMs from scratch. LLMs are frequently expensive to develop and train, with one recent model \u2014 Google\u2019s PaLM \u2014 costing an estimated $9 million to $23 million leveraging publicly available cloud computing resources.<\/p>\n Using the NeMo LLM Service, developers can create models ranging in size from 3 billion to 530 billion parameters with custom data in minutes to hours, Nvidia claims. (Parameters are the parts of the model learned from historical training data \u2014 in other words, the variables that inform the model\u2019s predictions, like the text it generates.) Models can be customized using a technique called prompt learning, which Nvidia says allows developers to tailor models trained with billions of data points for particular, industry-specific applications \u2014 e.g. a customer service chatbot \u2014 using a few hundred examples.<\/p>\n Developers can customize models for multiple use cases in a no-code \u201cplayground\u201d environment, which also offers features for experimentation. Once ready to deploy, the tuned models can run on cloud instances, on-premises systems or through an API.<\/p>\n The BioNeMo LLM Service is similar to the LLM Service, but with tweaks for life sciences customers. Part of Nvidia\u2019s Clara Discovery platform and soon available in early access on Nvidia GPU Cloud, it includes two language models for chemistry and biology applications as well as support for protein, DNA and chemistry data, Nvidia says.<\/p>\n Visualization of bio processes predicted by AI models.<\/p>\n<\/div>\n BioNeMo LLM will include four pretrained language models to start, including a model from Meta\u2019s AI R&D division, Meta AI Labs, that processes amino acid sequences to generate representations that can be used to predict protein properties and functions. Nvidia says that in the future, researchers using the BioNeMo LLM Service will be able to customize the LLMs for higher accuracy<\/p>\n Recent research has shown that LLMs are remarkably good at predicting certain biological processes. That\u2019s because structures like proteins can be modeled as a sort of language \u2014 one with a dictionary (amino acids) strung together to form a sentence (protein). For example, Salesforce\u2019s R&D division several years ago created an LLM model called ProGen that can generate structurally, functionally viable sequences of proteins.<\/p>\n Both the BioNeMo LLM Service and LLM Service include the option to use ready-made and custom models through a cloud API. Usage of the services also grants customers access to the NeMo Megatron framework, now in open beta, which allows developers to build a range of multilingual LLM models including GPT-3-type language models.<\/p>\n Nvidia says that automotive, computing, education, healthcare and telecommunications brands are currently using NeMo Megatron to launch AI-powered services in Chinese, English, Korean and Swedish.<\/p>\n The NeMo LLM and BioNeMo services and cloud APIs are expected to be available in early access starting next month. As for the NeMo Megatron framework, developers can try it via Nvidia\u2019s LaunchPad piloting platform at no charge.<\/p>\n<\/div>\n","protected":false},"excerpt":{"rendered":" As interest around large AI models \u2014 particularly large language models (LLMs) like OpenAI\u2019s GPT-3 \u2014 grows, Nvidia is looking to cash in with new fully managed, cloud-powered services geared toward enterprise software developers. Today at the company\u2019s fall 2022 GTC conference, Nvidia announced the NeMo LLM Service and BioNeMo LLM Service, which ostensibly make […]<\/p>\n","protected":false},"author":1,"featured_media":1207945,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[21],"tags":[],"class_list":["post-1207944","post","type-post","status-publish","format-standard","has-post-thumbnail","category-celebrity-gossip"],"_links":{"self":[{"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/posts\/1207944","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/comments?post=1207944"}],"version-history":[{"count":0,"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/posts\/1207944\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/media?parent=1207944"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/categories?post=1207944"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.ghanamma.com\/2022\/wp-json\/wp\/v2\/tags?post=1207944"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"Nvidia](\"https:\/\/www.ghanamma.com\/gp\/wp-content\/uploads\/2022\/09\/Large-Language-Models-for-Biology.png\")
<\/p>\n