Nutanix has unveiled the Nutanix GPT-in-a-Box solution, catering to customers eager to embark on their Artificial Intelligence (AI) and machine learning (ML) journey while maintaining full control over their data.
The offering presents a software-defined AI-ready platform, accompanied by comprehensive services aimed at aiding organizations in sizing and configuring hardware and software infrastructure appropriate for deploying a curated selection of large language models (LLMs) using top-tier open source AI and MLOps frameworks on the Nutanix Cloud Platform. This novel solution facilitates the procurement of AI-ready infrastructure to effectively fine-tune and operate generative pre-trained transformers (GPT), including LLMs either at the edge or within their own data centers.
Greg Macatee, Senior Research Analyst at IDC’s Infrastructure Systems, Platforms and Technologies Group, commented on the significance of Nutanix’s innovation: “With GPT-in-a-Box, Nutanix offers customers a turnkey, easy-to-use solution for their AI use cases, offering enterprises struggling with generative AI adoption an easier on-ramp to deployment.”
The Nutanix GPT-in-a-Box solution empowers organizations with readily available, customer-controlled AI infrastructure that can be situated at the edge or the core data center. This solution allows users to both execute and fine-tune AI and GPT models, all the while retaining full control over their invaluable data. Nutanix also offers a comprehensive suite of security and data protection mechanisms, particularly suitable for safeguarding AI-related data.
Thomas Cornely, SVP of Product Management at Nutanix, described the solution as an “opinionated AI-ready stack that aims to solve the key challenges with generative AI adoption and help jump-start AI innovation.”
The comprehensive Nutanix GPT-in-a-Box solution encompasses:
The Nutanix Cloud Infrastructure platform, incorporating Nutanix Files Storage and Objects Storage solutions, Nutanix AHV hypervisor and Kubernetes, coupled with NVIDIA GPU acceleration, scalable to cater to both large and small scales.
Nutanix services that aid customers in accurately sizing their clusters and deploying a comprehensive stack featuring prominent open source deep learning and MLOps frameworks, inference servers, and a curated array of large language models such as Llama2, Falcon, and MPT.
The capacity for data scientists and ML administrators to promptly employ these models through a selection of applications, an enhanced terminal UI, or standard CLI interfaces.
The platform’s adaptability to host and fine-tune various GPT models, utilizing internal data hosted on the inclusive Nutanix Files or Objects Storage services.
Jon Cosson, Chief Information Security Officer at JM Finn, emphasized the importance of maintaining data control in AI deployment: “Leveraging AI to more efficiently and effectively help our customers is a top priority for us but, as a regulated financial services organization, maintaining full control over our data is necessary. The Nutanix Cloud Platform delivers the performance, flexibility, and security required to safely deploy AI workloads.”
Recent surveys conducted by Nutanix show that a significant 78 percent of their customers expressed intent to operate their AI/ML workloads on the Nutanix Cloud Platform.
Nutanix’s introduction of GPT-in-a-Box showcases their commitment to providing organizations with a seamless and controlled pathway to AI and ML innovation, further solidifying their position in the rapidly evolving tech landscape.
