Dell and Nvidia speed gen-AI development

  • August 2, 2023
  • Steve Rogerson

Dell Technologies and Nvidia are helping companies quickly and securely build generative AI (gen-AI) models on-premises.

Dell gen-AI expands upon its Project Helix announcement in May, spanning IT infrastructure, PCs and professional services to simplify the adoption of full-stack gen-AI with large language models (LLM). This help organisations of all sizes and across industries securely transform and deliver better outcomes.

“Generative AI represents an inflection point that is driving fundamental change in the pace of innovation while improving the customer experience and enabling new ways to work,” said Jeff Clarke, vice chairman of Dell Technologies. “Customers big and small are using their own data and business context to train, fine-tune and inference on Dell infrastructure to incorporate advanced AI into their core business processes effectively and efficiently.”

Manuvir Das, vice president of Nvidia, added: “Generative AI can help every enterprise transform its data into intelligent applications that enable them to solve complex business challenges. Dell Technologies and Nvidia are building on our long-standing relationship to enable organisations to harness this capability to better serve their customers, more fully support their employees and fuel innovation across their operations.”

With Dell gen-AI, the breadth of Dell’s portfolio, including precision workstations, PowerEdge servers, PowerScale scale-out storage, ECS enterprise object storage and a broad set of services, provide the tools to deliver gen-AI from desktops to core data centres, edge locations and public clouds.

CyberAgent, a Japanese digital advertising company, selected Dell servers as the key IT infrastructure for its gen-AI development and digital advertising.

“We decided to select Dell PowerEdge XE9680 servers equipped with Nvidia H100 GPUs, which are optimised for generative AI applications,” said Daisuke Takahashi from CyberAgent. “In addition, we value the ease of use of the Dell iDrac management tool for secure local and remote server management.”

The Dell validated design for gen-AI is an inferencing blueprint, jointly engineered with Nvidia, optimised to speed the deployment of a modular, secure and scalable platform for gen-AI in the enterprise.

Until now, traditional inferencing approaches have been difficult to scale and support LLMs for real-time results and ensure data can be easily used by AI infrastructure. This offering helps users generate higher quality, faster time-to-value predictions and decisions with their own data.

With a verified inferencing approach, organisations can rapidly deploy gen-AI projects and scale applications to transform processes in key areas, such as customer operations, content creation and management, software development and sales.

Dell validated designs are pre-tested, proven configurations to power gen-AI inferencing efforts with Dell infrastructure, such as the PowerEdge XE9680 or PowerEdge R760xa, with a choice of Nvidia Tensor Core GPUs, AI enterprise software, the NeMo end-to-end framework and Dell software at its core. Users can combine this with resilient and scalable unstructured data storage, including PowerScale and ECS storage. The infrastructure is available via Dell Apex, offering an on-premises deployment with a cloud consumption and management experience.

Dell professional services deliver a broad spectrum of capabilities to help users accelerate gen-AI adoption to improve their operational efficiency and advance innovation.

These services begin with creating a gen-AI strategy that identifies high value use cases and a roadmap to achieve them. Dell also offers full-stack implementation services, based on its validated design for gen-AI, and adoption services that apply the platform to specific use cases, such as operations or content creation. Once integrated into the business, Dell’s scaling services help improve operations through managed services, training or resident experts.

“Dell’s AI offers enterprises the potential to right-size their gen-AI efforts and help streamline operations as customers look to quickly deliver products and services across industry-specific use cases,” said Ashish Nadkarni, group vice president at IDC. “In the era of intelligent automation, Dell is meeting organisations wherever they are in their gen-AI journey, helping them position themselves for success in an increasingly intelligent and technology-driven world.”

Dell workstations can help AI developers and data scientists develop and fine-tune gen-AI models locally before deploying at scale. They provide the performance and reliability with up to four Nvidia RTX 6000 Ada generation GPUs in a single workstation to run AI software frameworks 80% faster than the previous generation.

Dell’s Optimizer built-in AI software learns and responds to the way people work, improving performance across applications, network connectivity and audio. The latest feature helps mobile workstation users leveraging gen-AI models improve performance for the application in-use while reducing impact to battery runtime.

“Our customers are looking to use generative AI in every aspect of their business, from monitoring agent behaviour to detecting fraud,” said James Laird, chief operating officer at Intelligent Voice. “Recent advances in AI combined with the power of Dell’s AI allow us to quickly build, test and deploy high-quality models at the speed our customers require.”