Red Hat acquires Neural Magic to boost generative AI in the hybrid cloud

Red Hat (owned by IBM) has made a major acquisition in its growing commitment to dominance of the Artificial Intelligence (AI) generative. The multinational, known for its focus on open source solutions, has announced the acquisition of Neural Magic, a startup specializing in the optimization and acceleration of generative AI inference workloads. This strategic move is key to strengthening its offering in the development of AI focused on the hybrid cloud.

The acquisition of Neural Magic, founded in 2018 as a spin-off of the prestigious MIT (Massachusetts Institute of Technology), reinforces the position of Red Hat in the generative AI sector, a field that has grown exponentially in recent years. Neural Magic is known for its ability in developing optimization algorithms and software that improves the inference performance of large language models (LLMs). These advances allow companies to process large amounts of data more efficiently and with lower resource consumption.

Neural Magic: Pioneer in Generative AI Optimization

Since its inception, Neural Magic has developed solutions that accelerate inference workloads, a key aspect for the deployment of AI in the hybrid cloudThe company has distinguished itself for its ability to adapt generative AI technologies through open source, a vision that aligns perfectly with Red Hat’s strategy.

Red Hat's acquisition of Neural Magic will allow the latter to expand its capabilities in the hybrid cloud, an infrastructure that combines the best of the public and private cloud, offering flexibility to companies so they can optimize their operations based on their specific needs.

With this acquisition, Red Hat is expected to not only strengthen its product portfolio, but also continue its mission of Democratizing access to generative AI. This will be achieved through the integration of solutions based on open source that facilitate the customization and adaptation of LLMs to different infrastructures and business environments.

The vLLM project and open innovation

A highlight of the operation is the project vLLM, developed by researchers at the University of California at Berkeley. This platform, which is a core part of Neural Magic solutions, is dedicated to improving language models by optimizing inference processes. With vLLM it is possible to run generative AI models on a wide range of hardware, including GPUs from AMD, Nvidia, TPUs of Google, and x86 CPUs, among others.

The interesting thing about this acquisition is that Neural Magic Red Hat has implemented significant enhancements to the vLLM project, which will enable Red Hat to deliver more efficient and optimized solutions to its customers. This translates into an increased ability to deploy language models and AI algorithms on hybrid infrastructures, regardless of the location of the data.

In addition, with the integration of this technology, Red Hat seeks reduce energy consumption and improve efficiency in the deployment of AI, a crucial aspect in a global context that demands more sustainable solutions.

A commitment to open and efficient AI

This agreement also promotes Red Hat's vision of being not only the benchmark for open source, but also the leader in open AI solutions. As noted by Matt Hicks, president and CEO of Red Hat, AI workloads need to run wherever customer data lives, making flexible and open platforms an imperative.

The technology developed by Neural Magic will allow Red Hat to offer tools that facilitate the selection of the most appropriate infrastructure for each organization, which will help companies continue to advance their strategies. digital transformation.

For its part, Brian stevens, CEO of Neural Magic, highlights that the union with Red Hat is a great opportunity to continue advancing in its mission of offering multiplatform and ultra-efficient inference solutions. This collaboration will also benefit both large companies and startups in their journey towards transformation through AI.

A bright future for hybrid cloud and AI

With the acquisition of Neural MagicRed Hat is positioning itself as a key player in the generative AI ecosystem, offering solutions ranging from model optimization to deployment in hybrid environments. Companies will be able to benefit from Red Hat's ability to deploy efficient, scalable, and secure AI, ensuring that AI models fit their specific needs.

The hybrid cloud approach, coupled with support for open technologies, ensures that organizations have complete control over their infrastructure, security policies and model lifecycle – especially important in industrial and government sectors that require high levels of data protection.

Furthermore, the fact that Neural Magic is contributing to the vLLM project shows the commitment of both companies to continue innovating in a field as changing as generative AI.

With this operation, Red Hat demonstrates its commitment to continue leading in the field of Generative AI, offering its clients solutions that are not only efficient, but also flexible and customizable, staying true to its philosophy of open source and community collaboration.