AMD made available this week its latest IA -oriented project called Gaia. The platform features an app to run LLM locally on any PC, allowing the use of Offline Generative AI, which can be safer and even offer more performance, depending on the user’s hardware.
The Gaia platform is Open Source, so it uses SDK Lemonade for its inference in LLM. In addition, AMD says its AI models can adapt to different purposes by offering a more personalized and accurate experience for each user.
Using an agent for RAG (Retieval-Augmeld Generation), the tool can combine LLM with a knowledge base to help technology contextually prompts. According to Tom’s Hardware, the platform is currently made up of four agents: Simple Prompt Completion, Chaty, Clip and Joker.
Simple Prompt Completion tests and evaluates prompts, Chaty is the platform chatbot that interacts with the user, while the clip serves to search YouTube and offer a feature of questions and answers. Joker, as the name suggests, generates jokes to try to give the robot more personality.
Gaia works on any hardware
One of Gaia’s most interesting parts is that the platform can be used on any build and does not require AMD processors or GPUs. Of course, hardware capacity will impact the final performance of the program, but nothing prevents from installing on an Intel and GPU NVIDIA CPU PC.
Related News:
The platform, however, has an alternative version of hybrid installer (Hybrid), which comes with optimized AMD component settings. This way, this option can be better for those who use Ryzen CPUS AI endowed with NPU.
Gaia installers, both default and hybrid, are available for free download on this Github page, where interested parties also find instructions for their implementation.
Via: Tom’s Hardware
Join the Adrenaline offers group
Check out the main offers of hardware, components and other electronics we find over the internet. Video card, motherboard, RAM and everything you need to set up your PC. By participating in our group, you receive daily promotions and have early access to discount coupons.
Enter the group and enjoy the promotions
Source: https://www.adrenaline.com.br/amd/amd-lanca-gaia-plataforma-de-ia-open-source-para-llm-local-em-qualquer-pc/
