Advantech Launches Edge AI Server Solutions for Generative AI
Wednesday, June 12, 2024
TAIPEI, June 4, 2024 /PRNewswire/ -- Advantech, a global leader in Industrial IoT, is thrilled to announce a groundbreaking Edge AI server solution for generative AI, featuring Phison's patented aiDAPTIV+ technology. The AIR-520 Edge AI Server, powered by an AMD EPYC 7003 series processor, integrates SQ ai100 AI SSDs, NVIDIA RTX GPU cards, an Edge AI SDK, and NVIDIA AI Enterprise to provide a ready-to-deploy solution.
Generative AI tools such as large language models (LLMs) are transforming enterprise knowledge management by automating data organization, retrieval, and analysis, thereby boosting productivity and improving decision-making. Custom LLMs enhance accuracy, while edge training increases data privacy, though it can be more costly. This solution supports LLM fine-tuning with 1-4 GPU cards and SQ ai100 AI SSDs, enabling enterprises to train LLMs cost-effectively while keeping sensitive data secure at the edge.
Four Solution Offerings for Diverse Applications
Advantech offers four options: AIR-520-L13B/L33B/L70B, and L70B-Plus, tailored for different scales and applications. The L13B is ideal for real-time applications such as chatbots and language translation. The L33B is suited for more complex tasks, enhancing productivity and innovation in content creation. The L70B excels in sophisticated data analysis and decision-making for specialized domains. Additionally, the L70B-Plus, equipped with the NVIDIA AI Enterprise, offers end-to-end, reliable and optimized AI SDKs with long-term support and expert consulting services.
Quick Installation Optimized for Cost-Efficiency
All AIR-520 solutions include SQ ai100 AI SSDs, which leverage Phison's aiDAPTIV+ technology. These SSDs act as an extension of GPU vRAM, enabling the system to fine-tune LLMs with minimal GPU cards. This approach not only eases the budget barrier, but also makes the Edge AI Server more compact compared to traditional large rack-mount servers. Its size is comparable to a desktop PC, and it can be rack-mounted with the appropriate accessories, eliminating concerns about space and maintenance.
Fast-Track Development with Software Services
In addition to LLM fine-tuning capabilities, Advantech provides an Edge AI SDK with the GenAI Training Studio, preloaded with Llama-2 models for applications like chatbots and data analysis. This simplifies and accelerates customer-specific LLM model training and inference evaluation on the AIR-520. Furthermore, Advantech's DeviceOn provides OTA software/container updates and remote management, facilitating efficient AI orchestration and long-term maintenance.
Early samples of the AIR-520 Edge AI Server Solution are available now. For more information, please contact your local sales team or visit our website. https://shorturl.at/WQze2
View original content to download multimedia:https://www.prnewswire.com/news-releases/advantech-launches-edge-ai-server-solutions-for-generative-ai-302162802.html
SOURCE Advantech
|
|
|
|
|
 |
Energy Toolbase Launches Energy Storage Partnership with Sungrow to Support PowerStack 255CS and PowerTitan 2.0 | Jan 22, 2026
|
|
RS now offers Phoenix Contact's pioneering new NearFi technology | Jan 22, 2026
|
|
Quantum Art Raises $100 Million in Series A Round to Drive Scalable, Multi-Core Quantum Computing | Jan 22, 2026
|
|
MetaOptics to Showcase Five Breakthrough Metalens-Powered Products at CES 2026 | Jan 22, 2026
|
|
Fresco Raises EUR15m Series C to Power the Future of AI-Driven Cooking and the Connected Kitchen Ecosystem | Jan 22, 2026
|
|
Einride and IonQ Partnership Uses Quantum Computing to Optimize the Logistics of Electric and Autonomous Freight | Jan 22, 2026
|
|
No Assembly Required: Barrett Distribution Centers Powers Maxwood Furniture's West Coast DTC Expansion | Jan 22, 2026
|
|
SCAILIUM Debuts "AI Production Layer" to Overcome GPU Starvation and Slash AI Energy Waste | Jan 22, 2026
|
|
Hesai Recognized as the Only Lidar Company on Morgan Stanley's "Humanoid Tech 25" of Global Robotics Leaders | Jan 22, 2026
|
|
Ekinops New C700HC Chassis Efficiently Connects the Data Center and the Central Office | Jan 22, 2026
|
|
|
