The New Frontier Of LLM Inference: Where The Next Tenfold Gains Will Come From

This brute-force scaling approach is slowly fading and giving way to innovations in inference engines rooted in core computer ...
Business Wire

Vultr Launches Cloud Inference to Simplify Model Deployment and Automatically Scale AI Applications Globally

WEST PALM BEACH, Fla.--(BUSINESS WIRE)--Vultr, the world’s largest privately-held cloud computing platform, today announced the launch of Vultr Cloud Inference. This new serverless platform ...
TMCnet

DigitalOcean Appoints Vinay Kumar as Chief Product and Technology Officer

DigitalOcean (NYSE: DOCN) today announced the appointment of Vinay Kumar as Chief Product and Technology Officer (CPTO). In this role, Vinay will lead product strategy, product development, cloud ...
The Manila Times

Nokia Strengthens Edge AI Capabilities Through Strategic Collaboration with Blaize on Hybrid Inference Solutions Across Asia Pacific Regions

Blaize Holdings, Inc. (Nasdaq: BZAI, Nasdaq: BZAIW) ('Blaize'), a global leader in programmable, energy efficient AI ...

How AI Inference Can Unlock The Next Generation Of SaaS

The next generation of inference platforms must evolve to address all three layers. The goal is not only to serve models ...
SDxCentral

Nokia foregoes Nvidia for APAC AI infrastructure deal

Nokia is to power AI inference for the Asia Pacific market, as the vendor’s Singaporean arm enters a partnership with AI chip ...
TechCrunch

Hugging Face makes it easier for devs to run AI models on third-party clouds

AI dev platform Hugging Face has partnered with third-party cloud vendors, including SambaNova, to launch Inference Providers, a feature designed to make it easier for devs on Hugging Face to run AI ...
VentureBeat

MLPerf 3.1 adds large language model benchmarks for inference

Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More MLCommons is growing its suite of MLPerf AI benchmarks with the addition ...