Datadog’s State Of Cloud Costs 2024 Report Finds Spending On Gpu Instances Growing 40% As Organizations Experiment With Ai By Investing.com

Datadog’s new report, the State of Cloud Costs 2024, found that organizations using graphics processing unit (GPU) instances have increased their average spending on those instances by 40% in the last year. This growth in spend is due to the increasing use of GPUs for AI and large language models (LLMs), where they can be more than 200% faster than CPUs. The report also highlights the issue of wasted spend on containers, with 83% of container costs being associated with idle resources.