Datadog’s State Of Cloud Costs 2024 Report Finds Spending On Gpu Instances Growing 40% As Organizations Experiment With Ai

Datadog’s State of Cloud Costs 2024 report reveals that organizations are increasing their spending on GPU instances by 40% due to the growing use of AI and large language models. GPUs’ ability for parallel processing makes them essential for AI workloads, with potential speeds over 200% faster than CPUs. The report also highlights the issue of wasted spend on containers, with 83% of container costs being associated with idle resources.