Episode Details
Back to Episodes
Can Chip Matching Software Lower AI Compute Costs?
Description
Bloomberg reported that Callosum raised $100 million to build software that matches AI workloads to specific chips. The company targets routing and scheduling so training and inference jobs run on hardware that fits their memory, bandwidth, and cost profiles. The raise comes as enterprises manage heterogeneous fleets across AWS, Microsoft Azure, Google Cloud, and specialized providers like CoreWeave and Lambda. The market includes established schedulers and recent deals such as Nvidia's 2024 agreement to acquire Run:ai and Databricks' 2023 purchase of MosaicML for $1.3 billion. Buyers will evaluate governance, cost allocation, and measurable utilization gains. Founders should pilot across multiple chip families and providers and track throughput per dollar, queue times, and job success rates.
Learn more on this news by visiting us at: https://greyjournal.net/news/
Hosted on Acast. See acast.com/privacy for more information.