Major AI Infrastructure Startup General Compute Secures $400 Million Loan
Mountain View, California – October 27, 2023 – General Compute, an AI inference cloud startup, has landed a $400 million loan from Upper90, a tech investment firm. This transaction marks a pivotal moment in the evolution of AI infrastructure, as it features the first-ever loan secured by inference-specific chips.
Shifting Focus: Cost-Effective Inference Solutions
Market response to the burgeoning costs of AI tools and tokens has shifted towards more affordable infrastructure for running open-source models. General Compute aligns with this trend by leveraging readily available, open-source models without the expensive hardware required for model training.
Purpose-Built Neocloud & Efficient Inference Chips
General Compute has constructed a neocloud around silicon from SambaNova, an Intel-backed chipmaker. Neoclouds are designed specifically for AI workloads, unlike the traditional hyperscalers like AWS or Azure that cater to general-purpose computing. The company’s SN50 chips are purpose-built for inference, ensuring power efficiency and eliminating the need for expensive water-cooling systems.
Lessons Learned from GPU Financing
Upper90’s previous experience financing GPU purchases by Crusoe offers valuable insights for this new venture. In 2021, the firm recognized the potential of advanced chips as collateral and became pioneers in securing financing against them. Traditional lenders had previously shunned such deals due to the inherent risks and uncertainties surrounding chip depreciation.
Empowering Alternatives to Nvidia
General Compute’s access to chips outside of Nvidia’s ecosystem is crucial for the burgeoning AI landscape. Competition is heating up, with new chipmakers like Groq and Cerebras drawing significant attention. This fragmentation of Nvidia’s dominance is expected to yield more cost-efficient and efficient inference solutions.
Wararka.so — your trusted source for global news.
