Streamline AI Model Deployment: Hugging Face Simplifies Running AI on Third-Party Clouds for Developers
Hugging Face, a leading AI development platform, has recently announced an exciting partnership with various third-party cloud vendors, including SambaNova, to introduce a new feature called Inference Providers. This innovation is aimed at simplifying the process for developers to run AI models using their preferred infrastructure.
New Partnerships Enhance AI Model Deployment
In addition to SambaNova, Hugging Face has collaborated with other notable partners such as Fal, Replicate, and Together AI. These collaborations enable developers to seamlessly access their respective data centers for deploying AI models directly from the Hugging Face platform.
Streamlined Access to AI Models
With the Inference Providers feature, developers can easily launch models like DeepSeek on SambaNova’s infrastructure with just a few clicks from their Hugging Face project page. This is a significant enhancement from Hugging Face’s previous in-house solutions.
Focus on Collaboration and Model Distribution
In a recent blog post, Hugging Face emphasized a shift in focus towards enhancing collaboration, storage, and model distribution capabilities. The company stated:
“Serverless providers have flourished, and the time was right for Hugging Face to offer easy and unified access to serverless inference through a set of great providers.”
Benefits of Serverless Inference
One of the key advantages of serverless inference is that it allows developers to deploy and scale AI models without the need to manage the underlying hardware. Providers like SambaNova automatically handle the necessary computing resources, adjusting them based on usage.
- Easy deployment of AI models
- Automatic scaling of resources
- Reduced management overhead for developers
Cost Structure and User Benefits
Currently, developers using third-party cloud providers through Hugging Face will pay standard API rates set by the respective providers. Hugging Face has indicated the potential for future revenue-sharing agreements with its partners. All users of Hugging Face receive a small quota of credits for inference, while subscribers to Hugging Face Pro enjoy an additional $2 in credits each month.
About Hugging Face
Founded in 2016 as a chatbot startup, Hugging Face has transformed into one of the largest AI model hosting and development platforms globally. The company has raised nearly $400 million from prominent investors such as Salesforce, Google, Amazon, and Nvidia. Hugging Face proudly claims to be a profitable venture.
For more insights into AI advancements, consider subscribing to the AI-focused newsletter from TechCrunch, delivered to your inbox every Wednesday!