Philipp Schmid’s Post

View profile for Philipp Schmid, graphic

Technical Lead & LLMs at Hugging Face 🤗 | AWS ML HERO 🦸🏻♂️

It's Pre:Invent time! Excited to announce that HUGS is now supported and available on Amazon Web Services (AWS) Inferentia2! HUGS or Hugging Face Generative AI Services are optimized, zero-configuration inference microservices designed to simplify and accelerate the development of AI applications using open models. Built on open-source technologies. 👀 Think on NVIDIA NIMs, but on AWS Neuron Accelerators. No compilation or configuration headaches. Take your open model and run it without any pain on AWS Accelerators with in minutes. 😍 Starting today, HUGS on AWS Neuron supports Meta Llama, Nous Research Hermes, Mistral, and Mixtral models, with more to come! 🚀 Want to get started? Check out our Guide on how to deploy Llama 3.1 on AWS EKS with AWS Inferentia2 instances: https://lnkd.in/e24dYp_z

  • No alternative text description for this image
Bojan Jakimovski

Machine Learning Engineer | GenAI | MLOps | Federated Learning Enthusiast

2w

Awesome work Philipp Schmid ! Do you plan to include Multimodal stuff in near future ?

Like
Reply
Jeremy Laskar ☁️

Senior Account Manager - GenAI chez Amazon Web Services (AWS)

2w

That is HUGE !! Congrats to the entire team on making HUGS available on Inferentia & Trainium!

Kateryna Stetsiuk

Principal AI Consultant || Crafting сustom AI Strategies and Solutions to drive growth, profit and efficiency

2w

Awesome product!

Like
Reply
See more comments

To view or add a comment, sign in

Explore topics