Gradient makes LLM benchmarking cost-effective and effortless with AWS Inferentia
This is a guest post co-written with Michael Feil at Gradient. Evaluating the performance of large language models (LLMs) is
Continue reading
Tag: Inferentia
Fine-tune and deploy Llama 2 models cost-effectively in Amazon SageMaker JumpStart with AWS Inferentia and AWS Trainium
Today, we’re excited to announce the availability of Llama 2 inference and fine-tuning support on AWS Trainium and AWS Inferentia
Continue reading