Use everyday language to search and retrieve data with Mixtral 8x7B on Amazon SageMaker JumpStart

By Admin 08/04/2024

AWS Machine Learning Blog With the widespread adoption of generative artificial intelligence (AI) solutions, organizations are trying to use these technologies to make their teams more productive. One exciting use case is enabling natural language interactions with relational databases. Rather than writing complex SQL queries, you can describe in plain language what data you want […]Continue reading

Inference Llama 2 models with real-time response streaming using Amazon SageMaker

By Admin 09/01/2024

AWS Machine Learning Blog With the rapid adoption of generative AI applications, there is a need for these applications to respond in time to reduce the perceived latency with higher throughput. Foundation models (FMs) are often pre-trained on vast corpora of data with parameters ranging in scale of millions to billions and beyond. Large language […]Continue reading

Mitigate hallucinations through Retrieval Augmented Generation using Pinecone vector database & Llama-2 from Amazon SageMaker JumpStart

By Admin 06/12/2023

AWS Machine Learning Blog Despite the seemingly unstoppable adoption of LLMs across industries, they are one component of a broader technology ecosystem that is powering the new AI wave. Many conversational AI use cases require LLMs like Llama 2, Flan T5, and Bloom to respond to user queries. These models rely on parametric knowledge to […]Continue reading

Build trust and safety for generative AI applications with Amazon Comprehend and LangChain

By Admin 11/11/2023

AWS Machine Learning Blog We are witnessing a rapid increase in the adoption of large language models (LLM) that power generative AI applications across industries. LLMs are capable of a variety of tasks, such as generating creative content, answering inquiries via chatbots, generating code, and more. Organizations looking to use LLMs to power their applications […]Continue reading

Improve throughput performance of Llama 2 models using Amazon SageMaker

By Admin 25/09/2023

AWS Machine Learning Blog We’re at an exciting inflection point in the widespread adoption of machine learning (ML), and we believe most customer experiences and applications will be reinvented with generative AI. Generative AI can create new content and ideas, including conversations, stories, images, videos, and music. Like most AI, generative AI is powered by […]Continue reading

Deploy thousands of model ensembles with Amazon SageMaker multi-model endpoints on GPU to minimize your hosting costs

By Admin 08/08/2023

AWS Machine Learning Blog Artificial intelligence (AI) adoption is accelerating across industries and use cases. Recent scientific breakthroughs in deep learning (DL), large language models (LLMs), and generative AI is allowing customers to use advanced state-of-the-art solutions with almost human-like performance. These complex models often require hardware acceleration because it enables not only faster training […]Continue reading