Simplify data prep for generative AI with Amazon SageMaker Data Wrangler

By Admin 27/11/2023

AWS Machine Learning Blog Generative artificial intelligence (generative AI) models have demonstrated impressive capabilities in generating high-quality text, images, and other content. However, these models require massive amounts of clean, structured training data to reach their full potential. Most real-world data exists in unstructured formats like PDFs, which requires preprocessing before it can be used […]Continue reading

Retrieval-Augmented Generation with LangChain, Amazon SageMaker JumpStart, and MongoDB Atlas semantic search

By Admin 17/11/2023

AWS Machine Learning Blog Generative AI models have the potential to revolutionize enterprise operations, but businesses must carefully consider how to harness their power while overcoming challenges such as safeguarding data and ensuring the quality of AI-generated content. The Retrieval-Augmented Generation (RAG) framework augments prompts with external data from multiple sources, such as document repositories, […]Continue reading

Technique enables AI on edge devices to keep learning over time

By Admin 16/11/2023

MIT News – Artificial intelligence Personalized deep-learning models can enable artificial intelligence chatbots that adapt to understand a user’s accent or smart keyboards that continuously update to better predict the next word based on someone’s typing history. This customization requires constant fine-tuning of a machine-learning model with new data. Because smartphones and other edge devices […]Continue reading

Customizing coding companions for organizations

By Admin 09/11/2023

AWS Machine Learning Blog Generative AI models for coding companions are mostly trained on publicly available source code and natural language text. While the large size of the training corpus enables the models to generate code for commonly used functionality, these models are unaware of code in private repositories and the associated coding styles that […]Continue reading

Harnessing the power of enterprise data with generative AI: Insights from Amazon Kendra, LangChain, and large language models

By Admin 07/11/2023

AWS Machine Learning Blog Large language models (LLMs) with their broad knowledge, can generate human-like text on almost any topic. However, their training on massive datasets also limits their usefulness for specialized tasks. Without continued learning, these models remain oblivious to new data and trends that emerge after their initial training. Furthermore, the cost to […]Continue reading

To excel at engineering design, generative AI must learn to innovate, study finds

By Admin 19/10/2023

MIT News – Artificial intelligence ChatGPT and other deep generative models are proving to be uncanny mimics. These AI supermodels can churn out poems, finish symphonies, and create new videos and images by automatically learning from millions of examples of previous works. These enormously powerful and versatile tools excel at generating new content that resembles […]Continue reading

Fast and cost-effective LLaMA 2 fine-tuning with AWS Trainium

By Admin 05/10/2023

AWS Machine Learning Blog Large language models (LLMs) have captured the imagination and attention of developers, scientists, technologists, entrepreneurs, and executives across several industries. These models can be used for question answering, summarization, translation, and more in applications such as conversational agents for customer support, content creation for marketing, and coding assistants. Recently, Meta released […]Continue reading

Code Llama code generation models from Meta are now available via Amazon SageMaker JumpStart

By Admin 03/10/2023

AWS Machine Learning Blog Today, we are excited to announce Code Llama foundation models, developed by Meta, are available for customers through Amazon SageMaker JumpStart to deploy with one click for running inference. Code Llama is a state-of-the-art large language model (LLM) capable of generating code and natural language about code from both code and […]Continue reading

Fine-tune Falcon 7B and other LLMs on Amazon SageMaker with @remote decorator

By Admin 14/09/2023

AWS Machine Learning Blog Today, generative AI models cover a variety of tasks from text summarization, Q&A, and image and video generation. To improve the quality of output, approaches like n-short learning, Prompt engineering, Retrieval Augmented Generation (RAG) and fine tuning are used. Fine-tuning allows you to adjust these generative AI models to achieve improved […]Continue reading

Helping computer vision and language models understand what they see

By Admin 13/09/2023

MIT News – Artificial intelligence Powerful machine-learning algorithms known as vision and language models, which learn to match text with images, have shown remarkable results when asked to generate captions or summarize videos. While these models excel at identifying objects, they often struggle to understand concepts, like object attributes or the arrangement of items in […]Continue reading