Build custom chatbot applications using OpenChatkit models on Amazon SageMaker

By Admin 13/06/2023

AWS Machine Learning Blog Open-source large language models (LLMs) have become popular, allowing researchers, developers, and organizations to access these models to foster innovation and experimentation. This encourages collaboration from the open-source community to contribute to developments and improvement of LLMs. Open-source LLMs provide transparency to the model architecture, training process, and training data, which […]Continue reading

Fine-tune GPT-J using an Amazon SageMaker Hugging Face estimator and the model parallel library

By Admin 12/06/2023

AWS Machine Learning Blog GPT-J is an open-source 6-billion-parameter model released by Eleuther AI. The model is trained on the Pile and can perform various tasks in language processing. It can support a wide variety of use cases, including text classification, token classification, text generation, question and answering, entity extraction, summarization, sentiment analysis, and many […]Continue reading

Host ML models on Amazon SageMaker using Triton: ONNX Models

By Admin 10/06/2023

AWS Machine Learning Blog ONNX (Open Neural Network Exchange) is an open-source standard for representing deep learning models widely supported by many providers. ONNX provides tools for optimizing and quantizing models to reduce the memory and compute needed to run machine learning (ML) models. One of the biggest benefits of ONNX is that it provides […]Continue reading

Announcing new Jupyter contributions by AWS to democratize generative AI and scale ML workloads

By Admin 10/05/2023

AWS Machine Learning Blog Project Jupyter is a multi-stakeholder, open-source project that builds applications, open standards, and tools for data science, machine learning (ML), and computational science. The Jupyter Notebook, first released in 2011, has become a de facto standard tool used by millions of users worldwide across every possible academic, research, and industry sector. […]Continue reading