Overview
This is a repackaged software product wherein additional charges apply for seller support, as well as licensing fees paid to AWS. The additional cost is applicable to the extended support of 24-hour response time. The current Llama3.1-8B product uses a graphical interface to interact with users, no longer a DOS interface. The interface is clean, tidy, and easy to use. The following is the main introduction to the product
Meta recently released a new generation of open-source model series Llama3.1, which includes a 405B parameter version that performs similarly to or even surpasses closed source models such as GPT-4 in some benchmark tests. Llama3.1-8B-Instruction is an 8B parameter version in the series that supports English, German, French, Italian, Portuguese, Spanish, Hindi, and Thai, with a context length of up to 131072 tokens. The knowledge deadline has been updated until December 2023.
In order to enhance the ability of Llama3.1-8B-Instruction, Meta used over 25 million synthetic data generated by a larger 405B model during training. This enables Llama3.1-8B-Instruction to demonstrate cognitive and reasoning abilities similar to GPT3.5Turbo in code, mathematics, and other tests.
OpenBuddy utilizes the Llama3.1-8B-Instruction model and trains it on a small amount of Chinese data to release OpenBuddy-Llama3.1-8B-v22.1-131K, a new generation open-source cross language model with Chinese question answering and cross language translation capabilities. Although Llama3.1 itself does not have Chinese language proficiency, after training, the model is able to generate answers that are usually only possible with larger models on problems that are prone to conceptual confusion, demonstrating stronger cognitive potential.
However, due to limitations in the training dataset and time, OpenBuddy-Llama3.1-8B-v22.1 still has limitations in Chinese knowledge, especially in traditional cultural knowledge. Nevertheless, the model exhibits relatively stable performance in tasks such as comprehension of long texts, thanks to its inherent ability in long texts.
In the future, OpenBuddy plans to conduct larger scale training on the 8B and 70B models to enhance their Chinese knowledge reserve, long writing ability, and cognitive ability, and explore the possibility of fine-tuning the 405B model.
Highlights
- Build a local AI big model that belongs only to you
- Supports a context length of 128K tokens and 8 languages, including English, German, French, Italian, Portuguese, Hindi, Spanish, and Thai. Llama 3.1 continues to use Group Query Attention (GQA), which is an efficient representation that helps handle longer contexts
- Compared to Llama 3, the new feature of Llama 3.1 is that the instruction model has been fine tuned in terms of tool invocation, making it suitable for intelligent agent use cases. Built in two tools (search, use Wolfram Alpha for mathematical reasoning) that can be extended to custom JSON functionality
Details
Typical total price
$0.81/hour
Features and programs
Financing for AWS Marketplace purchases
Pricing
- ...
Instance type | Product cost/hour | EC2 cost/hour | Total/hour |
---|---|---|---|
t2.nano | $0.10 | $0.008 | $0.108 |
t2.micro AWS Free Tier | $0.10 | $0.016 | $0.116 |
t2.small | $0.10 | $0.032 | $0.132 |
t2.medium | $0.10 | $0.064 | $0.164 |
t2.large | $0.10 | $0.121 | $0.221 |
t2.xlarge | $0.10 | $0.227 | $0.327 |
t2.2xlarge | $0.10 | $0.433 | $0.533 |
t3.nano | $0.10 | $0.01 | $0.11 |
t3.micro AWS Free Tier | $0.10 | $0.02 | $0.12 |
t3.small | $0.10 | $0.039 | $0.139 |
Additional AWS infrastructure costs
Type | Cost |
---|---|
EBS General Purpose SSD (gp2) volumes | $0.10/per GB/month of provisioned storage |
Vendor refund policy
no refunds
Legal
Vendor terms and conditions
Content disclaimer
Delivery details
64-bit (x86) Amazon Machine Image (AMI)
Amazon Machine Image (AMI)
An AMI is a virtual image that provides the information required to launch an instance. Amazon EC2 (Elastic Compute Cloud) instances are virtual servers on which you can run your applications and workloads, offering varying combinations of CPU, memory, storage, and networking resources. You can launch as many instances from as many different AMIs as you need.
Version release notes
Updated to the latest
Additional details
Usage instructions
After booting up, enter the desktop and double-click on the GPT4AII software. When the software opens, click on the "models" option and then click on "add models". You can select other models (including other AI models such as GPT4, but this is done through the API). Select the first model Llama3.1, click on "Download" on the right, wait for the download to complete, click on the "Home" option on the left, click on "start chatting", and at the top of the page, there is a "choose a model" option. Click on "Llama3.1" to chat using Llama3.1
Resources
Support
Vendor support
For product technical support, please contact prosupport@hanweie.com
AWS infrastructure support
AWS Support is a one-on-one, fast-response support channel that is staffed 24x7x365 with experienced and technical support engineers. The service helps customers of all sizes and technical abilities to successfully utilize the products and features provided by Amazon Web Services.