Atlas v1.1 Release Notes
Atlas v1.1 marks the second software release from Positron.ai. Two additional language models are now included. These Llama 3.1 models use a quantized set of weights from NeuralMagic which have been tuned to produce high reasoning scores despite their compression.
Supported Models
Llama-3.1-8B-instruct-gptq (neuralmagic)
Llama-3.1-70B-instruct-gptq (neuralmagic)
Mixtral 8x7B-instruct-gptq
Shipping model primarily tested to context length of 2048 (prompt+response)
Documentation
Documentation for Atlas software releases posted to https://support.positron.ai/
Known Issues
There are three models installed, but only Llama3.1 8B is running on first boot. Administrator will need to access the service nodes in the Olivaw admin utility and select any additional models they want to be operational on their Atlas appliance. See https://support.positron.ai/user-guide/inference-gui-walkthrough for more information.