Solar-0-70b-16bit
tokenizer = AutoTokenizer.from_pretrained("upstage/Llama-2-70b-instruct-v2") model = AutoModelForCausalLM.from_pretrained( "upstage/Llama-2-70b-instruct-v2", device_map="auto", torch_dtype=torch.float16, load_in_8bit=True, rope_scaling={"type": "dynamic", "factor": 2} # allows handling of longer inputs ).
text → text · made by Upstage
Sold by
Nobody in the catalogue publishes a price for this yet.
About
Solar-0-70b-16bit — a text model from Upstage.
It takes text and returns text. It was published in July 2023. The catalogue files it under chat.
Every current figure
- Maker
- Upstage
- Register
- model
- Takes
- text
- Returns
- text
- Published
- July 2023
- Parameters
- 70 billion · read from its own name
Known as 1 name
upstage/SOLAR-0-70b-16bit