orca2:13b-q3_K_L - Ollama 框架

orca2

Orca 2 由微軟研究院開發，是 Meta Llama 2 模型微調後的版本。此模型設計 বিশেষভাবে擅長推理。

7b 13b

63.8K 下載次數更新於 15 個月前

33 個標籤

更新於 15 個月前

15 個月前

9fcd1fe1c136 · 6.9GB

{ "num_ctx": 4096, "stop": [ "<|im_start", "<|im_end", "|im_start",

82B

template

<|im_start|>system {{ .System }}<|im_end|> <|im_start|>user {{ .Prompt }}<|im_end|> <|im_start|>assi

106B

system

You are Orca, an AI language model created by Microsoft. You are a cautious assistant. You carefully

215B

license

MICROSOFT RESEARCH LICENSE TERMS IF YOU LIVE IN THE UNITED STATES, PLEASE READ THE “BINDING ARBIT

11kB

Readme

Orca 2 模型由微軟研究院開發。它們基於 Meta 的 Llama 2 模型進行微調，使用合成資料集以增強小型模型的推理能力。所有合成訓練資料都經過 Microsoft Azure 內容過濾器審核。

使用案例

Orca 2 是一個有用的助手，能夠在諸如根據您的資料進行推理、閱讀理解、數學問題解決和文本摘要等任務中提供答案。

此模型設計 বিশেষভাবে擅長推理。

微軟研究院對此模型的預期用途是鼓勵進一步研究關於小型語言模型的開發、評估和對齊。

CLI

70 億參數模型

ollama run orca2

130 億參數模型

ollama run orca2:13b

API

範例

curl -X POST http://localhost:11434/api/generate -d '{
  "model": "orca2",
  "prompt":"Why is the sky blue?"
 }'

參考文獻

微軟研究院公告部落格
微軟研究院發表的論文，《Orca 2：教導小型語言模型如何推理》

Orca 2 models are built by Microsoft Research. They are fine-tuned on Meta's Llama 2 using a synthetic dataset that was created to enhance the small model's reasoning abilities. All synthetic training data was moderated using Microsoft Azure content filters.

### Use case

Orca 2 is a helpful assistant, and provides an answer in tasks such as reasoning over your given data, reading comprehension, math problem solving and text summarization.

The model is designed to excel particularly in reasoning.

Microsoft Research's intended purpose for this model is to encourage further research on the development, evaluation, and alignment of smaller language models.

### CLI

7 billion parameter model:

```
ollama run orca2
```

13 billion parameter model:

```
ollama run orca2:13b
```

### API

Example:

```bash
curl -X POST http://localhost:11434/api/generate -d '{
  "model": "orca2",
  "prompt":"Why is the sky blue?"
 }'
```

### References

- [Microsoft Research announcement blog](https://www.microsoft.com/en-us/research/blog/orca-2-teaching-small-language-models-how-to-reason/)

- Microsoft Research published paper, [Orca 2: Teaching Small Language Models How to Reason](https://arxiv.org/pdf/2311.11045.pdf)

貼上、拖曳或點擊上傳圖片 (.png, .jpeg, .jpg, .svg, .gif)