openchat/openchat-3.6-8b cover image

openchat/openchat-3.6-8b

Openchat 3.6 is a LLama-3-8b fine tune that outperforms it on multiple benchmarks.

Openchat 3.6 is a LLama-3-8b fine tune that outperforms it on multiple benchmarks.

Public
bfloat16
8,192
ProjectLicense
openchat/openchat-3.6-8b cover image

openchat 3.6 8b

Ask me anything

0.00s

OpenChat: Advancing Open-source Language Models with Mixed-Quality Data

Limitations

Foundation Model Limitations Despite its advanced capabilities, OpenChat is still bound by the limitations inherent in its foundation models. These limitations may impact the model's performance in areas such as:

Complex reasoning Mathematical and arithmetic tasks Programming and coding challenges Hallucination of Non-existent Information OpenChat may sometimes generate information that does not exist or is not accurate, also known as "hallucination". Users should be aware of this possibility and verify any critical information obtained from the model.

Safety OpenChat may sometimes generate harmful, hate speech, biased responses, or answer unsafe questions. It's crucial to apply additional AI safety measures in use cases that require safe and moderated responses.

Citation

@article{wang2023openchat,
  title={OpenChat: Advancing Open-source Language Models with Mixed-Quality Data},
  author={Wang, Guan and Cheng, Sijie and Zhan, Xianyuan and Li, Xiangang and Song, Sen and Liu, Yang},
  journal={arXiv preprint arXiv:2309.11235},
  year={2023}
}