New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

模型能力评测和数据 #2

Open

zhangfan-algo opened this issue Jul 10, 2023 · 1 comment

zhangfan-algo commented Jul 10, 2023

想看下模型各项能力如何,例如视觉推理能力,OCR能力测评.以及预训练数据集和指令微调数据的训练代码以及数据可以开源一下吗包括预训练和指令精调的

Owner

airaria commented Jul 10, 2023

目前还没有量化指标；在llava和owleval测试集上的文本生成效果参见这里

多模态数据处理流程比较复杂，代码开源还在计划中

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment