选择清华的中文多模态模型VisualGLM-6B,做为基础模型。
https://github.com/THUDM/VisualGLM-6B
模型的整体效果还可以,支持中文,且开源。
整理一下搭建过程中遇到的问题:
1) This modeling file requires the following packages that were not found in your environment: sat. Run pip install sat
python环境缺少sat模块,但是错误提示有误导, pip install sat
是一个与ai无关的库, 实际应该执行指令: pip install SwissArmyTransformer
https://github.com/THUDM/VisualGLM-6B/issues/17
https://pypi.org/project/sat/ (pip install sat 安装的是这个模块)