Key Specifications

Benchmark Performance

Benchmark	Score	Unit	Evaluated At	Notes	Source
MMLU	73.4	%	2024-06-05	5-shot	view
HUMANEVAL	66	pass@1	2024-06-05	—	view
GSM8K	73.5	%	2024-06-05	0-shot CoT	view
MATH	33.3	%	2024-06-05	0-shot CoT	view
BBH	65.1	%	2024-06-05	3-shot CoT	view
GPQA	28.3	%	2024-06-05	0-shot	view
IFEVAL	67.4	%	2024-06-05	prompt_strict	view
ARC	90.2	%	2024-06-05	challenge	view
MUSR	38.5	%	2024-06-05	0-shot	view
WINOGRANDE	73.1	%	2024-06-05	0-shot	view

Name: GLM-4V 9B
Brand: other

清华智谱 GLM-4V 9B 多模态开源模型, 131K 上下文, 9B 参数, 视觉理解能力突出。

Fornecedor	Versão	Data de lançamento	Janela de contexto	Modalidades de entrada	Modalidades de saída	Licença
Other	glm-4v-9b	2024-06-05	131K	text, image	text	GLM-4 License

Benchmark	Pontuação	Unidade	Notas
MMLU (Massive Multitask Language Understanding)	73.4	%	5-shot
HumanEval	66.0	pass@1	—
GSM8K (Grade School Math 8K)	73.5	%	0-shot CoT
MATH	33.3	%	0-shot CoT
BBH (BIG-Bench Hard)	65.1	%	3-shot CoT
GPQA	28.3	%	0-shot
IFEval	67.4	%	prompt_strict
ARC	90.2	%	challenge
MUSR	38.5	%	0-shot
WinoGrande	73.1	%	0-shot

Entrada	Saída	Leitura de cache	Escrita de cache
—	—	—	—

por milhão de tokens