Benchmarking Multilingual Terminology Translation for UNDRR-ISC Hazard Information Profiles

This paper presents the results of the multilingual translation of the 281 UNDRR-ISC Hazard Information Profiles (HIPs) terms from English into French, Spanish, and Chinese, in response to a request from UN partners, member states, and the scientific community. We compare three translation setups: (1) gpt-oss-20b as an open-weight singleLLM baseline; (2) ChatGPT-5.5 as a state-ofthe-art proprietary baseline; and (3) a VoterArbitrator multi-agent architecture, which combines three models through consensusbased arbitration, served locally via Ollama. Outputs are aligned with a SKOS-based hazard knowledge organisation system, enabling machine-actionable multilingual terminology interoperable with semantic disaster risk infrastructures. Evaluation against a humanvalidated gold standard shows that ChatGPT5.5 achieves the highest Exact Match accuracy across all languages, while the VoterArbitrator system consistently outperforms the open-weight baseline on Exact Match (58.0% vs 45.6% for French) and achieves higher cosine similarity, although human evaluation identifies a higher rate of conceptually incorrect terms for Chinese. The findings suggest that consensus-based multi-agent arbitration offers a reproducible, sovereign, and infrastructure-independent alternative to proprietary systems, with performance gains over single open-weight model inference.