跳到正文
Artificial Analysis· @ArtificialAnlys · X·· 3 小时前AI 评分29
AI 导读

Artificial Analysis 宣布推出面向公共部门的政府版服务,提供基准测试、咨询与数据,帮助政府设计 AI 政策并选择 AI 技术。其评测覆盖模型与智能体的能力、准确率、幻觉、成本、速度与延迟,并已与韩国政府签署 MOU 作为独立评估方。

正文

Announcing Artificial Analysis for Government: benchmarking, advisory and data to help public sector clients design AI policy and select AI technologies

Our services help public sector clients to:

➤ Design AI policy and support decision-making: Our benchmarking and expertise can inform the urgent decisions governments must make in navigating AI - for example, how to secure critical infrastructure, safeguard employment and growth, and balance national priorities including innovation, competition, and security. We recently signed an MOU with the Korean Government as an independent evaluator supporting Korea’s efforts to develop globally competitive frontier AI models and strengthen its domestic AI ecosystem.

➤ Select AI Technologies: We are the go-to resource for millions of users navigating AI. We can support governments to deploy the most effective agents at the lowest cost, empower public sector workers, and plan for future use cases.

Our topic expertise includes:

➤ Capability, cost and performance: We are the global standard in measuring capabilities, accuracy, hallucination, cost, speed and latency of models and agents. Our benchmarking is widely referenced by top AI labs and news outlets.

➤ Cybersecurity and safety: The Artificial Analysis Cyber Index Alliance brings together partners including NVIDIA, IBM, Vercel and Collinear to set a new standard for evaluating AI cyber defense. This launched alongside the Artificial Analysis Cyber Index, which evaluates how well agents find and fix vulnerabilities. On safety, we evaluate models on a broad spectrum of harms across escalating levels of adversarial pressure. We recently partnered with NVIDIA to benchmark guardrail models for safety and refusal.

Get in touch at the link below

来源:Artificial Analysis · x.com