When it comes to real-world evaluation, appropriate benchmarks need to be carefully selected to match the context of AI ...

Researchers behind the MASK benchmark found that more knowledge doesn't mean more 'moral virtue.' See which model lies the ...

New AI benchmarks could help developers reduce bias in AI models, potentially making them fairer and less likely to cause harm. The research, from a team based at Stanford, was posted to the arXiv ...

They could offer a more nuanced way to measure AI’s bias and its understanding of the world. New AI benchmarks could help developers reduce bias in AI models, potentially making them fairer and ...

Google has launched Gemma 3, the third generation of its open-source AI models. The model is better than rivals like DeepSeek ...

DeepSeek has gone viral. Chinese AI lab DeepSeek broke into the mainstream consciousness this week after its chatbot app rose ...

DeepSeek-V2, a general-purpose text- and image-analyzing system, performed well in various AI benchmarks — and was far cheaper to run than comparable models at the time. It forced DeepSeek’s ...

Today, the per-token cost of querying DeepSeek’s R1 model is less than 4% of the price of using OpenAI’s o1 model, despite scoring similarly on various AI benchmarks. Since R1’s release ...