AI Benchmarks Mislead Us

Is AI Ranking Rigged?

Advertise here | 5-min Read

Welcome to our Friday edition!

In today’s menu:

  • AI Inspirational Quote

  • AI Leaderboard Flawed?

  • Al Summarize Any Document or PDF Instantly

  • Smarter Siri? Not Just Yet

  • Top Rated AI Tools

  • Byte Sized news

  • How to Create Full-Stack Web Apps Without Coding

AI INSPIRATIONAL QUOTE

It is never too late to be what you might have been.

LATEST NEWS

AI Leaderboard Flawed?

Top AI Benchmark May Be Unfair, Study Says

A new study from top universities, including MIT and Stanford, says LMArena, a popular AI model ranking site, might be giving unfair advantages to big tech companies like Google, Meta, and OpenAI. This could make their models look better than they actually are.

  • Big tech companies test many model versions privately and only show the best results.

  • Over 60% of interactions on LMArena go to models from Google and OpenAI.

  • Many open-source models were removed quietly, more often than big-company models.

LMArena is a major tool for comparing AI models. If it's biased, it could mislead users and researchers about which models are truly better. This study, along with other recent issues, shows that AI rankings may not always be fair or accurate.

Smart Podcast Summaries, Daily.

🚀 Meet PodSnacks: A personalized, AI-powered email that delivers the smartest insights from your podcast subscriptions — every morning.

No scrolling, no fluff. Just the news you care about.

🧠 Like Morning Brew, but built just for you.

Al Summarize Any Document or PDF Instantly

Smarter Siri? Not Just Yet

Apple Delays Smarter Siri Features

  • Apple CEO Tim Cook confirmed that smarter Siri features will be delayed.

  • Cook said Apple needs more time to reach the high quality it expects.

  • Some AI tools like Genmoji, Image Playground, and Writing Tools are already live.

Apple first showed the new Siri at WWDC 2024, but users will now have to wait longer. This is the first time Apple has openly talked about the delay since March. Siri is a key part of Apple’s AI push, and making it smarter and more helpful is part of their long-term plan. These updates could make Siri more personal, aware of what’s on the screen, and able to take actions inside apps.

Top Rated

Raycast for iOS: Powerful productivity on the go

Postiz v2: Social Media Scheduling with MCP support

LLMrefs: AI SEO Keyword Rank Tracker for LLM Search Engines

Foodee: Transform google sheets into digital menus and landing pages

GoCodeo SaaS Builder: An open-source AI agent that builds full-stack SaaS apps

How to Create Full-Stack Web Apps Without Coding

In this tutorial, you’ll learn how to build and launch complex web apps using Google’s new Firebase Studio, all without writing any code, thanks to AI-powered prototyping.

Step-by-step:

  1. Go to Firebase Studio and sign in with your Google account.

  2. In the “Prototype an app with AI” section, describe your app in as much detail as possible.

  3. Review the app blueprint created by AI, you can change the name, features, and colors.

  4. Test your prototype. If needed, make changes, then click “Publish” to launch it.

You can upload sketches or images of your app design to help the AI understand your ideas better. Want more control? Click the “Switch to code” button in the top right corner for advanced editing.

SPONSOR US

Get your business in front of over 90k+ AI professionals

8020AI is the world’s #1 AI Newsletter, Read by 90k+ professionals from leading companies such as Google, OpenAI, Meta, and Microsoft.

We've assisted in promoting Over 500 AI-Related ProductsWill yours be the next?

What We Can Offer:

  • Launch an Advertising Campaign

  • Introduce New Product or Features

  • Other Business Cooperation

Or Email our founder Alamin at [email protected]

👋 THAT’S A WRAP

FEEDBACK

How was your experience with 8020AI today?

How was 8020AI today?

Login or Subscribe to participate in polls.

Login or Subscribe to participate in polls.

If you have specific feedback or anything interesting you’d like to share, please let us know by replying to this email.