Is your smartphone smart? AnTuTu measures and scores AI in a new benchmark

ByLinky Cheng 2019-06-05 755

AnTuTu launches a new benchmark application called AiTuTu (or AI Review). As its name suggests, this application aims to quantify the capabilities of a smartphone's artificial intelligence.

The term "artificial intelligence" is often overused. It is a buzzword that many smartphone or component manufacturers use to highlight their products. To help users see more clearly, the company behind the famous AnTuTu benchmark has just launched a new application called AiTuTu, aimed at measuring the artificial intelligence capabilities of a smartphone.

AiTuTu consists of two steps. The first classifies a batch of images into six different categories, while the second detects objects within a video. This makes it possible to highlight the recognition of objects within an image, both fixed and animated. Each test then receives a score again divided into two categories: recognition speed and accuracy, pushing manufacturers to avoid focusing on speed alone, even if it means providing incorrect results.

The two tests are respectively based on two neural networks: Inception V3 in the case of photo classification and MobileNet SSD in the case of object recognition. These neural networks are then translated through the SDK provided by the manufacturer. In case the chipset does not support these algorithms, the application then uses TFLite, the open source tool developed by Google.

During the writing process, we had the opportunity to try several high-end smartphones in order to try the application, with very different scores depending on the brands. Here are some of the scores we have obtained:

However, these scores are not very representative at this time. Indeed, as mentioned above, the information is translated at some point through the manufacturer's SDK. However, Samsung has not yet made its SDK available, while HiSilicon (Huawei) is currently relying on TFLite to provide the bare minimum to developers. This explains the strong difference between the three platforms.

We know that many manufacturers have been caught with their hands in the cookie jar by optimising their smartphones particularly for benchmarks (OnePlus, Meizu, Oppo, Huawei...). We therefore wonder to what extent this very particular benchmark is not likely to be a source of cheating in the future. The test being based on a very precise video and a panel of 200 photos, it should not be too hard for manufacturers to train their AIs on this particular test.

YouTube link Subscribe to FrAndroid

Anyway, AiTuTu is not yet available on the Google Play Store, but you can already download the application in APK via the button below:

Download AiTuTu Benchmark (APK)

And if you don't know how to install this APK file, our dedicated tutorial is available.

 You may also want to read:
 MIUI 11: List of Xiaomi devices getting MIUI 11 upgrade leaks
  new Dell XPS 15 (7590): price, specs, features and launch date
  Redmi K20 Pro AnTuTu Benchmark Score beyond Xiaomi Mi 9

 

Gearbest Mobile SAR Value

 

Gearbest online shopping on GearBest

Extensive Product Selection

● Over 300,000 products

● 20 different categories

● 15 local warehosues

● Multiple top brands

Convenient Payment

● Global payment options: Visa, MasterCard, American Express

● PayPal, Western Union and bank transfer are accepted

● Boleto Bancario via Ebanx (for Brazil)

Prompt Shipping

● Unregistered air mail

● Registered air mail

● Priority line

● Expedited shipping

Dedicated After-sales Service

● 45 day money back guarantee

● 365 day free repair warranty

● 7 day Dead on Arrival guarantee (DOA)

You might also like

HOT TOPICS

Related Products