Home Apps Microsoft’s ‘Seeing AI’ app lets your iPhone narrate what it sees

Microsoft is releasing a new app — in the US only for now — that “sees” for you and narrates the world around you.

Seeing AI. It's a new app from Microsoft designed for the "low vision community", and is a research project app that “harnesses the power of AI to describe people, text and objects”.

Sadly, it is only avaialble in the US at the moment to iPhone users, but hopefully will become more widely available.

If you saw the movie ‘Her’, which featured the voice of Scarlett Johansson as the artificial intelligence in the protagonist’s computer and phone, you can imagine that AI would have used similar technology to understand what its camera saw, except at a vastly more advanced level, which is natural for a sci-fi film.

So, what kinds of things does Microsoft say Seeing AI can do?

Short Text
Speaks text as soon as it appears in front of the camera

Provides audio guidance to capture a printed page, and recognises the text, along with its original formatting

Gives audio beeps to help locate barcodes and then scans them to identify products

Recognises friends and describes people around you, including their emotions

An experimental feature to describe the scene around you

Identify currency bills when paying with cash. (Coming soon, US currency only for now)

Turns the visual world into an audible experience.

Now, given that the Google Search app lets you look at things and can tell you, for example, what kind of plant you’re looking at, which is something that Samsung's Bixby app for Galay S8 and S8+ can do too, this tech is definitely on its way for all, and a great example of how far artificial intelligence is coming.

Thankfully a completely autonomous and fully artificially intelligent Terminator robot with the same technology to identify humans is still in the realms of science fiction – or at least, for now!

Also - if you create a free iTunes US account (there are instructions online if you search), it is actually possible to download the Seeing AI app in Australia, but then when updates are due, you'll have to flick between Apple ID logins for the iTunes store, which can be annoying - but it can be done.

Here’s the video:


Our Mesh WiFi system MW3 is the first in Australia market with price below AUD$200 for a set of three.

· Best valued product
· Strong signal covering up to 300m2 for MW3 and 500m2 for MW6
· Aesthetically pleasing and light weigh (blend into any room deco)
· Wireline backhauls supported
· Product units are pre-paired and easy to setup
· Not requiring phone number or email address to set up
· Wall penetration (better than other similar brands)
· Seamless WiFi roaming
· User friendly app with controls to setup a guest network, parental controls for disabling groups of devices you allocate to individuals, QoS and more



Australia is a cyber espionage hot spot.

As we automate, script and move to the cloud, more and more businesses are reliant on infrastructure that has the high potential to be exposed to risk.

It only takes one awry email to expose an accounts’ payable process, and for cyber attackers to cost a business thousands of dollars.

In the free white paper ‘6 Steps to Improve your Business Cyber Security’ you’ll learn some simple steps you should be taking to prevent devastating and malicious cyber attacks from destroying your business.

Cyber security can no longer be ignored, in this white paper you’ll learn:

· How does business security get breached?
· What can it cost to get it wrong?
· 6 actionable tips


Alex Zaharov-Reutt

One of Australia’s best-known technology journalists and consumer tech experts, Alex has appeared in his capacity as technology expert on all of Australia’s free-to-air and pay TV networks on all the major news and current affairs programs, on commercial and public radio, and technology, lifestyle and reality TV shows. Visit Alex at Twitter here.


Popular News




Sponsored News