Seeing AI. It's a new app from Microsoft designed for the "low vision community", and is a research project app that “harnesses the power of AI to describe people, text and objects”.
Sadly, it is only avaialble in the US at the moment to iPhone users, but hopefully will become more widely available.
If you saw the movie ‘Her’, which featured the voice of Scarlett Johansson as the artificial intelligence in the protagonist’s computer and phone, you can imagine that AI would have used similar technology to understand what its camera saw, except at a vastly more advanced level, which is natural for a sci-fi film.
Speaks text as soon as it appears in front of the camera
Provides audio guidance to capture a printed page, and recognises the text, along with its original formatting
Gives audio beeps to help locate barcodes and then scans them to identify products
Recognises friends and describes people around you, including their emotions
An experimental feature to describe the scene around you
Identify currency bills when paying with cash. (Coming soon, US currency only for now)
Turns the visual world into an audible experience.
Now, given that the Google Search app lets you look at things and can tell you, for example, what kind of plant you’re looking at, which is something that Samsung's Bixby app for Galay S8 and S8+ can do too, this tech is definitely on its way for all, and a great example of how far artificial intelligence is coming.
Thankfully a completely autonomous and fully artificially intelligent Terminator robot with the same technology to identify humans is still in the realms of science fiction – or at least, for now!
Also - if you create a free iTunes US account (there are instructions online if you search), it is actually possible to download the Seeing AI app in Australia, but then when updates are due, you'll have to flick between Apple ID logins for the iTunes store, which can be annoying - but it can be done.
Here’s the video: