Friday, 30 November 2018 12:01

AWS says race into reinforcement learning with DeepRacer

DeepRacer DeepRacer

AWS has released a 1/18th scale autonomous race car dubbed DeepRacer at its AWS re:Invent conference as a way to help developers get started with reinforcement learning. The company also previewed its forthcoming Inferentia inferencing chip.

Where supervised learning involves matching human-created tags (as in image recognition, for example) and unsupervised learning basically finds patterns in complex data, reinforcement learning models work by trying various strategies to optimise a specified reward function.

Apart from the car itself (which is available for pre-order at US$249, with a regular price of US$399), the DeepRacer system includes a 3D physics simulator in the cloud. Users create their own reward function and train the model in the simulator — using Amazon SageMaker — before deploying it to the car.

SageMaker Neo, available immediately, compiles deep learning models for specific hardware platforms (including those from Nvidia, Intel and Arm), with automatic optimisation providing up to double the performance with no loss of accuracy.

The DeepRacer League is open to all-comers, with 20 races to be held at the various AWS Summits to be held during 2019. In addition, virtual tournaments will be held over the next 12 months. The winners, along with other top scorers will participate in the Championship Cup to be held at AWS re:Invent 2019.

The inaugural event, at AWS re:Invent 2018, gave entrants just 22 hours to develop and test their reinforcement learning models. The winner was Rick Fish, co-founder of UK-based Jigsaw XYZ, who recorded a lap time of 51.50 sec at the specially-constructed track in the MGM Grand Garden Arena.

In related news, lower-level ML services announced by AWS at re:Invent 2018 include new EC2 instances (available next week), a version of TensorFlow optimised to run on AWS (improving GPU utilisation from 65% to 90%, and halving training times compared with the previous market-leading platform), and Amazon Elastic Inference (elastic GPU provisioning for EC2 instances, with pay-for-use pricing delivering a "huge saving").

Jassy also announced that AWS Inferentia, a custom designed, high-performance machine learning inferencing chip. to be available in 2019, Inferentia supports multiple data types and multiple frameworks (including TensorFlow and Pytorch), and delivers hundreds of TFLOPS per chip.

"This is a big gamechanger," said Jassy.

Disclosure: The writer attended AWS re:Invent as a guest of the company.


Australia is a cyber espionage hot spot.

As we automate, script and move to the cloud, more and more businesses are reliant on infrastructure that has high potential to be exposed to risk.

It only takes one awry email to expose an accounts payable process, and for cyber attackers to cost a business thousands of dollars.

In the free white paper ‘6 steps to improve your Business Cyber Security’ you will learn some simple steps you should be taking to prevent devastating malicious cyber attacks from destroying your business.

Cyber security can no longer be ignored, in this white paper you will learn:

· How does business security get breached?
· What can it cost to get it wrong?
· 6 actionable tips



iTWire can help you promote your company, services, and products.


Advertise on the iTWire News Site / Website

Advertise in the iTWire UPDATE / Newsletter

Promote your message via iTWire Sponsored Content/News

Guest Opinion for Home Page exposure

Contact Andrew on 0412 390 000 or email [email protected]


Stephen Withers

joomla visitors

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.



Recent Comments