Friday, 30 November 2018 12:01

AWS says race into reinforcement learning with DeepRacer

DeepRacer DeepRacer

AWS has released a 1/18th scale autonomous race car dubbed DeepRacer at its AWS re:Invent conference as a way to help developers get started with reinforcement learning. The company also previewed its forthcoming Inferentia inferencing chip.

Where supervised learning involves matching human-created tags (as in image recognition, for example) and unsupervised learning basically finds patterns in complex data, reinforcement learning models work by trying various strategies to optimise a specified reward function.

Apart from the car itself (which is available for pre-order at US$249, with a regular price of US$399), the DeepRacer system includes a 3D physics simulator in the cloud. Users create their own reward function and train the model in the simulator — using Amazon SageMaker — before deploying it to the car.

SageMaker Neo, available immediately, compiles deep learning models for specific hardware platforms (including those from Nvidia, Intel and Arm), with automatic optimisation providing up to double the performance with no loss of accuracy.

The DeepRacer League is open to all-comers, with 20 races to be held at the various AWS Summits to be held during 2019. In addition, virtual tournaments will be held over the next 12 months. The winners, along with other top scorers will participate in the Championship Cup to be held at AWS re:Invent 2019.

The inaugural event, at AWS re:Invent 2018, gave entrants just 22 hours to develop and test their reinforcement learning models. The winner was Rick Fish, co-founder of UK-based Jigsaw XYZ, who recorded a lap time of 51.50 sec at the specially-constructed track in the MGM Grand Garden Arena.

In related news, lower-level ML services announced by AWS at re:Invent 2018 include new EC2 instances (available next week), a version of TensorFlow optimised to run on AWS (improving GPU utilisation from 65% to 90%, and halving training times compared with the previous market-leading platform), and Amazon Elastic Inference (elastic GPU provisioning for EC2 instances, with pay-for-use pricing delivering a "huge saving").

Jassy also announced that AWS Inferentia, a custom designed, high-performance machine learning inferencing chip. to be available in 2019, Inferentia supports multiple data types and multiple frameworks (including TensorFlow and Pytorch), and delivers hundreds of TFLOPS per chip.

"This is a big gamechanger," said Jassy.

Disclosure: The writer attended AWS re:Invent as a guest of the company.


You cannot afford to miss this Dell Webinar.

With Windows 7 support ending 14th January 2020, its time to start looking at your options.

This can have significant impacts on your organisation but also presents organisations with an opportunity to fundamentally rethink the way users work.

The Details

When: Thursday, September 26, 2019
Presenter: Dell Technologies
Location: Your Computer


QLD, VIC, NSW, ACT & TAS: 11:00 am
SA, NT: 10:30 am
WA: 9:00 am NZ: 1:00 pm

Register and find out all the details you need to know below.



iTWire can help you promote your company, services, and products.


Advertise on the iTWire News Site / Website

Advertise in the iTWire UPDATE / Newsletter

Promote your message via iTWire Sponsored Content/News

Guest Opinion for Home Page exposure

Contact Andrew on 0412 390 000 or email [email protected]


Stephen Withers

joomla visitors

Stephen Withers is one of Australia¹s most experienced IT journalists, having begun his career in the days of 8-bit 'microcomputers'. He covers the gamut from gadgets to enterprise systems. In previous lives he has been an academic, a systems programmer, an IT support manager, and an online services manager. Stephen holds an honours degree in Management Sciences and a PhD in Industrial and Business Studies.



Recent Comments