IKO
  • Blog
  • IKO 2019
    • Programme 2019
    • Organisers 2019
    • Register 2019
    • Venue 2019
  • IKO 2017
    • Organisers 2017
    • Programme 2017
    • Resources 2017
  • IKO 2016
    • Organisers 2016
    • Programme 2016
    • Resources 2016
  • IKO 2015
    • Organisers 2015
    • Programme 2015
    • Resources 2015
  • Contact

Learn First, Label Later: How Deep Learning Works

1/30/2015

0 Comments

 
By Patrick Lambe
To follow up on yesterday's post on deep learning, this fantastic feature article on Geoff Hinton - one of the pioneers of deep learning. Deep learning works by layering the neural nets to process at successive levels of detail, with feedback loops to reinforce the successful patterns. His breakthrough in machine learning was to allow the neural networks to learn patterns first without labelling each layer - only when the machine had learnt enough would labels be applied to the layers to assign meaning for human consumption. Actually this is exactly how good taxonomy development should begin - gather the data first, figure out meaningful patterns and clusters, assign concept labels later. It's usually disastrous to go in with a preconceived label-set and try to assign whatever you have to it. As for early practical applications? Google can now read YouTube videos and learn - by itself - how to recognise cats. Lesson? Learn first, categorise later.

"Nobody is saying that this system has exceeded the human ability to classify photos; indeed, if a human hired to write captions performed at the level of this neural net, the newbie wouldn’t last until lunchtime. But it did shockingly, shockingly well for a machine. Some of the dead-on hits included “a group of young people playing a game of frisbee,” “a person riding a motorcycle on a dirt road,” and “a herd of elephants walking across a dry grass field.” Considering that the system “learned” on its own concepts like a Frisbee, road, and herd of elephants, that’s pretty impressive." Hat tip to Andrew McAfee for this.
0 Comments



Leave a Reply.

    News

    We are using this blog to keep you updated on conference planning and organisation, and to link you to informative discussion materials.

    Archives

    August 2017
    May 2017
    March 2017
    January 2017
    November 2016
    September 2016
    August 2016
    July 2016
    May 2016
    March 2016
    February 2016
    January 2016
    December 2015
    October 2015
    September 2015
    August 2015
    July 2015
    June 2015
    May 2015
    April 2015
    March 2015
    February 2015
    January 2015

    Categories

    All

    RSS Feed

Copyright © 2019 Conference Organisers. All rights reserved.