Social Media Sidebar

Announcement

Please sign up, comment on articles and bring your friends!

Current poll

PlanetTech is asking:

What do you think about our new web site?

Love it, indeed
Really good solution
Same as old one
The old one was better
This is a new option

Quote of the day

'By far the greatest danger of Artificial Intelligence is that people conclude too early that they understand it'

 

Eliezer Yudkowsky

Cray and Microsoft accelerate deep learning training to minutes instead of weeks

RATE THIS! +24
Posted in Software on 12th Dec, 2016 02:35 PM by AlexMuller

A team of researchers have been working on a project to speed up the use of deep learning algorithms on supercomputers. They accelerated the training process. Instead of waiting weeks or months for results, data scientists can obtain results within hours or even minutes.

 

With the introduction of supercomputing architectures and technologies to deep learning frameworks, customers now have the ability to solve a whole new class of problems, such as moving from image recognition to video recognition, and from simple speech recognition to natural language processing with context.

 
The team have scaled the Microsoft Cognitive Toolkit, an open-source suite that trains deep learning algorithms, to more than 1,000 Nvidia Tesla P100 GPU accelerators on the Swiss centre's Cray XC50 supercomputer, which is nicknamed Piz Daint.
 
Deep learning problems share algorithmic similarities with applications traditionally run on a massively parallel supercomputer. By optimizing inter-node communication using the Cray® XC™ Aries network and a high performance MPI library, each training job can leverage significantly more compute resources, reducing the time required to train an individual model. 
 
“Cray’s proficiency in performance analysis and profiling, combined with the unique architecture of the XC systems, allowed us to bring deep learning problems to our Piz Daint system and scale them in a way that nobody else has,” said Prof. Dr. Thomas C. Schulthess, director of the Swiss National Supercomputing Centre (CSCS). “What is most exciting is that our researchers and scientists will now be able to use our existing Cray XC supercomputer to take on a new class of deep learning problems that were previously infeasible.”
 
“Applying a supercomputing approach to optimize deep learning workloads represents a powerful breakthrough for training and evaluating deep learning algorithms at scale,” said Dr. Xuedong Huang, distinguished engineer, Microsoft AI and Research. “Our collaboration with Cray and CSCS has demonstrated how the Microsoft Cognitive Toolkit can be used to push the boundaries of deep learning.”
 
The result of this deep learning collaboration opens the door for researchers to run larger, more complex, and multi-layered deep learning workloads at scale, harnessing the performance of a Cray supercomputer.
 
To simplify the building and deploying of deep learning environments in supercomputing, Cray is supporting its Cray XC customers with deep learning toolkits, such as the Microsoft Cognitive Toolkit, that allow customers to run deep learning applications at their fullest potential, at scale on a Cray supercomputer. Fusing high performance computing capability with deep learning is another step forward in Cray’s vision of the convergence of supercomputing and big data.
 
“Only Cray can bring the combination of supercomputing technologies, supercomputing best practices, and expertise in performance optimization to scale deep learning problems,” said Dr. Mark S. Staveley, Cray’s director of deep learning and machine learning. “We are working to unlock possibilities around new approaches and model sizes, turning the dreams and theories of scientists into something real that they can explore. Our collaboration with Microsoft and CSCS is a game changer for what can be accomplished using deep learning.”

Tags: computingcomputerMicrosoftsoftwareAIdeep learning

Read original article » Back to category

Comments

Author: Guest
Posted: 2016-12-26
+0
Ludovic, first of all- thanks for stopping by my blog! I adore the 35mm 1.4 and I han;#&v8217et been disappointed for a moment that I purchased it. For my every day life it’s been pretty much on my camera non-stop. I love it, and it’s currently my go-to lens! For a crop sensor (like your 60D) it will crop more like a 50mm frame, but that’s why I got mine in the first place- to go with my 7D! You won’t be disappointed! Reply


 

Recent headlines

  • Posted in Software on 2017-03-25 14:13:38
    Google Develops A Deep Learning Machine That Could Learn.....read more
    Posted in Medicine on 2017-03-25 14:26:25
    Google’s Calico partners with new biotech firm to.....read more
    Posted in Business on 2017-03-25 14:20:19
    25 US Cities Are Now Committed to 100% Renewable Energy..read more
    Posted in Science on 2017-03-25 14:16:44
    New Lenses Could Give You Super Color Vision..read more
    Posted in Business on 2017-03-24 19:18:37
    This company replaced 90% of its workforce with machines......read more
Posted in Business on 2013-10-10 01:33
China is working towards a manned lunar mission in about.....read more
Posted in Business on 2013-10-20 07:17
Spacex says China is their main competitor for commercial.....read more
Posted in Software on 2013-10-20 06:43
Pirate Bay Browser Clocks 1,000,000 Downloads..read more
Posted in Medicine on 2013-10-10 02:10
Google reportedly investing hundreds of millions into new.....read more
Posted in Medicine on 2013-10-14 03:13
Endothelial Cells Can Repair and Regenerate Organs,.....read more
Posted in Science on 01.01.2010
Spacex says China is their main competitor for commercial.....read more
Posted in Science on 01.01.2010
Staring at Your Phone Could Be Making You Short Sighted..read more
Posted in Science on 01.01.2010
Oculus Rift virtual reality headset coming to mobile, but.....read more
Posted in Science on 01.01.2010
China is working towards a manned lunar mission in about.....read more
Posted in Science on 01.01.2010
Delivering drugs via nanoparticles to target mitochondria..read more

Recent Blog Posts

  • Posted by AlexMuller
    Intensive medical treatment can reverse type 2 diabetes..read more
    Posted by AlexMuller
    Daily consumption of tea protects the elderly from cognitive.....read more
    Posted by AlexMuller
    New analysis method of metabolites accurately predicts whether.....read more
    Posted by AlexMuller
    Unproven stem cell 'therapy' blinds three patients at Florida.....read more
    Posted by AlexMuller
    Indigenous South American group has healthiest arteries of all.....read more

Login to your Account

Login to your PlanetTech Account here

Username:
Password:
Remember me
or

Create a New Account

You just need username and password

The following errors occured:
Username:
Email:
Password:
Verify password:
Remember me