Multiverso Caffe Benchmark

Note: This benchamrk is a work in progress, we will add more experiments and documents soon.

Task Description

Perform CIFAR-10 classification with Alex full model.

Codebase

Distributed Training For Caffe With Multiverso

Setup

Please follow this guide to setup your environment.

Hardware

• Hosts : 1
• GPU : GeForce GTX TITAN X * 4
• CPU : Intel(R) Core(TM) i7-5960X CPU @ 3.00GHz
• Memory : 128GB

Common settings

• batchSize per GPU: 100
• reduce learning rate after 120 epochs by factor 0f 10 then another factor of 10 after 10 more epochs

Results

Code Name	#Process(es)	#GPU(s) per Process	Use multiverso	Seconds per epoch	Best Model
1P1G0M	1	1	0	--	81.37 %
1P4G0M	1	4	0	--	81.21 %
4P1G1M	4	1	1	--	80.93 %