GPUMLib is an open source Graphics Processing Unit Machine Learning Library. GPUMLib aims to empower the machine learning community with a high performance library by tapping on the GPU enormous parallel computational power. This library is mainly developed in C++ and CUDA (with some C# tools).

Download now!
GPUMLib

Powering Machine Learning

Download GPUMLib version 0.3.5

Please choose the appropriate version

Windows setup (64 bits)
Other operating systems (source code)

Features

Version 0.3.5 includes the following machine learning algorithms and components:

  • Back-Propagation (BP)
  • Multiple Back-Propagation (MBP)
  • Non-Negative Matrix Factorization (NMF)
  • Semi-Supervised Non-Negative Matrix Factorization (SSNMF)
  • Autonomous Training System (ATS) for creating BP and MBP networks
  • Neural Selective Input Model (NSIM) for BP and MPB (NSIM allows neural networks to handle missing values directly)
  • Restricted Boltzmann Machines (RBMs)
  • Deep Belief Networks (DBNs)
  • Support Vector Machines (SVMs)
  • Self Organizing Maps (SOMs)
  • SOM surface recontruction
  • Radial Basis Function Networks (RBF)*
  • Resource Allocating Networks with Long Term Memory(RAN)*

* Not working in this version as these depend on CULA libraries (now obsolete). However the source code for these components is still available. We hope to fix this issue in future versions.

Citing GPUMLib

If you make use of GPUMLib in your work and want to cite GPUMLib (thank you), we would prefer that you would cite the appropriate papers above, since they form the core of GPUMLib.

The following publications describe work integrated in GPUMLib:

  • General
    • Noel Lopes and Bernardete Ribeiro. GPUMLib: An efficient open-source GPU machine learning library. International Journal of Computer Information Systems and Industrial Management Applications 3:355-362, 2011.
    • Noel Lopes, Bernardete Ribeiro, and Ricardo Quintas. GPUMLib: A new library to combine machine learning algorithms with graphics processing units. In IEEE 10th International Conference on Hybrid Intelligent Systems (HIS 2010) , pages 229-232, August 2010.
  • Back-Propagation, Multiple Back-Propagation and Autonomous Training System
    • Noel Lopes and Bernardete Ribeiro. An evaluation of multiple feed-forward networks on GPUs. International Journal of Neural Systems (IJNS) , 21(1):31-47, 2011.
    • Noel Lopes and Bernardete Ribeiro. Stochastic GPU-based multithread implementation of multiple back-propagation. In Second International Conference on Agents and Artificial Intelligence (ICAART 2010) , pages 271-276, 2010.
    • Noel Lopes and Bernardete Ribeiro. GPU implementation of the multiple back-propagation algorithm. In 10th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2009), LNCS 5788 , pages 449-456. Springer, 2009.
    • Noel Lopes and Bernardete Ribeiro. An efficient gradient-based learning algorithm applied to neural networks with selective actuation neurons. Neural, Parallel and Scientific Computations , 11:253-272, 2003.
    • Noel Lopes and Bernardete Ribeiro. Hybrid learning in a multi-neural network architecture. In INNS-IEEE International Joint Conference on Neural Networks (IJCNN 2001) , volume 4, pages 2788-2793, 2001.
  • Neural Selective Input Model (NSIM)
    • Noel Lopes and Bernardete Ribeiro. Handling missing values via a neural selective input model. Neural Network World , 22(4):357-370, 2012.
    • Noel Lopes and Bernardete Ribeiro. A robust learning model for dealing with missing values in many-core architectures. In 10th International Conference on Adaptive and Natural Computing Algorithms (ICANNGA 2011), Part II, LNCS 6594 , pages 108-117. Springer Berlin Heidelberg, 2011.
    • Noel Lopes and Bernardete Ribeiro. A strategy for dealing with missing values by using selective activation neurons in a multi-topology framework. In IEEE World Congress on Computational Intelligence (WCCI 2010) , 2010.
  • Deep Belief Networks and Restricted Boltzmann Machines
    • Noel Lopes and Bernardete Ribeiro. Towards adaptive learning with improved convergence of deep belief networks on graphics processing units. Pattern Recognition , 47(1):114-127, 2014.
    • Noel Lopes, Bernardete Ribeiro, and João Gonçalves. Restricted Boltzmann machines and deep belief networks on multi-core processors. In The 2012 International Joint Conference on Neural Networks (IJCNN) , 2012.
    • Noel Lopes and Bernardete Ribeiro. Improving convergence of restricted Boltzmann machines via a learning adaptive step size. In Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, LNCS 7441 , pages 511-518. Springer Berlin / Heidelberg, 2012.
  • Semi-Supervised Non-Negative Matrix Factorization and Non-Negative Matrix Factorization
    • Noel Lopes and Bernardete Ribeiro. A fast optimized semi-supervised non-negative matrix factorization algorithm. In IEEE International Joint Conference on Neural Networks (IJCNN 2011) , pages 2495-2500, 2011.
    • Noel Lopes and Bernardete Ribeiro. Non-negative matrix factorization implementation using graphic processing units. In 11th International Conference on Intelligent Data Engineering and Automated Learning (IDEAL 2010), LNCS 6283 , pages 275-283. Springer, 2010.
  • Resource Allocating Networks and Radial Basis Functions
    • Bernardete Ribeiro, Ricardo Quintas, and Noel Lopes. Evaluation of a resource allocating network with long term memory using GPU. In 10th International Conference on Adaptive and Natural Computing Algorithms (ICANNGA 2011), Part II, LNCS 6594 , pages 41-47. Springer, 2011.
  • Support Vector Machines
    • João Gonçalves, Noel Lopes, and Bernardete Ribeiro. Multi-threaded support vector machines for pattern recognition. In International Conference on Neural Information Processing (ICONIP 2012), Part II, LNCS 7664 , pages 616-623. Springer Berlin / Heidelberg, 2012.
  • Self-Organizing Maps and SOM surface reconstruction
    • Wai Pai Lee, Shafaatunnur Hasan, Siti Mariyam Shamsuddin, Noel Lopes. GPUMLib: Deep Learning SOM Library for Surface Reconstruction, International Journal of Advances in Soft Computing and Its Applications, 9(2), pages 1-16, 2017.
    • Shafaatunnur Hasan, Siti Mariyam Shamsuddin, and Noel Lopes. GPU Computing and Applications, chapter Soft Computing Methods for Big Data Problems, pages 235–247. Springer Singapore, 2014.
    • Shafaatunnur Hasan, Siti Mariyam Shamsuddin, and Noel Lopes. Machine learning big data framework and analytics for big data problems. International Journal of Soft Computing and its Application, 6(2), 2014.
    • Shafaatunnur Hasan, Siti Mariyam Shamsuddin, and Noel Lopes. Soft computing methods for big data problems. In 2013 Symposium on GPU Computing and Applications, 2013.
Other related articles:
  • Bernardete Ribeiro and Noel Lopes. Extreme learning classifier with deep concepts. In Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications, LNCS 8258 pages 182-189. Springer Berlin / Heidelberg, 2013.
  • Shafaatunnur Hasan, Siti~Mariyam Shamsuddin, and Noel Lopes. Soft computing methods for big data problems. In 2013 Symposium on GPU Computing and Applications, 2013.
  • Noel Lopes and Bernardete Ribeiro. Towards a hybrid NMF-based neural approach for face recognition on GPUs. International Journal of Data Mining, Modelling and Management (IJDMMM) , 4(2):138-155, 2012.
  • Bernardete Ribeiro and Noel Lopes. Deep belief networks for financial prediction. In International Conference on Neural Information Processing (ICONIP 2011), Part III, LNCS 7064 , pages 766-773. Springer, 2011.
  • Bernardete Ribeiro, Noel Lopes, and Catarina Silva. High-performance bankruptcy prediction model using graphics processing units. In IEEE World Congress on Computational Intelligence (WCCI 2010) , 2010.
  • Noel Lopes and Bernardete Ribeiro. A hybrid face recognition approach using GPUMLib. In 15th Iberoamerican Congress on Pattern Recognition (CIARP 2010), LNCS 6419 , pages 96-103. Springer, 2010.
  • Noel Lopes and Bernardete Ribeiro. MBPGPU: A supervised pattern classifier for graphical processing units. In 15th edition of the Portuguese Conference on Pattern Recognition (RECPAD 2009) , 2009.
  • Noel Lopes and Bernardete Ribeiro. Fast pattern classification of ventricular arrhythmias using graphics processing units. In 14th Iberoamerican Congress on Pattern Recognition (CIARP 2009), LNCS 5856 , pages 603-610. Springer, 2009.

Developers

Noel Lopes1,2
Bernardete Ribeiro1 (Advisor)
Ricardo Quintas1
João Gonçalves1
Shafaatunnur Hasan3
Siti Mariyam Shamsuddin3
Wai Pai Lee3

1CISUC - Center for Informatics and Systems of University of Coimbra, Portugal
2IPG - Polytechnic of Guarda, Portugal
3UTM Big Data Centre, Skudai, Johor, Malaysia