SecMML

Introduction

SecMML is a scalable and efficient MPC framework for training machine learning models based on Shamir's Secret Sharing and BGW protocol. It has the generality to be extended in the application scenarios of three+ parties in both semi-honest and malicious settings. Currently, SecMML is able to support several machine learning models, including linear regression, logistic regression, BP neural network and LSTM neural network.

Application scenario

There are two practical situations as follow:

1. Several companies each hold their own data sets. They want to train a better model on their union data sets, but would not to leak their own data sets. At first, they share their data to other parties in a secret sharing manner. In this way, each party still has a share of the entire data set. Then, as a party, each company trains the model collaboratively. When the training is completed, the model is revealed to all parties. Our framework is extensible to support arbitrary number of participants (three+) to train models on the entire data set composed of the data they hold.
2. There are a large number of individual data owners and they do not want their private data to be known by others. Internet companies want to make use of these distributed data to acquire better models. These companies may first specify several servers to perform the computation and these servers must be independent of each other. All data owners then send their data to these servers in secret sharing manner. The servers collaboratively train the model with these data and the trained model is finally revealed to the data owners. The scalability of the framework is that it can support any number of data owners, and any number of servers can be selected as computing parties.

Repository Structure

• core/: Core libaries in MPL. The fundamental matrix lib, math operator lib and Player lib.

• machine_learning/: Machine learning algorithms: neural networks, linear regression and logistic regression.

• malicious_lib/: The malicious setting.

• mnist/: Training dataset.

• util/: Data IO and network IO package. The network is implemented using socket, compatible on both Windows and Ubuntu.

• Constant.h: Some constants and general functions in SecMML. Note that, for windows users, the header UNIX_PLATFORM should be defined to use the winsocket library.

• CMakeLists.txt: Define the compile rule for the project. Note that, for windwos users, the target_link_libraries(SMMLF ws2_32) shall be uncommented.

Running

Here take training a linear regression model among three parties as an example

• Clone the SecMML git repository by running:

  git clone https://github.com/SMMLF/MPL-Public.git

• Set the number of parties to 3 (in Constant.h):

  #define M 3

• Specifiy the platform:

  • if Ubuntu (in Constant.h)

      `#ifndef UNIX_PLATFORM`
    
      `#define UNIX_PLATFORM`
      
      `#endif`
    

  • if Windows (in CMakeLists.txt):

      Add `target_link_libraries(SMMLF ws2_32)` to the file.
    

• Choose the machine learning model (main.cpp):

  • Three-layer Model: bp->graph();
  • Logisitc Regression Model: bp->logistic_graph();
  • Linear Regression Model: bp->linear_graph();

• Compile the executable file:

  • cd MPL-Public
  • cmake .
  • make

• Start three processes and input the party index, respectively:

  • ./MPL
  • Please enter party index:
  • Enter 0,1,...,M for each process in order.

Help

Any question, please contact [email protected].