Skip to content

Latest commit

 

History

History
115 lines (101 loc) · 4.6 KB

dsl_v2_predict_tutorial.md

File metadata and controls

115 lines (101 loc) · 4.6 KB

DSL version 2 predict tutorial

This documentation will give a brief tutorial of how to run a predict task after a trainning task.
We will take hetero-secureboost as an example.

Submit a training task

We can start a training job by submitting conf & dsl through flow client, Here we submit a hetero-secureboost binary classification task, whose conf and dsl are in hetero secureboost example folder.

>> flow job submit -c ./examples/dsl/v2/hetero_secureboost/test_secureboost_train_binary_conf.json -d ./examples/dsl/v2/hetero_secureboost/test_secureboost_train_dsl.json
>> {
        "data": {
            "board_url": "http://127.0.0.1:8080/index.html#/dashboard?job_id=2020103015490073208469&role=guest&party_id=10000",
            "job_dsl_path": "/fate/jobs/2020103015490073208469/job_dsl.json",
            "job_runtime_conf_path": "/fate/jobs/2020103015490073208469/job_runtime_conf.json",
            "logs_directory": "/fate/logs/2020103015490073208469",
            "model_info": {
                "model_id": "guest-10000#host-10000#model",
                "model_version": "2020103015490073208469"
            }
        },
        "jobId": "2020103015490073208469",
        "retcode": 0,
        "retmsg": "success"
    }

Then we can get a return message contains model_id and model_version.

Retrieve model_id and model_version

Forget to save model_id and model_version in the returned message? No worry. You can query the corresponding model_id and model_version of a job using the "flow job config" command.

>> flow job config -j 2020103015490073208469 -r guest -p 9999 -o ./
>> {
        "data": {
            "job_id": "2020103015490073208469",
            "model_info": {
                "model_id": "guest-10000#host-10000#model", <<- model_id needed for prediction tasks
                "model_version": "2020103015490073208469" <<- model_version needed for prediction tasks
            },
            "train_runtime_conf": {}
        },
        "retcode": 0,
        "retmsg": "download successfully, please check /fate/job_2020103015490073208469_config directory",
        "directory": "/fate/job_2020103015490073208469_config"
    }

Make a predict conf and generate predict dsl

We use flow_client to deploy components we needed in the predicting task:

flow job dsl --train-dsl-path ./examples/dsl/v2/hetero_secureboost/test_secureboost_train_dsl.json --cpn-list "reader_0, dataio_0, intersection_0, hetero_secure_boost_0" --version 2 -o ./predict_dsl

Then we got a generated dsl named with a timestamp in the output folder:

>> ls predict_dsl

We can modify existing predict conf by replacing model_id, model_version and data set name with yours to make a new predict conf. Here we replace model_id and model_version in predict conf with model_id and model_version returned by training job.

{
    "dsl_version": 2,
    "initiator": {
        "role": "guest",
        "party_id": 10000
    },
    "role": {
        "host": [
            9999
        ],
        "guest": [
            10000
        ]
    },
    "job_parameters": {
        "common": {
            "work_mode": 0,
            "backend": 0,
            "job_type": "predict",
            "model_id": "guest-10000#host-9999#model", <<-- to replace
            "model_version": "20200928174750711017114"  <<-- to replace
        }
    },
    "component_parameters": {
        "role": {
            "guest": {
                "0": {
                    "reader_0": {
                        "table": {
                            "name": "breast_hetero_guest", <<-- you can set new dataset here
                            "namespace": "experiment"
                        }
                    }
                }
            },
            "host": {
                "0": {
                    "reader_0": {
                        "table": {
                            "name": "breast_hetero_host",  <<-- you can set new dataset here
                            "namespace": "experiment"
                        }
                    }
                }
            }
        }
    }
}

Submit a predict job

Then we can submit a new predict job:

>> flow job submit -c ./examples/dsl/v2/hetero_secureboost/test_predict_conf.json -d ./predict_dsl/predict_dsl_20201030164751.json