Preprocessing
分类 | 名称 | 说明 |
---|---|---|
Binning | KBinsDiscretizer | 特征分箱:等频、等宽、Kmeans |
Scaling | MaxAbsScaler | 特征缩放:绝对值最大为1 |
MinMaxScaler | 特征缩放:数值范围 [-1, 1] | |
StandardScaler | 特征缩放:均值为0、方差为1 | |
RobustScaler | 特征缩放:数值范围 [Q2, Q3](分位数) | |
Normalizer | 样本缩放:范数等于1 | |
Encoding | LabelBinarizer | 标签编码:one-hot |
LabelEncoder | 标签编码:序数 | |
MultiLabelBinarizer | 标签编码:multi-hot | |
OneHotEncoder | 特征编码:one-hot | |
OrdinalEncoder | 特征编码:序数 | |
TargetEncoder | 特征编码:基于targets | |
Transformation | QuantileTransformer | 特征变换:均匀分布、高斯分布 |
SplineTransformer | 特征变换:基于B-spline | |
Imputation | SimpleImputer | 缺失值填充:平均数、中位数、众数、常数 |
如果是通过docker方式部署:先执行 docker exec -it primihub-node0 bash
进入到 primihub-node0
容器中:再执行CLI命令启动。
横向联邦
KBinsDiscretizer
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_kbinsdiscretizer.json"
submit example/FL/preprocessing/hfl_kbinsdiscretizer.json
MaxAbsScaler
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_maxabsscaler.json"
submit example/FL/preprocessing/hfl_maxabsscaler.json
MinMaxScaler
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_minmaxscaler.json"
submit example/FL/preprocessing/hfl_minmaxscaler.json
StandardScaler
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_standardscaler.json"
submit example/FL/preprocessing/hfl_standardscaler.json
RobustScaler
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_robustscaler.json"
submit example/FL/preprocessing/hfl_robustscaler.json
LabelBinarizer
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_labelbinarizer.json"
submit example/FL/preprocessing/hfl_labelbinarizer.json
LabelEncoder
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_labelencoder.json"
submit example/FL/preprocessing/hfl_labelencoder.json
MultiLabelBinarizer
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_multilabelbinarizer.json"
submit example/FL/preprocessing/hfl_multilabelbinarizer.json
OneHotEncoder
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_onehotencoder.json"
submit example/FL/preprocessing/hfl_onehotencoder.json
OrdinalEncoder
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_ordinalencoder.json"
submit example/FL/preprocessing/hfl_ordinalencoder.json
TargetEncoder
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_targetencoder.json"
submit example/FL/preprocessing/hfl_targetencoder.json
QuantileTransformer
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_quantiletransformer.json"
submit example/FL/preprocessing/hfl_quantiletransformer.json
SplineTransformer
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_splinetransformer.json"
submit example/FL/preprocessing/hfl_splinetransformer.json
SimpleImputer
- CLI
- Python SDK
数字型数据
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_simpleimputer_numeric.json"
字符型数据
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_simpleimputer_string.json"
数字型数据
submit example/FL/preprocessing/hfl_simpleimputer_numeric.json
字符型数据
submit example/FL/preprocessing/hfl_simpleimputer_string.json
Pipeline Demo
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_pipeline.json"
submit example/FL/preprocessing/hfl_pipeline.json
transform
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/hfl_transform.json"
submit example/FL/preprocessing/hfl_transform.json
纵向联邦
Normalizer
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/vfl_normalizer.json"
submit example/FL/preprocessing/vfl_normalizer.json
Pipeline Demo
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/vfl_pipeline.json"
submit example/FL/preprocessing/vfl_pipeline.json
transform
- CLI
- Python SDK
./primihub-cli --task_config_file="example/FL/preprocessing/vfl_transform.json"
submit example/FL/preprocessing/vfl_transform.json