Mercurial > repos > bgruening > sklearn_regression_metrics

annotate search_model_validation.py @ 18:3badea963c3b draft

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 49522db5f2dc8a571af49e3f38e80c22571068f4
author bgruening
date Tue, 09 Jul 2019 19:37:11 -0400
parents 40ee30b5e456
children 28d51b976c29
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
1 import argparse
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
2 import collections
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
3 import imblearn
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
4 import json
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
5 import numpy as np
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
6 import pandas
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
7 import pickle
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
8 import skrebate
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
9 import sklearn
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
10 import sys
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
11 import xgboost
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
12 import warnings
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
13 import iraps_classifier
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
14 import model_validations
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
15 import preprocessors
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
16 import feature_selectors
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
17 from imblearn import under_sampling, over_sampling, combine
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
18 from scipy.io import mmread
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
19 from mlxtend import classifier, regressor
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
20 from sklearn import (cluster, compose, decomposition, ensemble,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
21 feature_extraction, feature_selection,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
22 gaussian_process, kernel_approximation, metrics,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
23 model_selection, naive_bayes, neighbors,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
24 pipeline, preprocessing, svm, linear_model,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
25 tree, discriminant_analysis)
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
26 from sklearn.exceptions import FitFailedWarning
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
27 from sklearn.externals import joblib
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
28 from sklearn.model_selection._validation import _score
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
29
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
30 from utils import (SafeEval, get_cv, get_scoring, get_X_y,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
31 load_model, read_columns)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
32 from model_validations import train_test_split
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
33
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
34
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
35 N_JOBS = int(__import__('os').environ.get('GALAXY_SLOTS', 1))
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
36 CACHE_DIR = './cached'
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
37 NON_SEARCHABLE = ('n_jobs', 'pre_dispatch', 'memory', 'steps',
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
38 'nthread', 'verbose')
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
39
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
40
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
41 def _eval_search_params(params_builder):
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
42 search_params = {}
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
43
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
44 for p in params_builder['param_set']:
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
45 search_list = p['sp_list'].strip()
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
46 if search_list == '':
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
47 continue
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
48
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
49 param_name = p['sp_name']
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
50 if param_name.lower().endswith(NON_SEARCHABLE):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
51 print("Warning: `%s` is not eligible for search and was "
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
52 "omitted!" % param_name)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
53 continue
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
54
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
55 if not search_list.startswith(':'):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
56 safe_eval = SafeEval(load_scipy=True, load_numpy=True)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
57 ev = safe_eval(search_list)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
58 search_params[param_name] = ev
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
59 else:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
60 # Have `:` before search list, asks for estimator evaluatio
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
61 safe_eval_es = SafeEval(load_estimators=True)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
62 search_list = search_list[1:].strip()
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
63 # TODO maybe add regular express check
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
64 ev = safe_eval_es(search_list)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
65 preprocessors = (
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
66 preprocessing.StandardScaler(), preprocessing.Binarizer(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
67 preprocessing.Imputer(), preprocessing.MaxAbsScaler(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
68 preprocessing.Normalizer(), preprocessing.MinMaxScaler(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
69 preprocessing.PolynomialFeatures(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
70 preprocessing.RobustScaler(), feature_selection.SelectKBest(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
71 feature_selection.GenericUnivariateSelect(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
72 feature_selection.SelectPercentile(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
73 feature_selection.SelectFpr(), feature_selection.SelectFdr(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
74 feature_selection.SelectFwe(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
75 feature_selection.VarianceThreshold(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
76 decomposition.FactorAnalysis(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
77 decomposition.FastICA(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
78 decomposition.IncrementalPCA(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
79 decomposition.KernelPCA(random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
80 decomposition.LatentDirichletAllocation(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
81 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
82 decomposition.MiniBatchDictionaryLearning(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
83 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
84 decomposition.MiniBatchSparsePCA(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
85 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
86 decomposition.NMF(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
87 decomposition.PCA(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
88 decomposition.SparsePCA(random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
89 decomposition.TruncatedSVD(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
90 kernel_approximation.Nystroem(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
91 kernel_approximation.RBFSampler(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
92 kernel_approximation.AdditiveChi2Sampler(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
93 kernel_approximation.SkewedChi2Sampler(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
94 cluster.FeatureAgglomeration(),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
95 skrebate.ReliefF(n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
96 skrebate.SURF(n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
97 skrebate.SURFstar(n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
98 skrebate.MultiSURF(n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
99 skrebate.MultiSURFstar(n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
100 imblearn.under_sampling.ClusterCentroids(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
101 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
102 imblearn.under_sampling.CondensedNearestNeighbour(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
103 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
104 imblearn.under_sampling.EditedNearestNeighbours(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
105 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
106 imblearn.under_sampling.RepeatedEditedNearestNeighbours(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
107 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
108 imblearn.under_sampling.AllKNN(random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
109 imblearn.under_sampling.InstanceHardnessThreshold(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
110 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
111 imblearn.under_sampling.NearMiss(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
112 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
113 imblearn.under_sampling.NeighbourhoodCleaningRule(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
114 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
115 imblearn.under_sampling.OneSidedSelection(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
116 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
117 imblearn.under_sampling.RandomUnderSampler(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
118 random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
119 imblearn.under_sampling.TomekLinks(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
120 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
121 imblearn.over_sampling.ADASYN(random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
122 imblearn.over_sampling.RandomOverSampler(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
123 imblearn.over_sampling.SMOTE(random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
124 imblearn.over_sampling.SVMSMOTE(random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
125 imblearn.over_sampling.BorderlineSMOTE(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
126 random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
127 imblearn.over_sampling.SMOTENC(
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
128 categorical_features=[], random_state=0, n_jobs=N_JOBS),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
129 imblearn.combine.SMOTEENN(random_state=0),
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
130 imblearn.combine.SMOTETomek(random_state=0))
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
131 newlist = []
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
132 for obj in ev:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
133 if obj is None:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
134 newlist.append(None)
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
135 elif obj == 'all_0':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
136 newlist.extend(preprocessors[0:36])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
137 elif obj == 'sk_prep_all': # no KernalCenter()
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
138 newlist.extend(preprocessors[0:8])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
139 elif obj == 'fs_all':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
140 newlist.extend(preprocessors[8:15])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
141 elif obj == 'decomp_all':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
142 newlist.extend(preprocessors[15:26])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
143 elif obj == 'k_appr_all':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
144 newlist.extend(preprocessors[26:30])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
145 elif obj == 'reb_all':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
146 newlist.extend(preprocessors[31:36])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
147 elif obj == 'imb_all':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
148 newlist.extend(preprocessors[36:55])
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
149 elif type(obj) is int and -1 < obj < len(preprocessors):
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
150 newlist.append(preprocessors[obj])
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
151 elif hasattr(obj, 'get_params'): # user uploaded object
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
152 if 'n_jobs' in obj.get_params():
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
153 newlist.append(obj.set_params(n_jobs=N_JOBS))
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
154 else:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
155 newlist.append(obj)
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
156 else:
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
157 sys.exit("Unsupported estimator type: %r" % (obj))
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
158
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
159 search_params[param_name] = newlist
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
160
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
161 return search_params
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
162
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
163
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
164 def main(inputs, infile_estimator, infile1, infile2,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
165 outfile_result, outfile_object=None, groups=None):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
166 """
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
167 Parameter
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
168 ---------
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
169 inputs : str
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
170 File path to galaxy tool parameter
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
171
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
172 infile_estimator : str
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
173 File path to estimator
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
174
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
175 infile1 : str
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
176 File path to dataset containing features
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
177
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
178 infile2 : str
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
179 File path to dataset containing target values
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
180
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
181 outfile_result : str
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
182 File path to save the results, either cv_results or test result
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
183
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
184 outfile_object : str, optional
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
185 File path to save searchCV object
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
186
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
187 groups : str
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
188 File path to dataset containing groups labels
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
189 """
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
190
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
191 warnings.simplefilter('ignore')
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
192
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
193 with open(inputs, 'r') as param_handler:
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
194 params = json.load(param_handler)
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
195 if groups:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
196 (params['search_schemes']['options']['cv_selector']
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
197 ['groups_selector']['infile_g']) = groups
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
198
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
199 params_builder = params['search_schemes']['search_params_builder']
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
200
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
201 input_type = params['input_options']['selected_input']
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
202 if input_type == 'tabular':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
203 header = 'infer' if params['input_options']['header1'] else None
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
204 column_option = (params['input_options']['column_selector_options_1']
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
205 ['selected_column_selector_option'])
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
206 if column_option in ['by_index_number', 'all_but_by_index_number',
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
207 'by_header_name', 'all_but_by_header_name']:
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
208 c = params['input_options']['column_selector_options_1']['col1']
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
209 else:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
210 c = None
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
211 X = read_columns(
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
212 infile1,
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
213 c=c,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
214 c_option=column_option,
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
215 sep='\t',
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
216 header=header,
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
217 parse_dates=True).astype(float)
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
218 else:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
219 X = mmread(open(infile1, 'r'))
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
220
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
221 header = 'infer' if params['input_options']['header2'] else None
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
222 column_option = (params['input_options']['column_selector_options_2']
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
223 ['selected_column_selector_option2'])
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
224 if column_option in ['by_index_number', 'all_but_by_index_number',
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
225 'by_header_name', 'all_but_by_header_name']:
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
226 c = params['input_options']['column_selector_options_2']['col2']
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
227 else:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
228 c = None
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
229 y = read_columns(
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
230 infile2,
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
231 c=c,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
232 c_option=column_option,
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
233 sep='\t',
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
234 header=header,
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
235 parse_dates=True)
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
236 y = y.ravel()
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
237
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
238 optimizer = params['search_schemes']['selected_search_scheme']
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
239 optimizer = getattr(model_selection, optimizer)
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
240
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
241 options = params['search_schemes']['options']
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
242
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
243 splitter, groups = get_cv(options.pop('cv_selector'))
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
244 options['cv'] = splitter
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
245 options['n_jobs'] = N_JOBS
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
246 primary_scoring = options['scoring']['primary_scoring']
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
247 options['scoring'] = get_scoring(options['scoring'])
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
248 if options['error_score']:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
249 options['error_score'] = 'raise'
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
250 else:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
251 options['error_score'] = np.NaN
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
252 if options['refit'] and isinstance(options['scoring'], dict):
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
253 options['refit'] = primary_scoring
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
254 if 'pre_dispatch' in options and options['pre_dispatch'] == '':
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
255 options['pre_dispatch'] = None
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
256
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
257 with open(infile_estimator, 'rb') as estimator_handler:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
258 estimator = load_model(estimator_handler)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
259
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
260 memory = joblib.Memory(location=CACHE_DIR, verbose=0)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
261 # cache iraps_core fits could increase search speed significantly
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
262 if estimator.__class__.__name__ == 'IRAPSClassifier':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
263 estimator.set_params(memory=memory)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
264 else:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
265 for p, v in estimator.get_params().items():
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
266 if p.endswith('memory'):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
267 if len(p) > 8 and p[:-8].endswith('irapsclassifier'):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
268 # cache iraps_core fits could increase search
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
269 # speed significantly
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
270 new_params = {p: memory}
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
271 estimator.set_params(**new_params)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
272 elif v:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
273 new_params = {p, None}
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
274 estimator.set_params(**new_params)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
275 elif p.endswith('n_jobs'):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
276 new_params = {p: 1}
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
277 estimator.set_params(**new_params)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
278
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
279 param_grid = _eval_search_params(params_builder)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
280 searcher = optimizer(estimator, param_grid, **options)
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
281
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
282 # do train_test_split
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
283 do_train_test_split = params['train_test_split'].pop('do_split')
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
284 if do_train_test_split == 'yes':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
285 # make sure refit is choosen
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
286 if not options['refit']:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
287 raise ValueError("Refit must be `True` for shuffle splitting!")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
288 split_options = params['train_test_split']
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
289
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
290 # splits
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
291 if split_options['shuffle'] == 'stratified':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
292 split_options['labels'] = y
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
293 X, X_test, y, y_test = train_test_split(X, y, **split_options)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
294 elif split_options['shuffle'] == 'group':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
295 if not groups:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
296 raise ValueError("No group based CV option was "
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
297 "choosen for group shuffle!")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
298 split_options['labels'] = groups
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
299 X, X_test, y, y_test, groups, _ =\
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
300 train_test_split(X, y, **split_options)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
301 else:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
302 if split_options['shuffle'] == 'None':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
303 split_options['shuffle'] = None
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
304 X, X_test, y, y_test =\
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
305 train_test_split(X, y, **split_options)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
306 # end train_test_split
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
307
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
308 if options['error_score'] == 'raise':
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
309 searcher.fit(X, y, groups=groups)
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
310 else:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
311 warnings.simplefilter('always', FitFailedWarning)
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
312 with warnings.catch_warnings(record=True) as w:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
313 try:
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
314 searcher.fit(X, y, groups=groups)
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
315 except ValueError:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
316 pass
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
317 for warning in w:
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
318 print(repr(warning.message))
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
319
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
320 if do_train_test_split == 'no':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
321 # save results
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
322 cv_results = pandas.DataFrame(searcher.cv_results_)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
323 cv_results = cv_results[sorted(cv_results.columns)]
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
324 cv_results.to_csv(path_or_buf=outfile_result, sep='\t',
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
325 header=True, index=False)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
326
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
327 # output test result using best_estimator_
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
328 else:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
329 best_estimator_ = searcher.best_estimator_
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
330 if isinstance(options['scoring'], collections.Mapping):
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
331 is_multimetric = True
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
332 else:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
333 is_multimetric = False
16
268ecaf96b68 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit 57f4407e278a615f47a377a3328782b1d8e0b54d
bgruening
parents:
diff changeset
334
17
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
335 test_score = _score(best_estimator_, X_test,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
336 y_test, options['scoring'],
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
337 is_multimetric=is_multimetric)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
338 if not is_multimetric:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
339 test_score = {primary_scoring: test_score}
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
340 for key, value in test_score.items():
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
341 test_score[key] = [value]
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
342 result_df = pandas.DataFrame(test_score)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
343 result_df.to_csv(path_or_buf=outfile_result, sep='\t',
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
344 header=True, index=False)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
345
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
346 memory.clear(warn=False)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
347
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
348 if outfile_object:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
349 with open(outfile_object, 'wb') as output_handler:
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
350 pickle.dump(searcher, output_handler, pickle.HIGHEST_PROTOCOL)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
351
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
352
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
353 if __name__ == '__main__':
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
354 aparser = argparse.ArgumentParser()
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
355 aparser.add_argument("-i", "--inputs", dest="inputs", required=True)
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
356 aparser.add_argument("-e", "--estimator", dest="infile_estimator")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
357 aparser.add_argument("-X", "--infile1", dest="infile1")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
358 aparser.add_argument("-y", "--infile2", dest="infile2")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
359 aparser.add_argument("-r", "--outfile_result", dest="outfile_result")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
360 aparser.add_argument("-o", "--outfile_object", dest="outfile_object")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
361 aparser.add_argument("-g", "--groups", dest="groups")
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
362 args = aparser.parse_args()
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
363
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
364 main(args.inputs, args.infile_estimator, args.infile1, args.infile2,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
365 args.outfile_result, outfile_object=args.outfile_object,
40ee30b5e456 planemo upload for repository https://github.com/bgruening/galaxytools/tree/master/tools/sklearn commit ab963ec9498bd05d2fb2f24f75adb2fccae7958c
bgruening
parents: 16
diff changeset
366 groups=args.groups)