[2023/11/16-18:28:43.182] [ActivityExecutor-36] [INFO] [dku] running train_Predict_authorized_flag__binary__NP - ----------------------------------------
[2023/11/16-18:28:43.182] [ActivityExecutor-36] [INFO] [dku] running train_Predict_authorized_flag__binary__NP - DSS startup: jek version:12.3.1
[2023/11/16-18:28:43.182] [ActivityExecutor-36] [INFO] [dku] running train_Predict_authorized_flag__binary__NP - DSS home: /data/dataiku/datadir
[2023/11/16-18:28:43.182] [ActivityExecutor-36] [INFO] [dku] running train_Predict_authorized_flag__binary__NP - OS: Linux 5.10.192-183.736.amzn2.x86_64 amd64 - Java: Red Hat, Inc. 1.8.0_382
[2023/11/16-18:28:43.182] [ActivityExecutor-36] [INFO] [dku.flow.jobrunner] running train_Predict_authorized_flag__binary__NP - Allocated a slot for this activity!
[2023/11/16-18:28:43.182] [ActivityExecutor-36] [INFO] [dku.flow.jobrunner] running train_Predict_authorized_flag__binary__NP - Run activity
[2023/11/16-18:28:43.184] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Executing default pre-activity lifecycle hook
[2023/11/16-18:28:43.185] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Checking if sources are ready
[2023/11/16-18:28:43.185] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Will check readiness of TUT_BATCH.transactions_joined_prepared p=NP
[2023/11/16-18:28:43.186] [ActivityExecutor-36] [INFO] [dku.datasets.file] running train_Predict_authorized_flag__binary__NP - Building Filesystem handler config: {"connection":"filesystem_managed","path":"/TUT_BATCH.transactions_joined_prepared","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}}
[2023/11/16-18:28:43.187] [ActivityExecutor-36] [DEBUG] [dku.datasets.fsbased] running train_Predict_authorized_flag__binary__NP - getReadiness: will enumerate partition <partition:NP>
[2023/11/16-18:28:43.187] [ActivityExecutor-36] [INFO] [dku.datasets.ftplike] running train_Predict_authorized_flag__binary__NP - Enumerating Filesystem dataset prefix=
[2023/11/16-18:28:43.187] [ActivityExecutor-36] [DEBUG] [dku.datasets.fsbased] running train_Predict_authorized_flag__binary__NP - Building FS provider for dataset handler: TUT_BATCH.transactions_joined_prepared
[2023/11/16-18:28:43.187] [ActivityExecutor-36] [DEBUG] [dku.datasets.fsbased] running train_Predict_authorized_flag__binary__NP - FS Provider built
[2023/11/16-18:28:43.187] [ActivityExecutor-36] [DEBUG] [dku.fs.local] running train_Predict_authorized_flag__binary__NP - Enumerating local filesystem prefix=/
[2023/11/16-18:28:43.188] [ActivityExecutor-36] [DEBUG] [dku.fs.local] running train_Predict_authorized_flag__binary__NP - Enumeration done nb_paths=1 size=3920406
[2023/11/16-18:28:43.188] [ActivityExecutor-36] [DEBUG] [dku.datasets.fsbased] running train_Predict_authorized_flag__binary__NP - getReadiness: enumerated partition, found 1 paths, computing hash
[2023/11/16-18:28:43.188] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Checked source readiness TUT_BATCH.transactions_joined_prepared -> true
[2023/11/16-18:28:43.188] [ActivityExecutor-36] [DEBUG] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Computing hashes to propagate BEFORE activity
[2023/11/16-18:28:43.189] [ActivityExecutor-36] [DEBUG] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Recorded 1 hashes before activity run
[2023/11/16-18:28:43.189] [ActivityExecutor-36] [DEBUG] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Building recipe runner of type
[2023/11/16-18:28:43.237] [ActivityExecutor-36] [DEBUG] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Recipe runner built, will use 1 thread(s)
[2023/11/16-18:28:43.238] [ActivityExecutor-36] [DEBUG] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Starting execution thread: com.dataiku.dip.analysis.ml.prediction.flow.PredictionTrainingRecipeProxyRunner@88c51e3
[2023/11/16-18:28:43.238] [ActivityExecutor-36] [DEBUG] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Execution threads started, waiting for activity end
[2023/11/16-18:28:43.238] [FRT-61-FlowRunnable] [INFO] [dku.flow.activity] act.train_Predict_authorized_flag__binary__NP - Run thread for activity train_Predict_authorized_flag__binary__NP starting
[2023/11/16-18:28:43.253] [FRT-61-FlowRunnable] [INFO] [dku.datasets.file] act.train_Predict_authorized_flag__binary__NP - Building Filesystem handler config: {"connection":"filesystem_managed","path":"/TUT_BATCH.transactions_joined_prepared","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}}
[2023/11/16-18:28:43.253] [FRT-61-FlowRunnable] [INFO] [dku.datasets.ftplike] act.train_Predict_authorized_flag__binary__NP - Enumerating Filesystem dataset prefix=
[2023/11/16-18:28:43.253] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - Building FS provider for dataset handler: TUT_BATCH.transactions_joined_prepared
[2023/11/16-18:28:43.254] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - FS Provider built
[2023/11/16-18:28:43.254] [FRT-61-FlowRunnable] [DEBUG] [dku.fs.local] act.train_Predict_authorized_flag__binary__NP - Enumerating local filesystem prefix=/
[2023/11/16-18:28:43.254] [FRT-61-FlowRunnable] [DEBUG] [dku.fs.local] act.train_Predict_authorized_flag__binary__NP - Enumeration done nb_paths=1 size=3920406
[2023/11/16-18:28:43.254] [FRT-61-FlowRunnable] [INFO] [dku.input.push] act.train_Predict_authorized_flag__binary__NP - USTP: push selection.method=CLASS_REBALANCE_TARGET_NB_APPROX records=100000 ratio=0.02 col=authorized_flag
[2023/11/16-18:28:43.254] [FRT-61-FlowRunnable] [INFO] [dku.datasets.file] act.train_Predict_authorized_flag__binary__NP - Building Filesystem handler config: {"connection":"filesystem_managed","path":"/TUT_BATCH.transactions_joined_prepared","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}}
[2023/11/16-18:28:43.255] [FRT-61-FlowRunnable] [INFO] [dku.datasets.push] act.train_Predict_authorized_flag__binary__NP - Counting values using full-push-with-filter
[2023/11/16-18:28:43.256] [FRT-61-FlowRunnable] [INFO] [dku.datasets.file] act.train_Predict_authorized_flag__binary__NP - Building Filesystem handler config: {"connection":"filesystem_managed","path":"/TUT_BATCH.transactions_joined_prepared","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}}
[2023/11/16-18:28:43.256] [FRT-61-FlowRunnable] [INFO] [dku.datasets.ftplike] act.train_Predict_authorized_flag__binary__NP - Enumerating Filesystem dataset prefix=
[2023/11/16-18:28:43.256] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - Building FS provider for dataset handler: TUT_BATCH.transactions_joined_prepared
[2023/11/16-18:28:43.256] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - FS Provider built
[2023/11/16-18:28:43.257] [FRT-61-FlowRunnable] [DEBUG] [dku.fs.local] act.train_Predict_authorized_flag__binary__NP - Enumerating local filesystem prefix=/
[2023/11/16-18:28:43.257] [FRT-61-FlowRunnable] [DEBUG] [dku.fs.local] act.train_Predict_authorized_flag__binary__NP - Enumeration done nb_paths=1 size=3920406
[2023/11/16-18:28:43.257] [FRT-61-FlowRunnable] [INFO] [dku.input.push] act.train_Predict_authorized_flag__binary__NP - USTP: push selection.method=FULL records=-1 ratio=0.02 col=null
[2023/11/16-18:28:43.257] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - Extractor run: limit={"maxBytes":-1,"maxRecords":-1,"ordering":{"enabled":false,"rules":[]}} totalRecords=0
[2023/11/16-18:28:43.257] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.258] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.258] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - Start compressed [GZIP] stream: /data/dataiku/datadir/managed_datasets/TUT_BATCH.transactions_joined_prepared/out-s0.csv.gz / totalRecsBefore=0
[2023/11/16-18:28:43.258] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.258] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.848] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - after stream totalComp=3920406 totalUncomp=17614708 totalRec=54693
[2023/11/16-18:28:43.848] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - Extractor run done, totalCompressed=3920406 totalRecords=54693
[2023/11/16-18:28:43.850] [FRT-61-FlowRunnable] [INFO] [dku.sampling.rebalance] act.train_Predict_authorized_flag__binary__NP - Column rebalance targetRecords=100000.000000 targetCountPerModality=50000.000000 missing=45307 largeClasses=0
[2023/11/16-18:28:43.850] [FRT-61-FlowRunnable] [INFO] [dku.sampling.rebalance] act.train_Predict_authorized_flag__binary__NP - Column rebalance fixed targetCountPerModality=50000.000000d
[2023/11/16-18:28:43.850] [FRT-61-FlowRunnable] [INFO] [dku.sampling.rebalance] act.train_Predict_authorized_flag__binary__NP -  value=0 totalCount=5591 proba=8.942944
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku.sampling.rebalance] act.train_Predict_authorized_flag__binary__NP -  value=1 totalCount=49102 proba=1.018288
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - Extractor run: limit={"maxBytes":-1,"maxRecords":-1,"ordering":{"enabled":false,"rules":[]}} totalRecords=0
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - Start compressed [GZIP] stream: /data/dataiku/datadir/managed_datasets/TUT_BATCH.transactions_joined_prepared/out-s0.csv.gz / totalRecsBefore=0
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:43.851] [FRT-61-FlowRunnable] [INFO] [dku] act.train_Predict_authorized_flag__binary__NP - getCompression filename=**out-s0.csv.gz**
[2023/11/16-18:28:45.428] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - after stream totalComp=3920406 totalUncomp=17614708 totalRec=54693
[2023/11/16-18:28:45.428] [FRT-61-FlowRunnable] [INFO] [dku.format] act.train_Predict_authorized_flag__binary__NP - Extractor run done, totalCompressed=3920406 totalRecords=54693
[2023/11/16-18:28:45.439] [FRT-61-FlowRunnable] [INFO] [dku.recipes.train] act.train_Predict_authorized_flag__binary__NP - Read modeling: 
 {
  "algorithm": "RANDOM_FOREST_CLASSIFICATION",
  "rf_classifier_grid": {
    "n_estimators": {
      "gridMode": "EXPLICIT",
      "randomMode": "RANGE",
      "limit": {
        "min": 1
      },
      "values": [
        100
      ],
      "range": {
        "min": 80,
        "max": 200,
        "nbValues": 3,
        "scaling": "LINEAR"
      }
    },
    "n_jobs": 4,
    "max_tree_depth": {
      "gridMode": "EXPLICIT",
      "randomMode": "RANGE",
      "limit": {
        "min": 1
      },
      "values": [
        6,
        15
      ],
      "range": {
        "min": 6,
        "max": 20,
        "nbValues": 3,
        "scaling": "LINEAR"
      }
    },
    "min_samples_leaf": {
      "gridMode": "EXPLICIT",
      "randomMode": "RANGE",
      "limit": {
        "min": 1
      },
      "values": [
        1
      ],
      "range": {
        "min": 1,
        "max": 20,
        "nbValues": 3,
        "scaling": "LINEAR"
      }
    },
    "selection_mode": "auto",
    "max_features": {
      "gridMode": "EXPLICIT",
      "randomMode": "RANGE",
      "limit": {
        "min": 1
      },
      "values": [
        5
      ],
      "range": {
        "min": 1,
        "max": 20,
        "nbValues": 3,
        "scaling": "LINEAR"
      }
    },
    "max_feature_prop": {
      "gridMode": "EXPLICIT",
      "randomMode": "RANGE",
      "limit": {
        "min": 1.0E-23,
        "max": 1.0
      },
      "values": [
        0.3
      ],
      "range": {
        "min": 0.1,
        "max": 0.7,
        "nbValues": 3,
        "scaling": "LINEAR"
      }
    },
    "enabled": true
  },
  "max_ensemble_nodes_serialized": 6000,
  "metrics": {
    "customMetrics": [],
    "evaluationMetric": "ROC_AUC",
    "customEvaluationMetricGIB": true,
    "customEvaluationMetricNeedsProba": false,
    "thresholdOptimizationMetric": "F1",
    "costMatrixWeights": {
      "tpGain": 1.0,
      "tnGain": 0.0,
      "fpGain": -0.3,
      "fnGain": 0.0
    },
    "liftPoint": 0.4,
    "netUpliftPoint": 0.5
  },
  "autoOptimizeThreshold": true,
  "forcedClassifierThreshold": 0.0,
  "gridLength": 2,
  "grid_search_params": {
    "mode": "KFOLD",
    "splitRatio": 0.8,
    "shuffleIterations": 1,
    "nFolds": 5,
    "cvSeed": 1337,
    "stratified": true,
    "grouped": false,
    "strategy": "GRID",
    "bayesianOptimizer": "SCIKIT_OPTIMIZE",
    "randomized": true,
    "seed": 1337,
    "nIter": 0,
    "nIterRandom": 5,
    "timeout": 0,
    "nJobs": 4,
    "distributed": false,
    "nContainers": 4,
    "foldOffset": true
  },
  "pluginAlgoCustomGridSearch": false,
  "computeLearningCurves": false,
  "skipExpensiveReports": false
}
[2023/11/16-18:28:45.445] [FRT-61-FlowRunnable] [INFO] [dku.utils.fsacl] act.train_Predict_authorized_flag__binary__NP - Impersonating: FS granting additional READ access to dataiku_user
[2023/11/16-18:28:45.446] [FRT-61-FlowRunnable] [DEBUG] [dku.security.fsacl] act.train_Predict_authorized_flag__binary__NP - exec setfacl: sudo -n /etc/dataiku-security/0awPj26qXBLdQ9J3gz21sk99/execwrapper.sh acls setfacl --path /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5 --perm u:dataiku_user:r-x --perm u:dataiku:rwx --affected-user dataiku_user --recursive
[2023/11/16-18:28:45.504] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,504 180976 INFO Reading security conf from /etc/dataiku-security/0awPj26qXBLdQ9J3gz21sk99
[2023/11/16-18:28:45.505] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,504 180976 INFO Allowed path: /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5 in /data/dataiku/datadir
[2023/11/16-18:28:45.505] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,504 180976 INFO Reading security conf from /etc/dataiku-security/0awPj26qXBLdQ9J3gz21sk99
[2023/11/16-18:28:45.505] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,505 180976 INFO Allowed group ids: [1002]
[2023/11/16-18:28:45.507] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,507 180976 INFO User dataiku_user belongs to groups: [1001, 1002]
[2023/11/16-18:28:45.507] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,507 180976 INFO User dataiku_user belongs to group 1002 (dataiku_user_group) -> allowed
[2023/11/16-18:28:45.507] [null-err-63] [INFO] [dku.utils]  - 2023-11-16 18:28:45,507 180976 INFO Executing: ['setfacl', '-RP', '-m', 'u:dataiku_user:r-x,u:dataiku:rwx', '/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5']
[2023/11/16-18:28:45.517] [Thread-40] [DEBUG] [dku.utils]  - Process sudo done (return code 0)
[2023/11/16-18:28:45.517] [FRT-61-FlowRunnable] [INFO] [dku.utils.fsacl] act.train_Predict_authorized_flag__binary__NP - Impersonating: FS granting additional access to dataiku_user
[2023/11/16-18:28:45.517] [FRT-61-FlowRunnable] [DEBUG] [dku.security.fsacl] act.train_Predict_authorized_flag__binary__NP - exec setfacl: sudo -n /etc/dataiku-security/0awPj26qXBLdQ9J3gz21sk99/execwrapper.sh acls setfacl --path /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239 --perm d:u:dataiku_user:rwx --perm d:u:dataiku:rwx --perm u:dataiku_user:rwx --perm u:dataiku:rwx --affected-user dataiku_user --recursive
[2023/11/16-18:28:45.573] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,573 180983 INFO Reading security conf from /etc/dataiku-security/0awPj26qXBLdQ9J3gz21sk99
[2023/11/16-18:28:45.573] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,573 180983 INFO Allowed path: /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239 in /data/dataiku/datadir
[2023/11/16-18:28:45.573] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,573 180983 INFO Reading security conf from /etc/dataiku-security/0awPj26qXBLdQ9J3gz21sk99
[2023/11/16-18:28:45.574] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,574 180983 INFO Allowed group ids: [1002]
[2023/11/16-18:28:45.576] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,576 180983 INFO User dataiku_user belongs to groups: [1001, 1002]
[2023/11/16-18:28:45.576] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,576 180983 INFO User dataiku_user belongs to group 1002 (dataiku_user_group) -> allowed
[2023/11/16-18:28:45.576] [null-err-66] [INFO] [dku.utils]  - 2023-11-16 18:28:45,576 180983 INFO Executing: ['setfacl', '-RP', '-m', 'd:u:dataiku_user:rwx,d:u:dataiku:rwx,u:dataiku_user:rwx,u:dataiku:rwx', '/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239']
[2023/11/16-18:28:45.584] [Thread-43] [DEBUG] [dku.utils]  - Process sudo done (return code 0)
[2023/11/16-18:28:45.585] [FRT-61-FlowRunnable] [INFO] [dku.recipes.prediction.train] act.train_Predict_authorized_flag__binary__NP - Run training in code env built-in (set at deploy-time)
[2023/11/16-18:28:45.587] [FRT-61-FlowRunnable] [INFO] [dku.ml.distributed.service] act.train_Predict_authorized_flag__binary__NP - New worker pool created: pool-gkqgzktydoylrptp
[2023/11/16-18:28:45.587] [FRT-61-FlowRunnable] [INFO] [dku.recipes.prediction.train] act.train_Predict_authorized_flag__binary__NP - Attached remote worker pool to training kernel: pool-gkqgzktydoylrptp
[2023/11/16-18:28:45.594] [FRT-61-FlowRunnable] [DEBUG] [dku.remoterun.registry] act.train_Predict_authorized_flag__binary__NP - Registering container execution prediction-training-km6zokl of type RECIPE_PREDICTION_TRAIN_PYTHON
[2023/11/16-18:28:45.595] [FRT-61-FlowRunnable] [INFO] [dku.containerexec.imageshelper] act.train_Predict_authorized_flag__binary__NP - Finding out which image to use for requestedBase=dss-gis-exec-base-12.3.1:1.0.74 envLang=PYTHON envName=null envVersion=null
[2023/11/16-18:28:45.595] [FRT-61-FlowRunnable] [INFO] [dku.containerexec.imageshelper] act.train_Predict_authorized_flag__binary__NP - No env, using base
[2023/11/16-18:28:45.596] [FRT-61-FlowRunnable] [DEBUG] [dku.resourceusage] act.train_Predict_authorized_flag__binary__NP - Reporting start of CRU:{"context":{"type":"JOB_ACTIVITY","authIdentifier":"sean.angiolillo@dataiku.com","projectKey":"TUT_BATCH","jobId":"Scenario_build_Predict_authorized_flag__binary__2023-11-16T18-28-12.334","activityId":"train_Predict_authorized_flag__binary__NP","activityType":"recipe","recipeType":"prediction_training","recipeName":"train_Predict_authorized_flag__binary_"},"type":"SINGLE_K8S_JOB","id":"woNOtnJJYCHMG8yq","startTime":1700159325596,"singleK8SJob":{"k8sClusterId":"__builtin__","executionId":"prediction-training-km6zokl","cpuRequest":1.0,"cpuLimit":1.0,"memoryRequestMB":4086,"memoryLimitMB":4096}}
[2023/11/16-18:28:45.596] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Executing recipe on Kubernetes with config=CPU-M-1-cpu-4Gb-Ram, using image '424205999409.dkr.ecr.eu-west-1.amazonaws.com/gis-dataiker-2-registry/user-code-env/space-500c3c3c-int2/dss-gis-exec-base-12.3.1:1.0.74'
[2023/11/16-18:28:45.605] [FRT-61-FlowRunnable] [INFO] [dku.datasets.file] act.train_Predict_authorized_flag__binary__NP - Building Filesystem handler config: {"connection":"filesystem_managed","path":"/TUT_BATCH.transactions_joined_prepared","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}}
[2023/11/16-18:28:45.606] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - Building FS provider for dataset handler: TUT_BATCH.transactions_joined_prepared
[2023/11/16-18:28:45.606] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - FS Provider built
[2023/11/16-18:28:45.606] [FRT-61-FlowRunnable] [INFO] [dku.datasets.file] act.train_Predict_authorized_flag__binary__NP - Building Filesystem handler config: {"connection":"filesystem_managed","path":"/TUT_BATCH.transactions_joined_prepared","notReadyIfEmpty":false,"filesSelectionRules":{"mode":"ALL","excludeRules":[],"includeRules":[],"explicitFiles":[]}}
[2023/11/16-18:28:45.607] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - Building FS provider for dataset handler: TUT_BATCH.transactions_joined_prepared
[2023/11/16-18:28:45.607] [FRT-61-FlowRunnable] [DEBUG] [dku.datasets.fsbased] act.train_Predict_authorized_flag__binary__NP - FS Provider built
[2023/11/16-18:28:45.615] [FRT-61-FlowRunnable] [INFO] [dku.code.projectLibs] act.train_Predict_authorized_flag__binary__NP - EXTERNAL LIBS FROM TUT_BATCH is {"gitReferences":{},"pythonPath":["python"],"rsrcPath":["R"],"importLibrariesFromProjects":[]}
[2023/11/16-18:28:45.615] [FRT-61-FlowRunnable] [DEBUG] [dku.code.projectLibs] act.train_Predict_authorized_flag__binary__NP - Impersonation or zipped config are enabled, copying project TUT_BATCH lib chunk /projects/TUT_BATCH/lib/python to /data/dataiku/datadir/jobs/TUT_BATCH/Scenario_build_Predict_authorized_flag__binary__2023-11-16T18-28-12.334/train_Predict_authorized_flag__binary__NP/prediction-train-recipe/pyrunmawWyZEBiPA8/project-python-libs/TUT_BATCH/python
[2023/11/16-18:28:45.620] [FRT-61-FlowRunnable] [INFO] [dku.code.projectLibs] act.train_Predict_authorized_flag__binary__NP - chunkFolder is /projects/TUT_BATCH/lib/R
[2023/11/16-18:28:45.620] [FRT-61-FlowRunnable] [DEBUG] [dku.code.projectLibs] act.train_Predict_authorized_flag__binary__NP - Impersonation or zipped config are enabled, copying project lib chunk /projects/TUT_BATCH/lib/R to /data/dataiku/datadir/jobs/TUT_BATCH/Scenario_build_Predict_authorized_flag__binary__2023-11-16T18-28-12.334/train_Predict_authorized_flag__binary__NP/prediction-train-recipe/pyrunmawWyZEBiPA8/project-r-src/TUT_BATCH/R
[2023/11/16-18:28:45.633] [FRT-61-FlowRunnable] [INFO] [dku.ml.distributed.service] act.train_Predict_authorized_flag__binary__NP - New worker pool created: pool-nbuljmc85kywpzfs
[2023/11/16-18:28:46.092] [Thread-46] [DEBUG] [dku.utils]  - Process kubectl done (return code 0)
[2023/11/16-18:28:46.093] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Waiting for kubernetes logs availability
[2023/11/16-18:28:46.093] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Starting to wait for logs to be available
[2023/11/16-18:28:46.093] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Getting pod
[2023/11/16-18:28:46.214] [Thread-49] [DEBUG] [dku.utils]  - Process kubectl done (return code 0)
[2023/11/16-18:28:47.214] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Pod is now created, waiting for logs fetch to be successful
[2023/11/16-18:28:47.215] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Calling logs on pods/dataiku-exec-prediction-training-km6zokl
[2023/11/16-18:28:47.335] [Thread-52] [INFO] [dku.utils]  - Process kubectl completed, return code 1
[2023/11/16-18:28:47.336] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Get logs failed
[2023/11/16-18:28:47.336] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Waiting for logs, time elapsed: 121 milliseconds, status changed to: Error from server (BadRequest): container "c" in pod "dataiku-exec-prediction-training-km6zokl" is waiting to start: ContainerCreating

[2023/11/16-18:28:47.336] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Pod has not started yet: 'Error from server (BadRequest): container "c" in pod "dataiku-exec-prediction-training-km6zokl" is waiting to start: ContainerCreating
'
[2023/11/16-18:28:48.337] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Calling logs on pods/dataiku-exec-prediction-training-km6zokl
[2023/11/16-18:28:48.453] [Thread-55] [DEBUG] [dku.utils]  - Process kubectl done (return code 0)
[2023/11/16-18:28:48.454] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Getting logs succeeded, but checking that pod is indeed running
[2023/11/16-18:28:48.553] [Thread-58] [DEBUG] [dku.utils]  - Process kubectl done (return code 0)
[2023/11/16-18:28:48.554] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - In a job activity, gathering Kubernetes pod description in background
[2023/11/16-18:28:48.556] [FRT-61-FlowRunnable] [INFO] [dku.k8s] act.train_Predict_authorized_flag__binary__NP - Gathering Kubernetes pod description every 60000 ms
[2023/11/16-18:28:48.559] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Starting kubectl-loop: Thread[Thread-59,5,main]
[2023/11/16-18:28:48.559] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Done waiting for logs to be available, trying to start streaming them
[2023/11/16-18:28:48.559] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Fetch logs
[2023/11/16-18:28:48.707] [Thread-69] [DEBUG] [dku.utils]  - Process kubectl done (return code 0)
[2023/11/16-18:28:49.357] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:413: DeprecationWarning: invalid escape sequence \s
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (access_token_cookie_name, access_token_cookie_name)
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:488: DeprecationWarning: invalid escape sequence \:
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (access_token_purge, inside_port)
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:634: DeprecationWarning: invalid escape sequence \:
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (inside_port)
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /usr/lib64/python3.6/runpy.py:125: RuntimeWarning: 'dataiku.container.runner' found in sys.modules after import of package 'dataiku.container', but prior to execution of 'dataiku.container.runner'; this may result in unpredictable behaviour
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   warn(RuntimeWarning(msg))
[2023/11/16-18:28:49.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:413: DeprecationWarning: invalid escape sequence \s
[2023/11/16-18:28:49.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (access_token_cookie_name, access_token_cookie_name)
[2023/11/16-18:28:49.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:488: DeprecationWarning: invalid escape sequence \:
[2023/11/16-18:28:49.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (access_token_purge, inside_port)
[2023/11/16-18:28:49.449] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:634: DeprecationWarning: invalid escape sequence \:
[2023/11/16-18:28:49.450] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (inside_port)
[2023/11/16-18:28:49.450] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,356] [1/MainThread] [INFO] [root] Fetching job definition
[2023/11/16-18:28:49.450] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,356] [1/MainThread] [DEBUG] [root] Creating HTTP session for internal RPC
[2023/11/16-18:28:49.450] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,357] [1/MainThread] [DEBUG] [root] Verifying SSL calls: /home/dataiku/rpc_server_cert.pem
[2023/11/16-18:28:49.450] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,360] [1/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:49.450] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,445] [1/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-execution HTTP/1.1" 200 None
[2023/11/16-18:28:49.475] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,448] [1/MainThread] [INFO] [root] got exec: {"dssVersion": "12.3.1", "id": "prediction-training-km6zokl", "authCtx": {"userGroupLevelPermissions": {"admin": false, "mayManageUDM": true, "mayCreateProjects": true, "mayCreateProjectsFromMacros": true, "mayCreateProjectsFromTemplates": true, "mayCreateProjectsFromDataikuApps": true, "mayWriteUnsafeCode": false, "mayWriteSafeCode": true, "mayCreateAuthenticatedConnections": false, "mayCreateCodeEnvs": false, "mayCreateClusters": false, "mayCreateCodeStudioTemplates": false, "mayDevelopPlugins": false, "mayEditLibFolders": true, "mayManageCodeEnvs": false, "mayManageClusters": false, "mayManageCodeStudioTemplates": false, "mayViewIndexedHiveConnections": false, "mayCreatePublishedAPIServices": true, "mayCreatePublishedProjects": true, "mayWriteInRootProjectFolder": true, "mayCreateActiveWebContent": true, "mayCreateWorkspaces": true, "mayShareToWorkspaces": true, "mayCreateDataCollections": true, "mayPublishToDataCollections": true, "mayManageFeatureStore": true, "canObtainAPITicketFromCookiesForGroupsRegex": ""}, "via": ["scenario-run: scenario=TUT_BATCH.RETRAINMODELDEPLOY runId=2023-11-16-18-28-10-743", "sean.angiolillo@dataiku.com"], "authSource": "USER_FROM_UI", "realUserLogin": "sean.angiolillo@dataiku.com", "userGroups": ["designers", "everyone", "space_administrators", "deployer", "project-deployer"], "userProfile": "DESIGNER"}, "projectKey": "TUT_BATCH", "backendDipHomePath": "/data/dataiku/datadir", "contextPath": "/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239", "executionPath": "/data/dataiku/datadir/jobs/TUT_BATCH/Scenario_build_Predict_authorized_flag__binary__2023-11-16T18-28-12.334/train_Predict_authorized_flag__binary__NP/prediction-train-recipe/pyrunmawWyZEBiPA8", "type": "RECIPE_PREDICTION_TRAIN_PYTHON", "definition": null, "payload": null, "codeEnvs": [{"lang": "PYTHON", "version": "Latest"}], "envResource": null}
[2023/11/16-18:28:49.475] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,449] [1/MainThread] [INFO] [root] Training doctor model
[2023/11/16-18:28:49.475] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,450] [1/MainThread] [INFO] [root] Fetching project libraries
[2023/11/16-18:28:49.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,474] [1/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 None
[2023/11/16-18:28:49.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,475] [1/MainThread] [INFO] [root] Fetching instance libraries
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,486] [1/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 None
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,511] [1/MainThread] [DEBUG] [root] Adding /home/dataiku/lib/project/project-python-libs/TUT_BATCH/python to Pythonpath
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,512] [1/MainThread] [INFO] [root] running on python 3.6.8 (default, Jun 20 2023, 11:53:23) 
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [GCC 4.8.5 20150623 (Red Hat 4.8.5-44)]
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,512] [1/MainThread] [INFO] [root] now using PYTHONPATH: /opt/dataiku/python:/home/dataiku/lib/instance:/home/dataiku/lib/project/project-python-libs/TUT_BATCH/python
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,512] [1/MainThread] [INFO] [root] Running doctor main
[2023/11/16-18:28:49.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,518] [1/MainThread] [INFO] [root] Running subprocess in PID 41
[2023/11/16-18:28:50.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:49,518] [1/Thread-1] [INFO] [root] Start monitoring process 41
[2023/11/16-18:28:52.400] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:413: DeprecationWarning: invalid escape sequence \s
[2023/11/16-18:28:52.400] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (access_token_cookie_name, access_token_cookie_name)
[2023/11/16-18:28:52.400] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:488: DeprecationWarning: invalid escape sequence \:
[2023/11/16-18:28:52.400] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (access_token_purge, inside_port)
[2023/11/16-18:28:52.400] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/container/runner.py:634: DeprecationWarning: invalid escape sequence \:
[2023/11/16-18:28:52.400] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   """ % (inside_port)
[2023/11/16-18:28:52.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:51,988] [41/MainThread] [INFO] [root] Launching doctor main
[2023/11/16-18:28:52.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,398] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/split.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/split.json'
[2023/11/16-18:28:52.464] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,399] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/split.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/split.json
[2023/11/16-18:28:52.464] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,399] [41/MainThread] [DEBUG] [root] Creating HTTP session for internal RPC
[2023/11/16-18:28:52.464] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,400] [41/MainThread] [DEBUG] [root] Verifying SSL calls: /home/dataiku/rpc_server_cert.pem
[2023/11/16-18:28:52.464] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,404] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:52.464] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,462] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 2945
[2023/11/16-18:28:52.464] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,463] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/core_params.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/core_params.json'
[2023/11/16-18:28:52.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,463] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/core_params.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/core_params.json
[2023/11/16-18:28:52.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,467] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 2195
[2023/11/16-18:28:52.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,468] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rpreprocessing_params.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rpreprocessing_params.json'
[2023/11/16-18:28:52.478] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,468] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rpreprocessing_params.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rpreprocessing_params.json
[2023/11/16-18:28:52.478] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,472] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 31914
[2023/11/16-18:28:52.478] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,473] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rmodeling_params.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rmodeling_params.json'
[2023/11/16-18:28:52.478] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,473] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rmodeling_params.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rmodeling_params.json
[2023/11/16-18:28:52.490] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,477] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 2656
[2023/11/16-18:28:52.490] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,478] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json'
[2023/11/16-18:28:52.490] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,478] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json
[2023/11/16-18:28:52.490] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,488] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 797
[2023/11/16-18:28:52.541] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,488] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json, not found
[2023/11/16-18:28:52.541] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,489] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/_eassertions.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/_eassertions.json'
[2023/11/16-18:28:52.541] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,489] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/_eassertions.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/_eassertions.json
[2023/11/16-18:28:52.541] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,490] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (2): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:52.541] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,540] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 22
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,540] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: DatasetSanityCheckDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_DATASET_SANITY_CHECKS
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,540] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: ClassifierAccuracyCheckDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_MODEL_CHECK
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: RegressionR2CheckDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_MODEL_CHECK
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: LeakageDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_LEAKAGE_DETECTION
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: TreeOverfitDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_TRAINING_OVERFIT
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: MLAssertionsDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_ML_ASSERTIONS
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: ModelCheckDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_MODEL_CHECK
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] enabling diagnostic callback: AbnormalPredictionsDetectionDiagnostic of type DiagnosticType.ML_DIAGNOSTICS_ABNORMAL_PREDICTIONS_DETECTION
[2023/11/16-18:28:52.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Loading train set
[2023/11/16-18:28:52.547] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json'
[2023/11/16-18:28:52.547] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,541] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:52.547] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,545] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 797
[2023/11/16-18:28:52.547] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,546] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json, not found
[2023/11/16-18:28:52.615] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,546] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:52.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,548] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (3): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:52.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,614] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:52.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,614] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/train.csv.gz' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/train.csv.gz'
[2023/11/16-18:28:52.709] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,614] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/train.csv.gz into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/train.csv.gz
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,619] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 3148117
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,708] [41/MainThread] [INFO] [root] Reading with dtypes: None
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,708] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for transaction_id: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for authorized_flag: <class 'numpy.object_'> (schema_type=bigint feature_type=NUMERIC feature_role=TARGET)
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_date: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_date_parsed: None (schema_type=date feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_year: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_month: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.710] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_day: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_dow: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_hour: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for date: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_id: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_id: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_category_id: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for item_category: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_amount: <class 'numpy.float64'> (schema_type=double feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for signature_provided: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:52.711] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_subsector_description: str (schema_type=string feature_type=CATEGORY feature_role=INPUT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for spending_type: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_latitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_longitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_first_active_month: None (schema_type=date feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for days_active: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_reward_program: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_latitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_longitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_fico_score: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:52.712] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,709] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_age: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:52.713] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_geopoint: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.713] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_state: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.713] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_state_enName: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:52.713] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_geopoint: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.331] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_state: str (schema_type=string feature_type=CATEGORY feature_role=INPUT)
[2023/11/16-18:28:53.331] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_state_enName: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.331] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for dist_cardholder_merchant: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.332] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for risk: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.332] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:52,710] [41/MainThread] [INFO] [root] Reading with FIXED dtypes: {'authorized_flag': <class 'numpy.object_'>, 'purchase_amount': <class 'numpy.float64'>, 'signature_provided': <class 'numpy.float64'>, 'merchant_subsector_description': 'str', 'card_fico_score': <class 'numpy.float64'>, 'card_age': <class 'numpy.float64'>, 'merchant_state': 'str'}
[2023/11/16-18:28:53.332] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,326] [41/MainThread] [INFO] [root] Loaded table
[2023/11/16-18:28:53.335] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,330] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 0       2017-01-01 00:00:59+00:00
[2023/11/16-18:28:53.335] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1       2017-01-01 00:21:40+00:00
[2023/11/16-18:28:53.335] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2       2017-01-01 00:58:34+00:00
[2023/11/16-18:28:53.335] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3       2017-01-01 01:09:52+00:00
[2023/11/16-18:28:53.335] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4       2017-01-01 01:26:59+00:00
[2023/11/16-18:28:53.335] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659   2017-04-30 23:32:02+00:00
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660   2017-04-30 23:36:28+00:00
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661   2017-04-30 23:41:56+00:00
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662   2017-04-30 23:44:24+00:00
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663   2017-04-30 23:55:25+00:00
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 43664, dtype: datetime64[ns, UTC]
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/doctor/utils/__init__.py:160: DeprecationWarning: parsing timezone aware datetimes is deprecated; this will raise an error in the future
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   return (pd.Series((series.values.astype("datetime64[ms]") - np.datetime64(EPOCH))) / np.timedelta64(1, 's')).reindex_like(series, method='pad')
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,334] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 0        3.692218e+09
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1        3.692219e+09
[2023/11/16-18:28:53.336] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2        3.692221e+09
[2023/11/16-18:28:53.337] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3        3.692222e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4        3.692223e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659    3.702584e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660    3.702584e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661    3.702585e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662    3.702585e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663    3.702585e+09
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 43664, dtype: float64
[2023/11/16-18:28:53.340] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,336] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 0       2020-12-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1       2019-12-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2       2019-05-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3       2020-09-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4       2019-10-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659   2021-01-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660   2020-12-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661   2021-04-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662   2020-07-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663   2020-08-01 00:00:00+00:00
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 43664, dtype: datetime64[ns, UTC]
[2023/11/16-18:28:53.341] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,339] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 0        3.815770e+09
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1        3.784147e+09
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2        3.765658e+09
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3        3.807907e+09
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4        3.778877e+09
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659    3.818448e+09
[2023/11/16-18:28:53.342] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660    3.815770e+09
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661    3.826224e+09
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662    3.802550e+09
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663    3.805229e+09
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 43664, dtype: float64
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,340] [41/MainThread] [INFO] [dataiku.doctor.utils] Coercion done
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,340] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling DatasetSanityCheckDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] DatasetSanityCheckDiagnostic.on_load_train_dataset_end() generated diagnostics: ['The train dataset is imbalanced (balance=0.47), metrics can be misleading']
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] Adding diagnostic: <DoctorDiagnostic ML_DIAGNOSTICS_DATASET_SANITY_CHECKS: The train dataset is imbalanced (balance=0.47), metrics can be misleading>
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ClassifierAccuracyCheckDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.347] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling RegressionR2CheckDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling LeakageDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling TreeOverfitDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling MLAssertionsDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ModelCheckDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,345] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling AbnormalPredictionsDetectionDiagnostic.on_load_train_dataset_end()
[2023/11/16-18:28:53.353] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,346] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json
[2023/11/16-18:28:53.353] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,351] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fml_diagnostics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.354] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,351] [41/MainThread] [INFO] [dataiku.doctor.utils.split] Loaded train df: shape=(43664,35)
[2023/11/16-18:28:53.354] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,351] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Loading train set
[2023/11/16-18:28:53.354] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,351] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Loading test set
[2023/11/16-18:28:53.358] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,352] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:53.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,357] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,357] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/test.csv.gz' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/test.csv.gz'
[2023/11/16-18:28:53.380] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,357] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/test.csv.gz into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/split/test.csv.gz
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,361] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 200 817862
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [root] Reading with dtypes: None
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for transaction_id: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for authorized_flag: <class 'numpy.object_'> (schema_type=bigint feature_type=NUMERIC feature_role=TARGET)
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_date: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_date_parsed: None (schema_type=date feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.381] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_year: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_month: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_day: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_dow: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_hour: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for date: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_id: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_id: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.382] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_category_id: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for item_category: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_amount: <class 'numpy.float64'> (schema_type=double feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for signature_provided: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_subsector_description: str (schema_type=string feature_type=CATEGORY feature_role=INPUT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for spending_type: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_latitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_longitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_first_active_month: None (schema_type=date feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.383] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for days_active: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_reward_program: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_latitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_longitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_fico_score: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,380] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_age: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_geopoint: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_state: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_state_enName: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.384] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_geopoint: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.385] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_state: str (schema_type=string feature_type=CATEGORY feature_role=INPUT)
[2023/11/16-18:28:53.600] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_state_enName: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.600] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for dist_cardholder_merchant: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:28:53.600] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for risk: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:28:53.600] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,381] [41/MainThread] [INFO] [root] Reading with FIXED dtypes: {'authorized_flag': <class 'numpy.object_'>, 'purchase_amount': <class 'numpy.float64'>, 'signature_provided': <class 'numpy.float64'>, 'merchant_subsector_description': 'str', 'card_fico_score': <class 'numpy.float64'>, 'card_age': <class 'numpy.float64'>, 'merchant_state': 'str'}
[2023/11/16-18:28:53.600] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,597] [41/MainThread] [INFO] [root] Loaded table
[2023/11/16-18:28:53.600] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,599] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 0       2017-01-01 00:39:57+00:00
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1       2017-01-01 00:54:29+00:00
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2       2017-01-01 01:08:26+00:00
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3       2017-01-01 01:33:33+00:00
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4       2017-01-01 03:31:44+00:00
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11024   2017-04-30 22:15:04+00:00
[2023/11/16-18:28:53.604] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11025   2017-04-30 23:12:25+00:00
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11026   2017-04-30 23:12:45+00:00
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11027   2017-04-30 23:31:17+00:00
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11028   2017-04-30 23:38:25+00:00
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 11029, dtype: datetime64[ns, UTC]
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,601] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 0        3.692220e+09
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1        3.692221e+09
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2        3.692222e+09
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3        3.692223e+09
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4        3.692230e+09
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:28:53.605] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11024    3.702579e+09
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11025    3.702583e+09
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11026    3.702583e+09
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11027    3.702584e+09
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11028    3.702584e+09
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 11029, dtype: float64
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,602] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 0       2020-12-01 00:00:00+00:00
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1       2020-02-01 00:00:00+00:00
[2023/11/16-18:28:53.606] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2       2020-04-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3       2020-11-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4       2020-02-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11024   2020-09-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11025   2020-08-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11026   2020-06-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11027   2021-02-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11028   2021-02-01 00:00:00+00:00
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 11029, dtype: datetime64[ns, UTC]
[2023/11/16-18:28:53.608] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,605] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 0        3.815770e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1        3.789504e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2        3.794688e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3        3.813178e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4        3.789504e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11024    3.807907e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11025    3.805229e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11026    3.799958e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11027    3.821126e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11028    3.821126e+09
[2023/11/16-18:28:53.609] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 11029, dtype: float64
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,605] [41/MainThread] [INFO] [dataiku.doctor.utils] Coercion done
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,605] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling DatasetSanityCheckDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] DatasetSanityCheckDiagnostic.on_load_test_dataset_end() generated diagnostics: ['The test dataset is imbalanced (balance=0.48), metrics can be misleading']
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] Adding diagnostic: <DoctorDiagnostic ML_DIAGNOSTICS_DATASET_SANITY_CHECKS: The test dataset is imbalanced (balance=0.48), metrics can be misleading>
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ClassifierAccuracyCheckDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling RegressionR2CheckDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling LeakageDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.610] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling TreeOverfitDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling MLAssertionsDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ModelCheckDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,607] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling AbnormalPredictionsDetectionDiagnostic.on_load_test_dataset_end()
[2023/11/16-18:28:53.616] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,608] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json
[2023/11/16-18:28:53.619] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,613] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fml_diagnostics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.619] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,613] [41/MainThread] [INFO] [dataiku.doctor.utils.split] Loaded test df: shape=(11029,35)
[2023/11/16-18:28:53.619] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,613] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Loading test set
[2023/11/16-18:28:53.619] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,613] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Collecting preprocessing data
[2023/11/16-18:28:53.619] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,614] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:53.623] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,618] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.623] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,618] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at date... (type=CATEGORY)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,618] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_latitude... (type=NUMERIC)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,618] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at spending_type... (type=CATEGORY)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,618] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_day... (type=NUMERIC)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,619] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_month... (type=NUMERIC)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,619] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_fico_score... (type=NUMERIC)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,619] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Checking series of type: float64 (isM8=False)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,622] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_id... (type=CATEGORY)
[2023/11/16-18:28:53.624] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_longitude... (type=NUMERIC)
[2023/11/16-18:28:53.625] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at item_category... (type=CATEGORY)
[2023/11/16-18:28:53.625] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at dist_cardholder_merchant... (type=NUMERIC)
[2023/11/16-18:28:53.625] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_state_enName... (type=CATEGORY)
[2023/11/16-18:28:53.625] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_date_parsed... (type=NUMERIC)
[2023/11/16-18:28:53.625] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_state... (type=CATEGORY)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_state_enName... (type=CATEGORY)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at signature_provided... (type=NUMERIC)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,623] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Checking series of type: float64 (isM8=False)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,626] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_dow... (type=NUMERIC)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,626] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_age... (type=NUMERIC)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,626] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Checking series of type: float64 (isM8=False)
[2023/11/16-18:28:53.632] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at transaction_id... (type=NUMERIC)
[2023/11/16-18:28:53.633] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_year... (type=NUMERIC)
[2023/11/16-18:28:53.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_first_active_month... (type=NUMERIC)
[2023/11/16-18:28:53.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at days_active... (type=NUMERIC)
[2023/11/16-18:28:53.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_latitude... (type=NUMERIC)
[2023/11/16-18:28:53.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_category_id... (type=NUMERIC)
[2023/11/16-18:28:53.645] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_id... (type=CATEGORY)
[2023/11/16-18:28:53.645] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,629] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_subsector_description... (type=CATEGORY)
[2023/11/16-18:28:53.645] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,639] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_longitude... (type=NUMERIC)
[2023/11/16-18:28:53.652] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,639] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_hour... (type=NUMERIC)
[2023/11/16-18:28:53.652] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,639] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_geopoint... (type=CATEGORY)
[2023/11/16-18:28:53.653] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,639] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_amount... (type=NUMERIC)
[2023/11/16-18:28:53.653] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,639] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Checking series of type: float64 (isM8=False)
[2023/11/16-18:28:53.653] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,642] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at card_reward_program... (type=CATEGORY)
[2023/11/16-18:28:53.653] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,642] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_state... (type=CATEGORY)
[2023/11/16-18:28:53.653] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,651] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at merchant_geopoint... (type=CATEGORY)
[2023/11/16-18:28:53.653] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,651] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at risk... (type=CATEGORY)
[2023/11/16-18:28:53.654] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,651] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at purchase_date... (type=CATEGORY)
[2023/11/16-18:28:53.654] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,651] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_collector] Looking at authorized_flag... (type=NUMERIC)
[2023/11/16-18:28:53.654] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,652] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] generating interactions
[2023/11/16-18:28:53.659] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,652] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] {'feature_selection_params': {'method': 'NONE', 'random_forest_params': {'n_trees': 30, 'depth': 10, 'n_features': 25}, 'lasso_params': {'alpha': [0.01, 0.1, 1.0, 10.0, 100.0], 'cross_validate': True}, 'pca_params': {'n_features': 25, 'variance_proportion': 0.9}, 'correlation_params': {'min_abs_correlation': 0.0, 'max_abs_correlation': 1.0, 'n_features': 25}, 'custom_params': {'code': '# type your code here'}}, 'preprocessingFitSampleRatio': 1.0, 'preprocessingFitSampleSeed': 1337, 'target_remapping': [{'sourceValue': '0', 'mappedValue': 0, 'sampleFreq': 944}, {'sourceValue': '1', 'mappedValue': 1, 'sampleFreq': 9056}], 'skipPreprocessing': False, 'per_feature': {'date': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DateSource'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_latitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'spending_type': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_day': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_month': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_fico_score': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_id': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_longitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'item_category': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'dist_cardholder_merchant': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_state_enName': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_date_parsed': {'generate_derivative': False, 'numerical_handling': 'DATETIME_CYCLICAL', 'missing_handling': 'DROP_ROW', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': ['DAY', 'HOUR', 'MINUTE', 'WEEK'], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Date'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_state': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_state_enName': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'signature_provided': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_dow': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_age': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'transaction_id': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_IDENTIFIER', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_year': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_first_active_month': {'generate_derivative': False, 'numerical_handling': 'DATETIME_CYCLICAL', 'missing_handling': 'DROP_ROW', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': ['QUARTER', 'WEEK', 'YEAR'], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Date'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'days_active': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_latitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_category_id': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_id': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_subsector_description': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'INPUT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_longitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_hour': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_geopoint': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'GeoPoint'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_amount': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_reward_program': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_state': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'INPUT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_geopoint': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'GeoPoint'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'risk': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_date': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DateSource'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'authorized_flag': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'TARGET', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}}, 'reduce': {'enabled': False, 'kept_variance': 0.0}, 'feature_generation': {'pairwise_linear': {'behavior': 'DISABLED'}, 'polynomial_combinations': {'behavior': 'DISABLED'}, 'manual_interactions': {'interactions': []}, 'numericals_clustering': {'k': 0, 'all_features': False, 'input_features': [], 'behavior': 'DISABLED'}, 'categoricals_count_transformer': {'all_features': False, 'input_features': [], 'behavior': 'DISABLED'}}}
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,652] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] No feature selection to perform
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,652] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json'
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,652] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,656] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 788
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,657] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json, not found
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,657] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json'
[2023/11/16-18:28:53.660] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,657] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json
[2023/11/16-18:28:53.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,659] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (4): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:53.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,687] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 794
[2023/11/16-18:28:53.689] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,687] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json, not found
[2023/11/16-18:28:53.689] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,687] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json'
[2023/11/16-18:28:53.720] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,687] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json
[2023/11/16-18:28:53.720] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,689] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (5): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:53.720] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,718] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 788
[2023/11/16-18:28:53.720] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,718] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json, not found
[2023/11/16-18:28:53.721] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,719] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Collecting preprocessing data
[2023/11/16-18:28:53.721] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,719] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Preprocessing train set
[2023/11/16-18:28:53.759] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,719] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:53.760] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,721] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (6): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:53.760] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,749] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.760] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,750] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 43664
[2023/11/16-18:28:53.760] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,750] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:RemapValueToOutput
[2023/11/16-18:28:53.773] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,759] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.773] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,759] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {'card_fico_score': 568.4182621839502, 'signature_provided': 0.18848479296445583, 'card_age': 45.95275283986808, 'purchase_amount': 222.5142034628016}
[2023/11/16-18:28:53.773] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,761] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.773] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,761] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.773] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,761] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:RescalingProcessor2 (card_fico_score)
[2023/11/16-18:28:53.773] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,761] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale card_fico_score (avg=568.4182621839502 std=166.76433796516395 shift=568.4182621839502 inv_scale=0.005996485892618684)
[2023/11/16-18:28:53.777] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,772] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled card_fico_score (avg=-3.3839376071429144e-16 std=1.0000000000000264) nulls=0
[2023/11/16-18:28:53.777] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,772] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:RescalingProcessor2 (signature_provided)
[2023/11/16-18:28:53.777] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,772] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale signature_provided (avg=0.18848479296445583 std=0.39110328423727586 shift=0.18848479296445583 inv_scale=2.556869349614862)
[2023/11/16-18:28:53.777] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,774] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled signature_provided (avg=1.2621311511898445e-15 std=0.9999999999998468) nulls=0
[2023/11/16-18:28:53.777] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,774] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:RescalingProcessor2 (card_age)
[2023/11/16-18:28:53.778] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,774] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale card_age (avg=45.95275283986808 std=20.830437866840672 shift=45.95275283986808 inv_scale=0.04800667208210102)
[2023/11/16-18:28:53.778] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,776] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled card_age (avg=-2.8197996846585256e-18 std=0.999999999999991) nulls=0
[2023/11/16-18:28:53.797] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,776] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:RescalingProcessor2 (purchase_amount)
[2023/11/16-18:28:53.798] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,777] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale purchase_amount (avg=222.5142034628016 std=522.9107911649871 shift=222.5142034628016 inv_scale=0.0019123720850589279)
[2023/11/16-18:28:53.798] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,778] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled purchase_amount (avg=1.0082131477553118e-14 std=0.9999999999999739) nulls=0
[2023/11/16-18:28:53.798] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,778] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:FlushDFBuilder(num_flagonly)
[2023/11/16-18:28:53.798] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,778] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:FlushDFBuilder(datetime_cyclical)
[2023/11/16-18:28:53.798] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,778] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:FastSparseDummifyProcessor (merchant_subsector_description)
[2023/11/16-18:28:53.798] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,796] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Dummifier: Append a sparse block shape=(43664, 40) nnz=43664
[2023/11/16-18:28:53.815] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,797] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:FastSparseDummifyProcessor (merchant_state)
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Dummifier: Append a sparse block shape=(43664, 13) nnz=43664
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:FlushDFBuilder(cat_flagpresence)
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.819] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,814] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.819] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,815] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:FlushDFBuilder(interaction)
[2023/11/16-18:28:53.819] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,815] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:RealignTarget
[2023/11/16-18:28:53.819] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,815] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Realign target series = (43664,)
[2023/11/16-18:28:53.819] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,816] [41/MainThread] [DEBUG] [dku.ml.preprocessing] After realign target: (43664,)
[2023/11/16-18:28:53.819] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,816] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:DropRowsWhereNoTarget
[2023/11/16-18:28:53.820] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,817] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Deleting 0 rows because one of ['target'] is missing or infinity
[2023/11/16-18:28:53.820] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,817] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MF before = (43664, 57)
[2023/11/16-18:28:53.820] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,817] [41/MainThread] [DEBUG] [dku.ml.preprocessing] target before = (43664,)
[2023/11/16-18:28:53.848] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,818] [41/MainThread] [INFO] [dataiku.doctor.multiframe] MultiFrame, dropping rows: []
[2023/11/16-18:28:53.848] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing] After DRWNT input_df=(43664, 35)
[2023/11/16-18:28:53.848] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MF after = (43664, 57)
[2023/11/16-18:28:53.848] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing] target after = (43664,)
[2023/11/16-18:28:53.848] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:DumpPipelineState
[2023/11/16-18:28:53.848] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing] ********* Pipeline state (Before feature selection)
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    input_df= (43664, 35) 
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,846] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    current_mf=(43664, 57) 
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    PPR: 
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       target = <class 'pandas.core.series.Series'> ((43664,))
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:EmitCurrentMFAsResult
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 43664
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing] FIT/PROCESS WITH Step:DumpPipelineState
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing] ********* Pipeline state (At end)
[2023/11/16-18:28:53.849] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    input_df= (43664, 35) 
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    current_mf=(0, 0) 
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    PPR: 
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       target = <class 'pandas.core.series.Series'> ((43664,))
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       TRAIN = <class 'dataiku.doctor.multiframe.MultiFrame'> ((43664, 57))
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       UNPROCESSED = <class 'pandas.core.frame.DataFrame'> ((43664, 35))
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling DatasetSanityCheckDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ClassifierAccuracyCheckDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling RegressionR2CheckDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.850] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling LeakageDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.851] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling TreeOverfitDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.851] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling MLAssertionsDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.854] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ModelCheckDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.854] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [INFO] [root] train multiframe initial size: 43664
[2023/11/16-18:28:53.854] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] ModelCheckDiagnostic.on_preprocess_train_dataset_end() generated diagnostics: []
[2023/11/16-18:28:53.854] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,847] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling AbnormalPredictionsDetectionDiagnostic.on_preprocess_train_dataset_end()
[2023/11/16-18:28:53.854] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,848] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json
[2023/11/16-18:28:53.861] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,853] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fml_diagnostics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.861] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,854] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/collector_data.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/collector_data.json
[2023/11/16-18:28:53.861] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,859] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fcollector_data.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.870] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,860] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/imputed.json
[2023/11/16-18:28:53.870] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,864] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fimputed.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.870] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,864] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/rescalers.json
[2023/11/16-18:28:53.875] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,869] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Frescalers.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.875] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,869] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dummies.json
[2023/11/16-18:28:53.876] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,874] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fdummies.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.885] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,874] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/preprocessing_report.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/preprocessing_report.json
[2023/11/16-18:28:53.885] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,879] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fpreprocessing_report.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.885] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,879] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Preprocessing train set
[2023/11/16-18:28:53.885] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,879] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Preprocessing test set
[2023/11/16-18:28:53.885] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,879] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:53.890] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,884] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.890] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,884] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 11029
[2023/11/16-18:28:53.890] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,884] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RemapValueToOutput
[2023/11/16-18:28:53.890] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,888] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.890] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,888] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {'card_fico_score': 568.4182621839502, 'signature_provided': 0.18848479296445583, 'card_age': 45.95275283986808, 'purchase_amount': 222.5142034628016}
[2023/11/16-18:28:53.890] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,889] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.893] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,889] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.893] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,889] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (card_fico_score)
[2023/11/16-18:28:53.894] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,889] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale card_fico_score (avg=568.9847674313174 std=168.56887354683042 shift=568.4182621839502 inv_scale=0.005996485892618684)
[2023/11/16-18:28:53.894] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,891] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled card_fico_score (avg=0.003397040723931984 std=1.0108208721581913) nulls=0
[2023/11/16-18:28:53.894] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,891] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (signature_provided)
[2023/11/16-18:28:53.894] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,891] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale signature_provided (avg=0.1831535043974975 std=0.386809855674101 shift=0.18848479296445583 inv_scale=2.556869349614862)
[2023/11/16-18:28:53.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,893] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled signature_provided (avg=-0.013631408330805245 std=0.9890222641018674) nulls=0
[2023/11/16-18:28:53.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,893] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (card_age)
[2023/11/16-18:28:53.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,893] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale card_age (avg=45.73415540846858 std=20.625186260373027 shift=45.95275283986808 inv_scale=0.04800667208210102)
[2023/11/16-18:28:53.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,894] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled card_age (avg=-0.01049413520718542 std=0.9901465534339823) nulls=0
[2023/11/16-18:28:53.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,894] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (purchase_amount)
[2023/11/16-18:28:53.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,895] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale purchase_amount (avg=219.54275455617116 std=675.3698708022315 shift=222.5142034628016 inv_scale=0.0019123720850589279)
[2023/11/16-18:28:53.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,896] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled purchase_amount (avg=-0.00568251594122092 std=1.2915584880120397) nulls=0
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,896] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(num_flagonly)
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,896] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(datetime_cyclical)
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,896] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FastSparseDummifyProcessor (merchant_subsector_description)
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,902] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Dummifier: Append a sparse block shape=(11029, 40) nnz=11029
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,902] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FastSparseDummifyProcessor (merchant_state)
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,907] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Dummifier: Append a sparse block shape=(11029, 13) nnz=11029
[2023/11/16-18:28:53.909] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(cat_flagpresence)
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(interaction)
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RealignTarget
[2023/11/16-18:28:53.910] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,908] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Realign target series = (11029,)
[2023/11/16-18:28:53.911] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,909] [41/MainThread] [DEBUG] [dku.ml.preprocessing] After realign target: (11029,)
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,909] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:DropRowsWhereNoTarget
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,909] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Deleting 0 rows because one of ['target'] is missing or infinity
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,909] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MF before = (11029, 57)
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,909] [41/MainThread] [DEBUG] [dku.ml.preprocessing] target before = (11029,)
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,910] [41/MainThread] [INFO] [dataiku.doctor.multiframe] MultiFrame, dropping rows: []
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing] After DRWNT input_df=(11029, 35)
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MF after = (11029, 57)
[2023/11/16-18:28:53.919] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing] target after = (11029,)
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:DumpPipelineState
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing] ********* Pipeline state (Before feature selection)
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    input_df= (11029, 35) 
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    current_mf=(11029, 57) 
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    PPR: 
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       target = <class 'pandas.core.series.Series'> ((11029,))
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,917] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:EmitCurrentMFAsResult
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 11029
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:DumpPipelineState
[2023/11/16-18:28:53.920] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing] ********* Pipeline state (At end)
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    input_df= (11029, 35) 
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    current_mf=(0, 0) 
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    PPR: 
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       target = <class 'pandas.core.series.Series'> ((11029,))
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       TRAIN = <class 'dataiku.doctor.multiframe.MultiFrame'> ((11029, 57))
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       UNPROCESSED = <class 'pandas.core.frame.DataFrame'> ((11029, 35))
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling DatasetSanityCheckDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ClassifierAccuracyCheckDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.921] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling RegressionR2CheckDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.922] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling LeakageDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.922] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling TreeOverfitDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.922] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling MLAssertionsDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.922] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ModelCheckDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.922] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [INFO] [root] test multiframe initial size: 11029
[2023/11/16-18:28:53.922] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] ModelCheckDiagnostic.on_preprocess_test_dataset_end() generated diagnostics: []
[2023/11/16-18:28:53.925] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling AbnormalPredictionsDetectionDiagnostic.on_preprocess_test_dataset_end()
[2023/11/16-18:28:53.926] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,918] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json
[2023/11/16-18:28:53.926] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,923] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fml_diagnostics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.926] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,924] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Preprocessing test set
[2023/11/16-18:28:53.926] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,924] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Hyperparameter searching
[2023/11/16-18:28:53.938] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,924] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:28:53.938] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,928] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:53.938] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,929] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(43664,57) tn=2488848 nnz=261984 fill_ratio=0.11
[2023/11/16-18:28:53.939] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,929] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:28:53.939] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,937] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] Create CLF from params: {'algorithm': 'RANDOM_FOREST_CLASSIFICATION', 'rf_classifier_grid': {'n_estimators': {'gridMode': 'EXPLICIT', 'randomMode': 'RANGE', 'limit': {'min': 1}, 'values': [100], 'range': {'min': 80, 'max': 200, 'nbValues': 3, 'scaling': 'LINEAR'}}, 'n_jobs': 4, 'max_tree_depth': {'gridMode': 'EXPLICIT', 'randomMode': 'RANGE', 'limit': {'min': 1}, 'values': [6, 15], 'range': {'min': 6, 'max': 20, 'nbValues': 3, 'scaling': 'LINEAR'}}, 'min_samples_leaf': {'gridMode': 'EXPLICIT', 'randomMode': 'RANGE', 'limit': {'min': 1}, 'values': [1], 'range': {'min': 1, 'max': 20, 'nbValues': 3, 'scaling': 'LINEAR'}}, 'selection_mode': 'auto', 'max_features': {'gridMode': 'EXPLICIT', 'randomMode': 'RANGE', 'limit': {'min': 1}, 'values': [5], 'range': {'min': 1, 'max': 20, 'nbValues': 3, 'scaling': 'LINEAR'}}, 'max_feature_prop': {'gridMode': 'EXPLICIT', 'randomMode': 'RANGE', 'limit': {'min': 1e-23, 'max': 1.0}, 'values': [0.3], 'range': {'min': 0.1, 'max': 0.7, 'nbValues': 3, 'scaling': 'LINEAR'}}, 'enabled': True}, 'max_ensemble_nodes_serialized': 6000, 'metrics': {'customMetrics': [], 'evaluationMetric': 'ROC_AUC', 'customEvaluationMetricGIB': True, 'customEvaluationMetricNeedsProba': False, 'thresholdOptimizationMetric': 'F1', 'costMatrixWeights': {'tpGain': 1.0, 'tnGain': 0.0, 'fpGain': -0.3, 'fnGain': 0.0}, 'liftPoint': 0.4, 'netUpliftPoint': 0.5}, 'autoOptimizeThreshold': True, 'forcedClassifierThreshold': 0.0, 'gridLength': 2, 'grid_search_params': {'mode': 'KFOLD', 'splitRatio': 0.8, 'shuffleIterations': 1, 'nFolds': 5, 'cvSeed': 1337, 'stratified': True, 'grouped': False, 'strategy': 'GRID', 'bayesianOptimizer': 'SCIKIT_OPTIMIZE', 'randomized': True, 'seed': 1337, 'nIter': 0, 'nIterRandom': 5, 'timeout': 0, 'nJobs': 4, 'distributed': False, 'nContainers': 4, 'foldOffset': True}, 'pluginAlgoCustomGridSearch': False, 'computeLearningCurves': False, 'skipExpensiveReports': False} for algorithm RANDOM_FOREST_CLASSIFICATION
[2023/11/16-18:28:53.939] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,937] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] Using stratified K-Fold CV with k=5
[2023/11/16-18:28:53.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,938] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json'
[2023/11/16-18:28:53.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,938] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json
[2023/11/16-18:28:53.946] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,942] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 824
[2023/11/16-18:28:53.946] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,942] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json, not found
[2023/11/16-18:28:54.002] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,944] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (7): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:54.003] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,987] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "GET /kernel/tintercom/ml/available-container-configurations?type=KUBERNETES HTTP/1.1" 200 93
[2023/11/16-18:28:54.003] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:53,987] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluation_monitor] The following distributed container configuration(s) are available to run this search: ['CPU-S-0.5-cpu-2Gb-Ram', 'CPU-M-1-cpu-4Gb-Ram', 'CPU-L-1-cpu-8Gb-Ram', 'CPU-XL-2-cpu-16Gb-Ram']
[2023/11/16-18:28:54.003] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,001] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_runner] Fitting 5 folds for each of 2 candidates, totalling 10 fits
[2023/11/16-18:28:54.003] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,001] [41/MainThread] [INFO] [dataiku.base.utils] Detected 1/16 usable CPUs
[2023/11/16-18:28:54.012] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,001] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_runner] Execute hyperparameter search locally on 4 threads
[2023/11/16-18:28:54.013] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,001] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json'
[2023/11/16-18:28:54.013] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,001] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json
[2023/11/16-18:28:54.013] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,006] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 821
[2023/11/16-18:28:54.040] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,006] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json, not found
[2023/11/16-18:28:54.040] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,006] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json
[2023/11/16-18:28:54.040] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,008] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (8): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:54.041] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,038] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fgrid_search_scores.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:28:54.041] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,039] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:28:54.041] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,039] [41/MainThread] [INFO] [dataiku.doctor.crossval.strategies.grid_search_strategy] Running GridSearchStrategy for hyperparameters space: <dataiku.doctor.prediction.common.TreesHyperparametersSpace object at 0x7f419a868128>
[2023/11/16-18:28:54.041] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,039] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 0: {'max_depth': 6, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:28:54.041] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,039] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:28:54.044] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,039] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.local_worker] Starting worker: local-0
[2023/11/16-18:28:54.044] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,040] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T1
[2023/11/16-18:28:54.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,041] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.local_worker] Started worker: local-0
[2023/11/16-18:28:54.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,042] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 1: {'max_depth': 6, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:28:54.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,042] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T1 on local-0...
[2023/11/16-18:28:54.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,042] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.local_worker] Starting worker: local-1
[2023/11/16-18:28:54.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,042] [41/Thread-2:local-0] [INFO] [dataiku.doctor.crossval.search_context] Fit s=0: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:28:54.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,042] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T2
[2023/11/16-18:28:54.046] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,042] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.local_worker] Started worker: local-1
[2023/11/16-18:28:54.046] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,043] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 2: {'max_depth': 6, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:28:54.046] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,043] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T2 on local-1...
[2023/11/16-18:28:54.046] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,043] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:28:54.046] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,044] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.local_worker] Starting worker: local-2
[2023/11/16-18:28:54.047] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,044] [41/Thread-3:local-1] [INFO] [dataiku.doctor.crossval.search_context] Fit s=1: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:28:54.047] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,044] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T3
[2023/11/16-18:28:54.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,044] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:28:54.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,044] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.local_worker] Started worker: local-2
[2023/11/16-18:28:54.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,045] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 3: {'max_depth': 6, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:28:54.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,045] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T3 on local-2...
[2023/11/16-18:28:54.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,046] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.local_worker] Starting worker: local-3
[2023/11/16-18:28:54.543] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,046] [41/Thread-4:local-2] [INFO] [dataiku.doctor.crossval.search_context] Fit s=2: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:28:54.543] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,046] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T4
[2023/11/16-18:28:54.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,046] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.local_worker] Started worker: local-3
[2023/11/16-18:28:54.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,047] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 4: {'max_depth': 6, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:28:54.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,047] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T4 on local-3...
[2023/11/16-18:28:54.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,047] [41/Thread-5:local-3] [INFO] [dataiku.doctor.crossval.search_context] Fit s=3: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:28:55.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:54,542] [1/Thread-1] [INFO] [root] Local process resource usage : {"commandName": "/opt/dataiku/bin/python -m dataiku.container.exec_train_recipe", "vmRSSTotalMBS": 0, "majorFaults": 0, "childrenMajorFaults": 0, "cpuUserTimeMS": 3880.0, "cpuSystemTimeMS": 490.0, "cpuChildrenUserTimeMS": 0.0, "cpuChildrenSystemTimeMS": 0.0, "cpuTotalMS": 4370.0, "vmSizePeakMB": 6900.765625, "vmSizeMB": 6836.765625, "vmRSSMB": 338.14453125, "vmHWMMB": 338.14453125, "vmRSSAnonMB": 295.38671875, "vmDataMB": 3194.52734375, "vmRSSPeakMB": 338.14453125}
[2023/11/16-18:28:55.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:55,046] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:28:56.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:55,047] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:28:56.048] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:55,143] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (9): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:56.049] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:55,249] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:28:56.049] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:55,341] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:28:56.446] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:56,343] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:28:56.446] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:56,346] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:28:56.446] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:56,351] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (10): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:56.446] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:56,444] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:28:57.447] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:56,445] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:28:57.647] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:57,540] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:28:57.648] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:57,543] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:28:57.648] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:57,546] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (11): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:57.648] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:57,645] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:28:58.648] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:57,646] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:28:58.851] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:58,650] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:28:58.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:58,653] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:28:58.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:58,744] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (12): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:28:58.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:58,849] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:28:59.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:58,850] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:00.151] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:59,943] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:00.151] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:28:59,944] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:00.151] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:00,041] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (13): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:00.152] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:00,149] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:01.152] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:00,150] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:01.350] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:01,243] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:01.350] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:01,245] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:01.350] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:01,251] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (14): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:01.350] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:01,348] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:02.351] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:01,349] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:02.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:02,350] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:02.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:02,350] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:02.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:02,441] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (15): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:02.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:02.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.468] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:02,465] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:02,466] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.469] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,467] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:03.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,467] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:03.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,471] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (16): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:03.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:03.542] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:03.543] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,540] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:03.572] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,541] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:03.572] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,569] [41/Thread-4:local-2] [INFO] [dataiku.doctor.crossval.search_context] Done s=2: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=8.4 st=1.1 sc=0.7097012078008024, sg=1)
[2023/11/16-18:29:03.572] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,569] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T3 done on local-2
[2023/11/16-18:29:03.573] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,570] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T5
[2023/11/16-18:29:03.573] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,570] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T5 on local-2...
[2023/11/16-18:29:03.573] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,571] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 0: {'max_depth': 15, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:29:03.851] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,571] [41/Thread-4:local-2] [INFO] [dataiku.doctor.crossval.search_context] Fit s=4: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:29:03.851] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,847] [41/Thread-2:local-0] [INFO] [dataiku.doctor.crossval.search_context] Done s=0: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=8.4 st=1.4 sc=0.6987882446555655, sg=1)
[2023/11/16-18:29:03.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,848] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T1 done on local-0
[2023/11/16-18:29:03.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,849] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T6
[2023/11/16-18:29:03.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,849] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 1: {'max_depth': 15, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:29:03.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,850] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T6 on local-0...
[2023/11/16-18:29:04.142] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:03,850] [41/Thread-2:local-0] [INFO] [dataiku.doctor.crossval.search_context] Fit s=0: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:29:04.142] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,089] [41/Thread-5:local-3] [INFO] [dataiku.doctor.crossval.search_context] Done s=3: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=8.5 st=1.5 sc=0.7042085847339554, sg=1)
[2023/11/16-18:29:04.142] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,090] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T4 done on local-3
[2023/11/16-18:29:04.142] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,140] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T7
[2023/11/16-18:29:04.142] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,140] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 2: {'max_depth': 15, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:29:04.143] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,140] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T7 on local-3...
[2023/11/16-18:29:04.147] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,141] [41/Thread-5:local-3] [INFO] [dataiku.doctor.crossval.search_context] Fit s=1: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:29:04.147] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,143] [41/Thread-3:local-1] [INFO] [dataiku.doctor.crossval.search_context] Done s=1: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=8.5 st=1.6 sc=0.7143293880166172, sg=1)
[2023/11/16-18:29:04.147] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,144] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T2 done on local-1
[2023/11/16-18:29:04.147] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,145] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T8
[2023/11/16-18:29:04.148] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,145] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 3: {'max_depth': 15, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:29:04.148] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,145] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T8 on local-1...
[2023/11/16-18:29:04.748] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,146] [41/Thread-3:local-1] [INFO] [dataiku.doctor.crossval.search_context] Fit s=2: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:29:04.748] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,551] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:04.748] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,569] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:04.748] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,590] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (17): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:05.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,747] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:05.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:04,747] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:06.049] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:05,840] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:06.050] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:05,841] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:06.050] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:05,844] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (18): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:06.050] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:06,047] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:07.050] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:06,048] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:07.442] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:07,141] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:07.442] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:07,142] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:07.442] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:07,146] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (19): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:07.442] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:07,349] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:08.443] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:07,441] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:08.743] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:08,444] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:08.743] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:08,444] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:08.743] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:08,541] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (20): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:08.743] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:08,741] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:09.744] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:08,742] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:09.950] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:09,840] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:09.950] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:09,841] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:09.950] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:09,846] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (21): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:09.950] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:09,947] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:10.950] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:09,949] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:11.249] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:11,041] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:11.249] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:11,041] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:11.249] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:11,047] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (22): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:11.249] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:11,247] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:12.249] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:11,247] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:12.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:12.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:12.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:12,341] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:12.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:12,343] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:12.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:12,345] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (23): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:13.545] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:12,543] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:13.545] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:12,545] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:13.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:13,640] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:13.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:13,640] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:13.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:13,644] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (24): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:13.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:13,747] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:14.749] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:13,748] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:14.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:14,842] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:14.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:14,842] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:14.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:14,846] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (25): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:14.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:14,943] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:15.946] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:14,944] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:16.145] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:16,040] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:16.145] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:16,042] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:16.145] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:16,046] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (26): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:16.146] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:16,143] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:17.146] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:16,144] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:17.150] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:17.150] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:17.150] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:17.150] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:17.150] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,146] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:17.150] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,146] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:17.554] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,149] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (27): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:17.555] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,243] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:17.555] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,243] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:17.555] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:17.555] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:17.555] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:17.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:17.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,553] [41/Thread-4:local-2] [INFO] [dataiku.doctor.crossval.search_context] Done s=4: max_depth=6, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=8.2 st=5.8 sc=0.7099576561953234, sg=1)
[2023/11/16-18:29:17.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,554] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T5 done on local-2
[2023/11/16-18:29:17.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,554] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T9
[2023/11/16-18:29:17.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,555] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T9 on local-2...
[2023/11/16-18:29:17.559] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,556] [41/Thread-4:local-2] [INFO] [dataiku.doctor.crossval.search_context] Fit s=3: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:29:18.245] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,557] [41/Thread-34] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json
[2023/11/16-18:29:18.245] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,559] [41/Thread-34] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (28): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:18.245] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,661] [41/Thread-34] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fgrid_search_scores.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:18.245] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:17,678] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_evaluator] Schedule evaluation on split 4: {'max_depth': 15, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:29:19.246] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:18,244] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:19.246] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:18,245] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:19.246] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:18,249] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:19.246] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:18,250] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:19.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:19,251] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:19.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:19,252] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:19.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:19,254] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (29): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:19.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:19,346] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:20.348] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:19,346] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:20.351] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:20.351] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:20.351] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:20.351] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:20.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,347] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:20.359] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,348] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:20.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,350] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (30): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:20.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,540] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:20.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,540] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:20.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:20.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:21.543] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,943] [41/Thread-2:local-0] [INFO] [dataiku.doctor.crossval.search_context] Done s=0: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=13.0 st=4.1 sc=0.7036980024250608, sg=1)
[2023/11/16-18:29:21.543] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,944] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T6 done on local-0
[2023/11/16-18:29:21.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,944] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Enqueued task T10
[2023/11/16-18:29:21.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,945] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.work_scheduler] Running task T10 on local-0...
[2023/11/16-18:29:21.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:20,945] [41/Thread-2:local-0] [INFO] [dataiku.doctor.crossval.search_context] Fit s=4: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 
[2023/11/16-18:29:21.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,349] [41/Thread-5:local-3] [INFO] [dataiku.doctor.crossval.search_context] Done s=1: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=13.1 st=4.1 sc=0.7143176186637823, sg=1)
[2023/11/16-18:29:21.544] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,349] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T7 done on local-3
[2023/11/16-18:29:21.642] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,542] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:21.642] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,543] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:21.643] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,547] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (31): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:21.643] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,640] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:22.643] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:21,641] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:22.643] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,045] [41/Thread-3:local-1] [INFO] [dataiku.doctor.crossval.search_context] Done s=2: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=13.4 st=4.5 sc=0.7155129363089683, sg=1)
[2023/11/16-18:29:22.643] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,046] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T8 done on local-1
[2023/11/16-18:29:22.643] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,642] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:23.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,643] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:23.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,646] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (32): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:23.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,843] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:23.644] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:22,843] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:23.944] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:23.944] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:23.944] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:23,846] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:23.944] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:23,846] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:23.944] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:23,848] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (33): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:24.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:23,943] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:24.945] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:23,944] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:25.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:24,945] [41/Thread-1] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search'
[2023/11/16-18:29:25.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:24,945] [41/Thread-1] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search
[2023/11/16-18:29:25.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:24,948] [41/Thread-1] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (34): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:25.045] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,043] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 785
[2023/11/16-18:29:25.787] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,043] [41/Thread-1] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/stop_search, not found
[2023/11/16-18:29:25.787] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:25.787] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:25.787] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:25.788] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:25.788] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,302] [41/Thread-4:local-2] [INFO] [dataiku.doctor.crossval.search_context] Done s=3: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=5.6 st=2.2 sc=0.7103823876214969, sg=1)
[2023/11/16-18:29:25.788] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,340] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T9 done on local-2
[2023/11/16-18:29:25.815] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/pyenv/lib64/python3.6/site-packages/sklearn/ensemble/base.py:154: UserWarning: Loky-backed parallel loops cannot be nested below threads, setting n_jobs=1
[2023/11/16-18:29:25.815] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   n_jobs = min(effective_n_jobs(n_jobs), n_estimators)
[2023/11/16-18:29:25.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,786] [41/Thread-2:local-0] [INFO] [dataiku.doctor.crossval.search_context] Done s=4: max_depth=15, max_features=auto, min_samples_leaf=1, n_estimators=100, min_samples_split=3 (ft=4.3 st=0.5 sc=0.7176349407883722, sg=1)
[2023/11/16-18:29:25.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,786] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.work_scheduler] Task T10 done on local-0
[2023/11/16-18:29:25.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,788] [41/Thread-70] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json
[2023/11/16-18:29:25.816] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,790] [41/Thread-70] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (35): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:26.052] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:25,814] [41/Thread-70] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fgrid_search_scores.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:26.052] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,045] [41/Thread-1] [INFO] [dataiku.doctor.crossval.search_runner] Completed search for hyperparameters
[2023/11/16-18:29:26.052] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,046] [41/Thread-1] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json
[2023/11/16-18:29:26.058] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,051] [41/Thread-1] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fgrid_search_scores.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:26.059] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,052] [41/Thread-1] [INFO] [dataiku.doctor.distributed.work_scheduler] Scheduler has been soft interrupted
[2023/11/16-18:29:26.059] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,052] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_scores.json
[2023/11/16-18:29:26.059] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,057] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fgrid_search_scores.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:26.064] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,058] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/grid_search_done_py.json
[2023/11/16-18:29:26.064] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,062] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fgrid_search_done_py.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:26.064] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/MainThread] [INFO] [dataiku.doctor.distributed.work_scheduler] Scheduler has been hard interrupted (shutdown)
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.local_worker] Stopping worker: local-3
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.local_worker] Stopping worker: local-1
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.local_worker] Stopping worker: local-2
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-2:local-0] [ERROR] [dataiku.doctor.distributed.work_scheduler] All workers are dead, interrupt the scheduler
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-5:local-3] [INFO] [dataiku.doctor.distributed.local_worker] Stopped worker: local-3
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-3:local-1] [INFO] [dataiku.doctor.distributed.local_worker] Stopped worker: local-1
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,063] [41/Thread-4:local-2] [INFO] [dataiku.doctor.distributed.local_worker] Stopped worker: local-2
[2023/11/16-18:29:26.065] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,064] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.local_worker] Stopping worker: local-0
[2023/11/16-18:29:26.066] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,064] [41/Thread-2:local-0] [INFO] [dataiku.doctor.distributed.local_worker] Stopped worker: local-0
[2023/11/16-18:29:26.071] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,064] [41/MainThread] [INFO] [dataiku.doctor.crossval.search_runner] Hyperparameter search done, best_parameters being : {'max_depth': 15, 'max_features': 'auto', 'min_samples_leaf': 1, 'n_estimators': 100, 'min_samples_split': 3}
[2023/11/16-18:29:26.071] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,065] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Hyperparameter searching
[2023/11/16-18:29:26.072] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,065] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:29:26.072] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,069] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:26.072] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,070] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Fitting model
[2023/11/16-18:29:26.076] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,070] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:29:26.076] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,074] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:26.076] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] Fitting model:
[2023/11/16-18:29:26.076] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common]   Model is: RandomForestClassifier(bootstrap=True,
[2023/11/16-18:29:26.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             class_weight={0: 4.920441739914357, 1: 0.556555433757361},
[2023/11/16-18:29:26.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             criterion='gini', max_depth=15, max_features='auto',
[2023/11/16-18:29:26.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             max_leaf_nodes=None, min_impurity_decrease=0.0,
[2023/11/16-18:29:27.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             min_impurity_split=None, min_samples_leaf=1,
[2023/11/16-18:29:27.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             min_samples_split=3, min_weight_fraction_leaf=0.0,
[2023/11/16-18:29:27.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             n_estimators=100, n_jobs=4, oob_score=False, random_state=1337,
[2023/11/16-18:29:27.077] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             verbose=0, warm_start=False)
[2023/11/16-18:29:27.078] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common]   train_X class: <class 'numpy.ndarray'>
[2023/11/16-18:29:27.078] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common]   train_X shape: (43664, 57)
[2023/11/16-18:29:27.078] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:26,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common]   train_y shape: (43664,)
[2023/11/16-18:29:29.046] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,045] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_fit] Obtained RF CLF params: {'bootstrap': True, 'class_weight': {0: 4.920441739914357, 1: 0.556555433757361}, 'criterion': 'gini', 'max_depth': 15, 'max_features': 'auto', 'max_leaf_nodes': None, 'min_impurity_decrease': 0.0, 'min_impurity_split': None, 'min_samples_leaf': 1, 'min_samples_split': 3, 'min_weight_fraction_leaf': 0.0, 'n_estimators': 100, 'n_jobs': 4, 'oob_score': False, 'random_state': 1337, 'verbose': 0, 'warm_start': False} 
[2023/11/16-18:29:29.047] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,045] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_fit] Output params are {'resolved': {'algorithm': 'RANDOM_FOREST_CLASSIFICATION', 'skipExpensiveReports': False, 'rf': {'estimators': 100, 'max_tree_depth': 15, 'min_samples_leaf': 1, 'selection_mode': 'auto'}}, 'other': {'rf_min_samples_split': 3}}
[2023/11/16-18:29:29.047] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,045] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling DatasetSanityCheckDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.266] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,045] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ClassifierAccuracyCheckDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.266] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,045] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling RegressionR2CheckDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.266] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,045] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling LeakageDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.266] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,248] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] LeakageDiagnostic.on_fitting_end() generated diagnostics: []
[2023/11/16-18:29:29.266] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,248] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling TreeOverfitDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.266] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,265] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] TreeOverfitDiagnostic.on_fitting_end() generated diagnostics: []
[2023/11/16-18:29:29.267] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,265] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling MLAssertionsDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.272] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,265] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ModelCheckDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.272] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,265] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling AbnormalPredictionsDetectionDiagnostic.on_fitting_end()
[2023/11/16-18:29:29.272] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,265] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json
[2023/11/16-18:29:29.272] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,271] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fml_diagnostics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:29.278] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,271] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Fitting model
[2023/11/16-18:29:29.278] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,271] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Saving model
[2023/11/16-18:29:29.278] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,272] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:29:29.278] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,276] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:29.278] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,277] [41/MainThread] [INFO] [dataiku.doctor.prediction_entrypoints] PICKLING RandomForestClassifier(bootstrap=True,
[2023/11/16-18:29:29.278] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             class_weight={0: 4.920441739914357, 1: 0.556555433757361},
[2023/11/16-18:29:29.687] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             criterion='gini', max_depth=15, max_features='auto',
[2023/11/16-18:29:29.687] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             max_leaf_nodes=None, min_impurity_decrease=0.0,
[2023/11/16-18:29:29.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             min_impurity_split=None, min_samples_leaf=1,
[2023/11/16-18:29:29.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             min_samples_split=3, min_weight_fraction_leaf=0.0,
[2023/11/16-18:29:29.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             n_estimators=100, n_jobs=4, oob_score=False, random_state=1337,
[2023/11/16-18:29:29.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -             verbose=0, warm_start=False)
[2023/11/16-18:29:29.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,294] [41/MainThread] [INFO] [dataiku.base.dku_pickle] Setting cloudpickle as the pickle dumping tool
[2023/11/16-18:29:29.688] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,366] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/clf.pkl to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/clf.pkl
[2023/11/16-18:29:29.694] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,686] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fclf.pkl&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:29.695] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,688] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/actual_params.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/actual_params.json
[2023/11/16-18:29:29.695] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,692] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Factual_params.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:29.695] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,693] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Saving model
[2023/11/16-18:29:29.695] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,693] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Scoring model
[2023/11/16-18:29:29.902] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,693] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:29:29.902] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,698] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:29.902] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,698] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Intrinsic scoring
[2023/11/16-18:29:29.902] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,698] [41/MainThread] [INFO] [dataiku.doctor.prediction.scoring_base] Computing feature importance
[2023/11/16-18:29:29.902] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,901] [41/MainThread] [INFO] [dataiku.doctor.prediction.linear_coefficients_computation] Not computing linear coefficients because attribute `coef_` is not present
[2023/11/16-18:29:30.080] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,901] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Extracting rescalers
[2023/11/16-18:29:30.081] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:29,901] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Creating random forest trees summary
[2023/11/16-18:29:30.081] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,053] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/trees.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/trees.json
[2023/11/16-18:29:30.081] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,079] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrees.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:30.196] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,080] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/iperf.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/iperf.json
[2023/11/16-18:29:30.196] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,084] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fiperf.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:30.196] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,087] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(11029,57) tn=628653 nnz=66174 fill_ratio=0.11
[2023/11/16-18:29:30.196] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,087] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:29:30.196] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,192] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Starting threshold optim
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,195] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.000000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,197] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.025000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,200] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.050000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,202] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.075000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,204] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.100000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,206] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.125000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.212] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,209] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.150000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.252] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,211] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.175000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.252] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,213] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.200000 score 0.944795 (pred_true=11029)
[2023/11/16-18:29:30.252] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,216] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.225000 score 0.944886 (pred_true=11027)
[2023/11/16-18:29:30.252] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,242] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.250000 score 0.945016 (pred_true=11022)
[2023/11/16-18:29:30.252] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,244] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.275000 score 0.945272 (pred_true=11010)
[2023/11/16-18:29:30.253] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,247] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.300000 score 0.944876 (pred_true=10987)
[2023/11/16-18:29:30.253] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,249] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.325000 score 0.943472 (pred_true=10929)
[2023/11/16-18:29:30.270] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,251] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.350000 score 0.940847 (pred_true=10817)
[2023/11/16-18:29:30.270] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,254] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.375000 score 0.935847 (pred_true=10654)
[2023/11/16-18:29:30.270] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,256] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.400000 score 0.921633 (pred_true=10261)
[2023/11/16-18:29:30.271] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,259] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.425000 score 0.893980 (pred_true=9461)
[2023/11/16-18:29:30.271] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,261] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.450000 score 0.827853 (pred_true=7976)
[2023/11/16-18:29:30.271] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,264] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.475000 score 0.729576 (pred_true=6148)
[2023/11/16-18:29:30.271] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,267] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.500000 score 0.673993 (pred_true=5321)
[2023/11/16-18:29:30.289] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,269] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.525000 score 0.644351 (pred_true=4943)
[2023/11/16-18:29:30.289] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,272] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.550000 score 0.626285 (pred_true=4719)
[2023/11/16-18:29:30.289] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,275] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.575000 score 0.613852 (pred_true=4578)
[2023/11/16-18:29:30.289] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,278] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.600000 score 0.604933 (pred_true=4477)
[2023/11/16-18:29:30.289] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,280] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.625000 score 0.592003 (pred_true=4331)
[2023/11/16-18:29:30.290] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,283] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.650000 score 0.576677 (pred_true=4171)
[2023/11/16-18:29:30.290] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,286] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.675000 score 0.552219 (pred_true=3913)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,288] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.700000 score 0.514494 (pred_true=3544)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,291] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.725000 score 0.473098 (pred_true=3154)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,294] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.750000 score 0.440869 (pred_true=2868)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,296] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.775000 score 0.412419 (pred_true=2622)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,299] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.800000 score 0.373780 (pred_true=2314)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,301] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.825000 score 0.335770 (pred_true=2026)
[2023/11/16-18:29:30.307] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,304] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.850000 score 0.286852 (pred_true=1678)
[2023/11/16-18:29:30.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,306] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.875000 score 0.215665 (pred_true=1207)
[2023/11/16-18:29:30.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,309] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.900000 score 0.155813 (pred_true=843)
[2023/11/16-18:29:30.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,311] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.925000 score 0.098730 (pred_true=517)
[2023/11/16-18:29:30.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,313] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.950000 score 0.033456 (pred_true=168)
[2023/11/16-18:29:30.326] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,315] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] AT CUT 0.975000 score 0.005655 (pred_true=28)
[2023/11/16-18:29:30.326] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,315] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Selected threshold 0.275 
[2023/11/16-18:29:30.326] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,324] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] preds [1 1 1 ... 1 1 1]
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,324] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] MAPPED SHAPE 11029
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,324] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] k=0 v=0
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,324] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Mask data [False False False ... False False False]
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,325] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] mapped pred <class 'numpy.ndarray'>
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,325] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] k=1 v=1
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,325] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Mask data [ True  True  True ...  True  True  True]
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,325] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] mapped pred <class 'numpy.ndarray'>
[2023/11/16-18:29:30.339] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,325] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] MAPPED PREDS ['1' '1' '1' ... '1' '1' '1']
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/doctor/utils/metrics.py:56: FutureWarning: Support for multi-dimensional indexing (e.g. `obj[:, None]`) is deprecated and will be removed in a future version.  Convert to a numpy array before indexing instead.
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   np.put_along_axis(T, y_true.astype(int)[:, np.newaxis], sample_weight[:, np.newaxis], axis=1)
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,338] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] Total true rate = 9875 / 11029
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,338] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] Computing lift on first 4411 rows
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,339] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] True rate on considered : 4411 / 4281
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,339] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] Lift = 1.083945
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,400] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Density for 0 (id 0)
[2023/11/16-18:29:30.401] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,400] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] valid_y shape = (11029,)
[2023/11/16-18:29:30.490] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,400] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] CP: <class 'numpy.ndarray'> ((11029,))
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,400] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Actual shape = (11029,)
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,400] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] MASK is <class 'numpy.ndarray'> 
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,400] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Class proba shape (1154,)
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,489] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Density for 1 (id 1)
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,489] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] valid_y shape = (11029,)
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,489] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] CP: <class 'numpy.ndarray'> ((11029,))
[2023/11/16-18:29:30.491] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,489] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Actual shape = (11029,)
[2023/11/16-18:29:30.638] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,489] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] MASK is <class 'numpy.ndarray'> 
[2023/11/16-18:29:30.638] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,489] [41/MainThread] [INFO] [dataiku.doctor.prediction.classification_scoring] Class proba shape (9875,)
[2023/11/16-18:29:30.638] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/doctor/utils/calibration.py:34: RuntimeWarning: invalid value encountered in true_divide
[2023/11/16-18:29:30.638] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   freq_pos = y_true[i_start:i_end].sum() / weight
[2023/11/16-18:29:30.638] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/doctor/utils/calibration.py:35: RuntimeWarning: invalid value encountered in double_scalars
[2023/11/16-18:29:30.638] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   avg_pred = y_prob[i_start:i_end].sum() / weight
[2023/11/16-18:29:30.639] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,628] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/predicted.csv to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/predicted.csv
[2023/11/16-18:29:30.851] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,637] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fpredicted.csv&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:30.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,641] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json
[2023/11/16-18:29:30.852] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,646] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fperf.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:31.136] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,850] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/prediction_statistics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/prediction_statistics.json
[2023/11/16-18:29:31.136] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:30,855] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fprediction_statistics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:31.136] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,130] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dss_pipeline_meta.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dss_pipeline_meta.json
[2023/11/16-18:29:31.745] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,135] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fdss_pipeline_meta.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:31.745] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,724] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dss_pipeline_model.gz to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/dss_pipeline_model.gz
[2023/11/16-18:29:31.745] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,738] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fdss_pipeline_model.gz&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:31.745] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,743] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling DatasetSanityCheckDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,744] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] DatasetSanityCheckDiagnostic.on_scoring_end() generated diagnostics: []
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,744] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ClassifierAccuracyCheckDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] ClassifierAccuracyCheckDiagnostic.on_scoring_end() generated diagnostics: []
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling RegressionR2CheckDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] RegressionR2CheckDiagnostic.on_scoring_end() generated diagnostics: []
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling LeakageDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] LeakageDiagnostic.on_scoring_end() generated diagnostics: []
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling TreeOverfitDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling MLAssertionsDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.753] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] MLAssertionsDiagnostic.on_scoring_end() generated diagnostics: []
[2023/11/16-18:29:31.754] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,751] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling ModelCheckDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.754] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,752] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] calling AbnormalPredictionsDetectionDiagnostic.on_scoring_end()
[2023/11/16-18:29:31.754] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,752] [41/MainThread] [DEBUG] [dataiku.doctor.diagnostics.diagnostics] AbnormalPredictionsDetectionDiagnostic.on_scoring_end() generated diagnostics: ["The model almost always predicts the class '1'"]
[2023/11/16-18:29:31.759] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,752] [41/MainThread] [INFO] [dataiku.doctor.diagnostics.diagnostics] Adding diagnostic: <DoctorDiagnostic ML_DIAGNOSTICS_ABNORMAL_PREDICTIONS_DETECTION: The model almost always predicts the class '1'>
[2023/11/16-18:29:31.759] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,752] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/ml_diagnostics.json
[2023/11/16-18:29:31.759] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,757] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fml_diagnostics.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:31.759] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,757] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Scoring model
[2023/11/16-18:29:31.759] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,757] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] START -  Preparing explainability
[2023/11/16-18:29:31.764] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,758] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:29:31.764] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,762] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:31.764] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,762] [41/MainThread] [INFO] [dataiku.doctor.prediction_entrypoints] Starting to compute global explanations
[2023/11/16-18:29:31.765] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,763] [41/MainThread] [INFO] [dataiku.doctor.prediction_entrypoints] Building model handler
[2023/11/16-18:29:31.769] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,763] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json'
[2023/11/16-18:29:31.769] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,763] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json
[2023/11/16-18:29:31.769] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,767] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 797
[2023/11/16-18:29:31.769] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,767] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json, not found
[2023/11/16-18:29:31.794] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,768] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/user_meta.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/user_meta.json'
[2023/11/16-18:29:31.794] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,768] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/user_meta.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/user_meta.json
[2023/11/16-18:29:31.794] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,770] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (36): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:31.794] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,792] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 794
[2023/11/16-18:29:31.817] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,793] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/user_meta.json, not found
[2023/11/16-18:29:31.817] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,793] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json.gz' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json.gz'
[2023/11/16-18:29:31.817] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,793] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json.gz into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json.gz
[2023/11/16-18:29:31.817] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,795] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (37): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:31.817] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,815] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 788
[2023/11/16-18:29:31.843] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,815] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/perf.json.gz, not found
[2023/11/16-18:29:31.843] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,816] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json'
[2023/11/16-18:29:31.843] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,816] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json
[2023/11/16-18:29:31.843] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,818] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (38): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:31.892] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,842] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 797
[2023/11/16-18:29:31.892] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,842] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/roverrides.json, not found
[2023/11/16-18:29:31.892] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,888] [41/MainThread] [INFO] [dataiku.core.saved_model] Post-processing model
[2023/11/16-18:29:31.892] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,889] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] generating interactions
[2023/11/16-18:29:31.893] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,889] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] {'feature_selection_params': {'method': 'NONE', 'random_forest_params': {'n_trees': 30, 'depth': 10, 'n_features': 25}, 'lasso_params': {'alpha': [0.01, 0.1, 1.0, 10.0, 100.0], 'cross_validate': True}, 'pca_params': {'n_features': 25, 'variance_proportion': 0.9}, 'correlation_params': {'min_abs_correlation': 0.0, 'max_abs_correlation': 1.0, 'n_features': 25}, 'custom_params': {'code': '# type your code here'}}, 'preprocessingFitSampleRatio': 1.0, 'preprocessingFitSampleSeed': 1337, 'target_remapping': [{'sourceValue': '0', 'mappedValue': 0, 'sampleFreq': 944}, {'sourceValue': '1', 'mappedValue': 1, 'sampleFreq': 9056}], 'skipPreprocessing': False, 'per_feature': {'date': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DateSource'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_latitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'spending_type': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_day': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_month': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_fico_score': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_id': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_longitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'item_category': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'dist_cardholder_merchant': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_state_enName': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_date_parsed': {'generate_derivative': False, 'numerical_handling': 'DATETIME_CYCLICAL', 'missing_handling': 'DROP_ROW', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': ['DAY', 'HOUR', 'MINUTE', 'WEEK'], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Date'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_state': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_state_enName': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'signature_provided': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_dow': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_age': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'transaction_id': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_IDENTIFIER', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_year': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_first_active_month': {'generate_derivative': False, 'numerical_handling': 'DATETIME_CYCLICAL', 'missing_handling': 'DROP_ROW', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': ['QUARTER', 'WEEK', 'YEAR'], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Date'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'days_active': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_latitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_category_id': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_id': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_subsector_description': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'INPUT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_longitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_hour': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_geopoint': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'GeoPoint'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_amount': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_reward_program': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_state': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'INPUT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_geopoint': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'GeoPoint'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'risk': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_date': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DateSource'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'authorized_flag': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'TARGET', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}}, 'reduce': {'enabled': False, 'kept_variance': 0.0}, 'feature_generation': {'pairwise_linear': {'behavior': 'DISABLED'}, 'polynomial_combinations': {'behavior': 'DISABLED'}, 'manual_interactions': {'interactions': []}, 'numericals_clustering': {'k': 0, 'all_features': False, 'input_features': [], 'behavior': 'DISABLED'}, 'categoricals_count_transformer': {'all_features': False, 'input_features': [], 'behavior': 'DISABLED'}}}
[2023/11/16-18:29:31.894] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,889] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] No feature selection to perform
[2023/11/16-18:29:31.894] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,890] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] generating interactions
[2023/11/16-18:29:31.895] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,890] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] {'feature_selection_params': {'method': 'NONE', 'random_forest_params': {'n_trees': 30, 'depth': 10, 'n_features': 25}, 'lasso_params': {'alpha': [0.01, 0.1, 1.0, 10.0, 100.0], 'cross_validate': True}, 'pca_params': {'n_features': 25, 'variance_proportion': 0.9}, 'correlation_params': {'min_abs_correlation': 0.0, 'max_abs_correlation': 1.0, 'n_features': 25}, 'custom_params': {'code': '# type your code here'}}, 'preprocessingFitSampleRatio': 1.0, 'preprocessingFitSampleSeed': 1337, 'target_remapping': [{'sourceValue': '0', 'mappedValue': 0, 'sampleFreq': 944}, {'sourceValue': '1', 'mappedValue': 1, 'sampleFreq': 9056}], 'skipPreprocessing': False, 'per_feature': {'date': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DateSource'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_latitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'spending_type': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_day': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_month': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_fico_score': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_id': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_longitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'item_category': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'dist_cardholder_merchant': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_state_enName': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_date_parsed': {'generate_derivative': False, 'numerical_handling': 'DATETIME_CYCLICAL', 'missing_handling': 'DROP_ROW', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': ['DAY', 'HOUR', 'MINUTE', 'WEEK'], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Date'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_state': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_state_enName': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'signature_provided': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_dow': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_age': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'transaction_id': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_IDENTIFIER', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_year': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'autoReason': 'REJECT_ZERO_VARIANCE', 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_first_active_month': {'generate_derivative': False, 'numerical_handling': 'DATETIME_CYCLICAL', 'missing_handling': 'DROP_ROW', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': ['QUARTER', 'WEEK', 'YEAR'], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Date'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'days_active': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_latitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_category_id': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_id': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_subsector_description': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'INPUT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_longitude': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_hour': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'REJECT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_geopoint': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'GeoPoint'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_amount': {'generate_derivative': False, 'numerical_handling': 'REGULAR', 'missing_handling': 'IMPUTE', 'missing_impute_with': 'MEAN', 'impute_constant_value': 0.0, 'keep_regular': False, 'rescaling': 'AVGSTD', 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'INPUT', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DoubleMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'card_reward_program': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_state': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'INPUT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'USStateMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'merchant_geopoint': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'GeoPoint'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'risk': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'Text'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'purchase_date': {'category_handling': 'DUMMIFY', 'missing_handling': 'NONE', 'missing_impute_with': 'MODE', 'dummy_clip': 'MAX_NB_CATEGORIES', 'cumulative_proportion': 0.95, 'min_samples': 10, 'max_nb_categories': 100, 'max_cat_safety': 200, 'nb_bins_hashing': 1048576, 'hash_whole_categories': True, 'dummy_drop': 'NONE', 'impact_method': 'M_ESTIMATOR', 'impact_m': 10, 'impact_kfold': True, 'impact_kfold_k': 5, 'impact_kfold_seed': 1337, 'ordinal_order': 'COUNT', 'ordinal_ascending': False, 'ordinal_default_mode': 'HIGHEST', 'ordinal_default_value': 0, 'frequency_default_mode': 'EXPLICIT', 'frequency_default_value': 0.0, 'frequency_normalized': True, 'role': 'REJECT', 'type': 'CATEGORY', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'DateSource'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}, 'authorized_flag': {'generate_derivative': False, 'impute_constant_value': 0.0, 'keep_regular': False, 'quantile_bin_nb_bins': 4, 'binarize_threshold_mode': 'MEDIAN', 'binarize_constant_threshold': 0.0, 'datetime_cyclical_periods': [], 'role': 'TARGET', 'type': 'NUMERIC', 'state': {'userModified': False, 'autoModifiedByDSS': False, 'recordedMeaning': 'LongMeaning'}, 'customHandlingCode': '', 'customProcessorWantsMatrix': False, 'sendToInput': 'main'}}, 'reduce': {'enabled': False, 'kept_variance': 0.0}, 'feature_generation': {'pairwise_linear': {'behavior': 'DISABLED'}, 'polynomial_combinations': {'behavior': 'DISABLED'}, 'manual_interactions': {'interactions': []}, 'numericals_clustering': {'k': 0, 'all_features': False, 'input_features': [], 'behavior': 'DISABLED'}, 'categoricals_count_transformer': {'all_features': False, 'input_features': [], 'behavior': 'DISABLED'}}}
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,890] [41/MainThread] [INFO] [dataiku.doctor.preprocessing_handler] No feature selection to perform
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,890] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Preparing explainer components: column importance, background rows and feature histograms
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [root] Reading with dtypes: None
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for transaction_id: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for authorized_flag: <class 'numpy.object_'> (schema_type=bigint feature_type=NUMERIC feature_role=TARGET)
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_date: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_date_parsed: None (schema_type=date feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.896] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_year: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_month: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_day: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_dow: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_hour: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for date: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_id: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_id: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_category_id: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for item_category: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for purchase_amount: <class 'numpy.float64'> (schema_type=double feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:29:31.897] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for signature_provided: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_subsector_description: str (schema_type=string feature_type=CATEGORY feature_role=INPUT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for spending_type: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_latitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_longitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,891] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_first_active_month: None (schema_type=date feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for days_active: None (schema_type=bigint feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_reward_program: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_latitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_longitude: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:31.898] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_fico_score: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_age: <class 'numpy.float64'> (schema_type=bigint feature_type=NUMERIC feature_role=INPUT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_geopoint: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_state: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for card_state_enName: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_geopoint: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_state: str (schema_type=string feature_type=CATEGORY feature_role=INPUT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for merchant_state_enName: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:31.899] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for dist_cardholder_merchant: None (schema_type=double feature_type=NUMERIC feature_role=REJECT)
[2023/11/16-18:29:32.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [dataiku.doctor.utils] Computed dtype for risk: None (schema_type=string feature_type=CATEGORY feature_role=REJECT)
[2023/11/16-18:29:32.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:31,892] [41/MainThread] [INFO] [root] Reading with FIXED dtypes: {'authorized_flag': <class 'numpy.object_'>, 'purchase_amount': <class 'numpy.float64'>, 'signature_provided': <class 'numpy.float64'>, 'merchant_subsector_description': 'str', 'card_fico_score': <class 'numpy.float64'>, 'card_age': <class 'numpy.float64'>, 'merchant_state': 'str'}
[2023/11/16-18:29:32.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,507] [41/MainThread] [INFO] [root] Loaded table
[2023/11/16-18:29:32.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,514] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 0       2017-01-01 00:00:59+00:00
[2023/11/16-18:29:32.519] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1       2017-01-01 00:21:40+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2       2017-01-01 00:58:34+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3       2017-01-01 01:09:52+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4       2017-01-01 01:26:59+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659   2017-04-30 23:32:02+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660   2017-04-30 23:36:28+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661   2017-04-30 23:41:56+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662   2017-04-30 23:44:24+00:00
[2023/11/16-18:29:32.520] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663   2017-04-30 23:55:25+00:00
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 43664, dtype: datetime64[ns, UTC]
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/doctor/utils/__init__.py:160: DeprecationWarning: parsing timezone aware datetimes is deprecated; this will raise an error in the future
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   return (pd.Series((series.values.astype("datetime64[ms]") - np.datetime64(EPOCH))) / np.timedelta64(1, 's')).reindex_like(series, method='pad')
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,517] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 0        3.692218e+09
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1        3.692219e+09
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2        3.692221e+09
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3        3.692222e+09
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4        3.692223e+09
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:29:32.534] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659    3.702584e+09
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660    3.702584e+09
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661    3.702585e+09
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662    3.702585e+09
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663    3.702585e+09
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 43664, dtype: float64
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,519] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 0       2020-12-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1       2019-12-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2       2019-05-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3       2020-09-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4       2019-10-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659   2021-01-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660   2020-12-01 00:00:00+00:00
[2023/11/16-18:29:32.535] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661   2021-04-01 00:00:00+00:00
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662   2020-07-01 00:00:00+00:00
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663   2020-08-01 00:00:00+00:00
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 43664, dtype: datetime64[ns, UTC]
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,522] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 0        3.815770e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 1        3.784147e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 2        3.765658e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3        3.807907e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4        3.778877e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43659    3.818448e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43660    3.815770e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43661    3.826224e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43662    3.802550e+09
[2023/11/16-18:29:32.536] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 43663    3.805229e+09
[2023/11/16-18:29:32.537] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 43664, dtype: float64
[2023/11/16-18:29:32.537] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,522] [41/MainThread] [INFO] [dataiku.doctor.utils] Coercion done
[2023/11/16-18:29:32.537] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,528] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 43664
[2023/11/16-18:29:32.537] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,528] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:29:32.557] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,528] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {'card_fico_score': 568.4182621839502, 'signature_provided': 0.18848479296445583, 'card_age': 45.95275283986808, 'purchase_amount': 222.5142034628016}
[2023/11/16-18:29:32.557] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,531] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:29:32.557] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,531] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:29:32.557] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,531] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (card_fico_score)
[2023/11/16-18:29:32.557] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,531] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale card_fico_score (avg=568.4182621839502 std=166.76433796516395 shift=568.4182621839502 inv_scale=0.005996485892618684)
[2023/11/16-18:29:32.557] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,533] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled card_fico_score (avg=-3.3839376071429144e-16 std=1.0000000000000264) nulls=0
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,533] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (signature_provided)
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,533] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale signature_provided (avg=0.18848479296445583 std=0.39110328423727586 shift=0.18848479296445583 inv_scale=2.556869349614862)
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,535] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled signature_provided (avg=1.2621311511898445e-15 std=0.9999999999998468) nulls=0
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,535] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (card_age)
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,536] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale card_age (avg=45.95275283986808 std=20.830437866840672 shift=45.95275283986808 inv_scale=0.04800667208210102)
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,537] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled card_age (avg=-2.8197996846585256e-18 std=0.999999999999991) nulls=0
[2023/11/16-18:29:32.558] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,537] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:RescalingProcessor2 (purchase_amount)
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,538] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescale purchase_amount (avg=222.5142034628016 std=522.9107911649871 shift=222.5142034628016 inv_scale=0.0019123720850589279)
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,541] [41/MainThread] [DEBUG] [dku.ml.preprocessing]   Rescaled purchase_amount (avg=1.0082131477553118e-14 std=0.9999999999999739) nulls=0
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,541] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(num_flagonly)
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,541] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(datetime_cyclical)
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,541] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FastSparseDummifyProcessor (merchant_subsector_description)
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,559] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Dummifier: Append a sparse block shape=(43664, 40) nnz=43664
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,560] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FastSparseDummifyProcessor (merchant_state)
[2023/11/16-18:29:32.584] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,577] [41/MainThread] [DEBUG] [dku.ml.preprocessing] Dummifier: Append a sparse block shape=(43664, 13) nnz=43664
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,577] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,577] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(cat_flagpresence)
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:MultipleImputeMissingFromInput
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] MIMIFI: Imputing with map {}
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:FlushDFBuilder(interaction)
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:DumpPipelineState
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] ********* Pipeline state (Before feature selection)
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    input_df= (43664, 35) 
[2023/11/16-18:29:32.585] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    current_mf=(43664, 57) 
[2023/11/16-18:29:32.586] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    PPR: 
[2023/11/16-18:29:32.586] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:EmitCurrentMFAsResult
[2023/11/16-18:29:32.586] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 43664
[2023/11/16-18:29:32.586] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] PROCESS WITH Step:DumpPipelineState
[2023/11/16-18:29:32.586] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing] ********* Pipeline state (At end)
[2023/11/16-18:29:32.586] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    input_df= (43664, 35) 
[2023/11/16-18:29:33.164] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    current_mf=(0, 0) 
[2023/11/16-18:29:33.164] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]    PPR: 
[2023/11/16-18:29:33.164] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,578] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       TRAIN = <class 'dataiku.doctor.multiframe.MultiFrame'> ((43664, 57))
[2023/11/16-18:29:33.164] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,579] [41/MainThread] [DEBUG] [dku.ml.preprocessing]       UNPROCESSED = <class 'pandas.core.frame.DataFrame'> ((43664, 35))
[2023/11/16-18:29:33.165] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,579] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(43664,57) tn=2488848 nnz=261984 fill_ratio=0.11
[2023/11/16-18:29:33.165] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:32,579] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:29:33.185] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,160] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json'
[2023/11/16-18:29:33.185] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,160] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json
[2023/11/16-18:29:33.185] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,162] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (39): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:33.185] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,183] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 818
[2023/11/16-18:29:33.185] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,183] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json, not found
[2023/11/16-18:29:33.209] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,184] [41/MainThread] [INFO] [dataiku.doctor.prediction.column_importance_handler] Reusing the model feature importance
[2023/11/16-18:29:33.209] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,184] [41/MainThread] [INFO] [dataiku.doctor.prediction.column_importance_handler] Saving column importance
[2023/11/16-18:29:33.209] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,185] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/column_importance.json
[2023/11/16-18:29:33.209] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,187] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (40): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:33.213] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,208] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fcolumn_importance.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:33.213] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,208] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv'
[2023/11/16-18:29:33.213] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,208] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv
[2023/11/16-18:29:33.214] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,212] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 809
[2023/11/16-18:29:33.274] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,212] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv, not found
[2023/11/16-18:29:33.274] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,220] [41/MainThread] [INFO] [dataiku.doctor.prediction.background_rows_handler] Building background rows
[2023/11/16-18:29:33.274] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,225] [41/MainThread] [INFO] [dataiku.doctor.prediction.background_rows_handler] Background estimated bias <= 0.04656370812941052
[2023/11/16-18:29:33.274] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,240] [41/MainThread] [INFO] [dataiku.doctor.prediction.background_rows_handler] Built background rows with shape=(1000, 35)
[2023/11/16-18:29:33.274] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,240] [41/MainThread] [INFO] [dataiku.doctor.prediction.background_rows_handler] Saving background rows with shape=(1000, 35)
[2023/11/16-18:29:33.274] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,271] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/background_rows.csv
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,273] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (41): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,308] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fbackground_rows.csv&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,312] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 187     2017-01-02 12:01:04+00:00
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 37042   2017-04-14 20:47:34+00:00
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 15081   2017-02-16 18:57:43+00:00
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11304   2017-02-06 09:41:07+00:00
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11563   2017-02-06 22:22:25+00:00
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4495    2017-01-16 12:36:48+00:00
[2023/11/16-18:29:33.316] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 38461   2017-04-18 12:25:16+00:00
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3682    2017-01-13 18:29:36+00:00
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 868     2017-01-04 18:30:26+00:00
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 39778   2017-04-21 10:27:58+00:00
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 1000, dtype: datetime64[ns, UTC]
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - /opt/dataiku/python/dataiku/doctor/utils/__init__.py:160: DeprecationWarning: parsing timezone aware datetimes is deprecated; this will raise an error in the future
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -   return (pd.Series((series.values.astype("datetime64[ms]") - np.datetime64(EPOCH))) / np.timedelta64(1, 's')).reindex_like(series, method='pad')
[2023/11/16-18:29:33.317] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,315] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 187      3.700572e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 37042    3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 15081    3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11304    3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11563    3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4495     3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 38461    3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3682     3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 868      3.693228e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 39778    3.701759e+09
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: purchase_date_parsed, Length: 1000, dtype: float64
[2023/11/16-18:29:33.318] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,316] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalizing date to numeric : 187     2020-08-01 00:00:00+00:00
[2023/11/16-18:29:33.319] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 37042   2021-03-01 00:00:00+00:00
[2023/11/16-18:29:33.319] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 15081   2021-02-01 00:00:00+00:00
[2023/11/16-18:29:33.319] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11304   2020-12-01 00:00:00+00:00
[2023/11/16-18:29:33.319] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11563   2020-12-01 00:00:00+00:00
[2023/11/16-18:29:33.319] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -                    ...           
[2023/11/16-18:29:33.319] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4495    2020-03-01 00:00:00+00:00
[2023/11/16-18:29:33.323] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 38461   2019-01-01 00:00:00+00:00
[2023/11/16-18:29:33.323] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3682    2019-12-01 00:00:00+00:00
[2023/11/16-18:29:33.323] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 868     2020-09-01 00:00:00+00:00
[2023/11/16-18:29:33.323] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 39778   2021-03-01 00:00:00+00:00
[2023/11/16-18:29:33.323] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 1000, dtype: datetime64[ns, UTC]
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,318] [41/MainThread] [INFO] [dataiku.doctor.utils] Normalized date : 187      3.826224e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 37042    3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 15081    3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11304    3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 11563    3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  -              ...     
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 4495     3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 38461    3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 3682     3.823546e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 868      3.818448e+09
[2023/11/16-18:29:33.324] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - 39778    3.823546e+09
[2023/11/16-18:29:33.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Name: card_first_active_month, Length: 1000, dtype: float64
[2023/11/16-18:29:33.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,319] [41/MainThread] [INFO] [dataiku.doctor.utils] Coercion done
[2023/11/16-18:29:33.325] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,322] [41/MainThread] [INFO] [dataiku.base.folder_context] Fetching file from backend: source='/data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json' target='/home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json'
[2023/11/16-18:29:33.407] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,322] [41/MainThread] [INFO] [dataiku.container.file_exchange] Fetching file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json into /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json
[2023/11/16-18:29:33.407] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,326] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/get-file HTTP/1.1" 404 830
[2023/11/16-18:29:33.408] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,326] [41/MainThread] [WARNING] [dataiku.container.file_exchange] Could not fetch file /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json, not found
[2023/11/16-18:29:33.408] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,336] [41/MainThread] [INFO] [dataiku.doctor.posttraining.features_distribution] Computing features distribution
[2023/11/16-18:29:33.408] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,404] [41/MainThread] [INFO] [dataiku.doctor.posttraining.features_distribution] Saving features distribution
[2023/11/16-18:29:33.439] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,406] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/features_distribution.json
[2023/11/16-18:29:33.439] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,409] [41/MainThread] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (42): dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111
[2023/11/16-18:29:33.439] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,432] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ffeatures_distribution.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:34.033] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,438] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "GET /kernel/tintercom/ml/prediction/get-max-columns-to-explain HTTP/1.1" 200 2
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,440] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Computing shapley values in 2 chunks for 6 columns: ['card_fico_score', 'signature_provided', 'card_age', 'merchant_subsector_description', 'purchase_amount', 'merchant_state']
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,441] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Processing chunk 1/2
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,466] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Built two frankensteins of shape (45000, 6) for chunk 1
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,466] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,508] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,508] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(45000,57) tn=2565000 nnz=270000 fill_ratio=0.11
[2023/11/16-18:29:34.034] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:33,508] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:29:34.592] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,032] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:34.592] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,075] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:34.592] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(45000,57) tn=2565000 nnz=270000 fill_ratio=0.11
[2023/11/16-18:29:34.593] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,075] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:29:34.593] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,501] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Extracting shapley values from predictions for 1/2 chunk
[2023/11/16-18:29:34.593] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,503] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Processing chunk 2/2
[2023/11/16-18:29:34.593] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,549] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Built two frankensteins of shape (45000, 6) for chunk 2
[2023/11/16-18:29:34.593] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,549] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,591] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,591] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(45000,57) tn=2565000 nnz=270000 fill_ratio=0.11
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:34,591] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,013] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,076] [41/MainThread] [INFO] [dataiku.doctor.multiframe] Set MF index len 45000
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,077] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] prepare multiframe shape=(45000,57) tn=2565000 nnz=270000 fill_ratio=0.11
[2023/11/16-18:29:35.551] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,077] [41/MainThread] [INFO] [dataiku.doctor.prediction.common] too small, using array
[2023/11/16-18:29:35.552] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,543] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Extracting shapley values from predictions for 2/2 chunk
[2023/11/16-18:29:35.552] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,545] [41/MainThread] [INFO] [dataiku.doctor.individual_explainer] Building explanations object
[2023/11/16-18:29:35.562] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,550] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/global_explanations_absolute_importance.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/global_explanations_absolute_importance.json
[2023/11/16-18:29:35.562] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,555] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fglobal_explanations_absolute_importance.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:35.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,561] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/global_explanations_observations.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/global_explanations_observations.json
[2023/11/16-18:29:35.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,568] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Fglobal_explanations_observations.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:35.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,569] [41/MainThread] [INFO] [dataiku.doctor.utils.listener] END -  Preparing explainability
[2023/11/16-18:29:35.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,570] [41/MainThread] [INFO] [dataiku.doctor.utils] Training with python version: 3.6.8 (sys.version_info(major=3, minor=6, micro=8, releaselevel='final', serial=0))
[2023/11/16-18:29:35.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,570] [41/MainThread] [INFO] [root] Sending /home/dataiku/cache/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json to /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239/train_info.json
[2023/11/16-18:29:36.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,574] [41/MainThread] [DEBUG] [urllib3.connectionpool] https://dss-headless-node-bf3772dc.space-500c3c3c-int2.svc.cluster.local:45111 "POST /kernel/tintercom/containers/put-file?executionId=prediction-training-km6zokl&fileKind=FILTERED_PATHS&path=%2Fdata%2Fdataiku%2Fdatadir%2Fsaved_models%2FTUT_BATCH%2FZ7LESED5%2Fversions%2F1700159323239%2Ftrain_info.json&expand=false HTTP/1.1" 200 0
[2023/11/16-18:29:36.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Installing debugging signal handler
[2023/11/16-18:29:36.575] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:35,762] [1/MainThread] [INFO] [root] Stop monitoring process 41
[2023/11/16-18:29:40.576] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:39,665] [1/Thread-1] [WARNING] [root] Process not yet started, or shutting down
[2023/11/16-18:29:40.576] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:39,666] [1/Thread-1] [INFO] [root] Done monitoring process 41
[2023/11/16-18:29:40.576] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - [2023-11-16 18:29:39,666] [1/MainThread] [INFO] [root] Containerized process exited with status 0
[2023/11/16-18:29:40.576] [kubectl-stream-logs-out-85] [INFO] [dku.utils]  - Installing debugging signal handler
[2023/11/16-18:29:40.683] [Thread-64] [DEBUG] [dku.utils]  - Process kubectl-stream-logs done (return code 0)
[2023/11/16-18:29:40.683] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Log streaming stopped with rv=0, retrying
[2023/11/16-18:29:41.183] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Check if pods could still produce logs
[2023/11/16-18:29:41.287] [Thread-72] [DEBUG] [dku.utils]  - Process kubectl-get-pods done (return code 0)
[2023/11/16-18:29:41.289] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Pods phase is Running
[2023/11/16-18:29:41.289] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Container states are {"terminated":1}
[2023/11/16-18:29:41.290] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Log streaming terminated with return code 0
[2023/11/16-18:29:41.290] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Waiting for kubernetes pod to finish
[2023/11/16-18:29:41.290] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - wait for pod to complete, getting pod status
[2023/11/16-18:29:41.290] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Querying status on pod dataiku-exec-prediction-training-km6zokl- try number 1
[2023/11/16-18:29:41.386] [Thread-75] [DEBUG] [dku.utils]  - Process kubectl-get-pod done (return code 0)
[2023/11/16-18:29:41.387] [FRT-61-FlowRunnable] [DEBUG] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - kubectl get pod OK, out=Running
[2023/11/16-18:29:41.387] [FRT-61-FlowRunnable] [DEBUG] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Kubernetes pod is running
[2023/11/16-18:29:46.387] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - wait for pod to complete, getting pod status
[2023/11/16-18:29:46.388] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Querying status on pod dataiku-exec-prediction-training-km6zokl- try number 1
[2023/11/16-18:29:46.528] [Thread-78] [DEBUG] [dku.utils]  - Process kubectl-get-pod done (return code 0)
[2023/11/16-18:29:46.528] [FRT-61-FlowRunnable] [DEBUG] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - kubectl get pod OK, out=Succeeded
[2023/11/16-18:29:46.528] [FRT-61-FlowRunnable] [INFO] [dku.containers.kubernetes] act.train_Predict_authorized_flag__binary__NP - Kubernetes pod is succeeded
[2023/11/16-18:29:46.532] [FRT-61-FlowRunnable] [INFO] [dku.ml.distributed.pool] act.train_Predict_authorized_flag__binary__NP - Closing worker pool pool-nbuljmc85kywpzfs
[2023/11/16-18:29:46.532] [FRT-61-FlowRunnable] [INFO] [dku.ml.distributed.service] act.train_Predict_authorized_flag__binary__NP - Unregistered worker pool: pool-nbuljmc85kywpzfs
[2023/11/16-18:29:46.532] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Stopping kubectl-loop: Thread[Thread-59,5,main]
[2023/11/16-18:29:46.532] [FRT-61-FlowRunnable] [DEBUG] [dku.remoterun.registry] act.train_Predict_authorized_flag__binary__NP - Finished with container execution prediction-training-km6zokl
[2023/11/16-18:29:46.533] [FRT-61-FlowRunnable] [DEBUG] [dku.resourceusage] act.train_Predict_authorized_flag__binary__NP - Reporting completion of CRU:{"context":{"type":"JOB_ACTIVITY","authIdentifier":"sean.angiolillo@dataiku.com","projectKey":"TUT_BATCH","jobId":"Scenario_build_Predict_authorized_flag__binary__2023-11-16T18-28-12.334","activityId":"train_Predict_authorized_flag__binary__NP","activityType":"recipe","recipeType":"prediction_training","recipeName":"train_Predict_authorized_flag__binary_"},"type":"SINGLE_K8S_JOB","id":"woNOtnJJYCHMG8yq","startTime":1700159325596,"singleK8SJob":{"k8sClusterId":"__builtin__","executionId":"prediction-training-km6zokl","cpuRequest":1.0,"cpuLimit":1.0,"memoryRequestMB":4086,"memoryLimitMB":4096}}
[2023/11/16-18:29:46.533] [FRT-61-FlowRunnable] [INFO] [dku.recipes.code.base] act.train_Predict_authorized_flag__binary__NP - Cleaning Kubernetes pod
[2023/11/16-18:29:46.536] [FRT-61-FlowRunnable] [INFO] [dku.security.process] act.train_Predict_authorized_flag__binary__NP - Starting process (regular)
[2023/11/16-18:29:46.538] [FRT-61-FlowRunnable] [INFO] [dku.security.process] act.train_Predict_authorized_flag__binary__NP - Process started with pid=181289
[2023/11/16-18:29:46.653] [null-out-105] [INFO] [dku.utils]  - secret "dkusecret-prediction-training-km6zokl" deleted
[2023/11/16-18:29:46.692] [null-out-105] [INFO] [dku.utils]  - pod "dataiku-exec-prediction-training-km6zokl" deleted
[2023/11/16-18:29:46.725] [FRT-61-FlowRunnable] [INFO] [dku.ml.distributed.pool] act.train_Predict_authorized_flag__binary__NP - Closing worker pool pool-gkqgzktydoylrptp
[2023/11/16-18:29:46.725] [FRT-61-FlowRunnable] [INFO] [dku.ml.distributed.service] act.train_Predict_authorized_flag__binary__NP - Unregistered worker pool: pool-gkqgzktydoylrptp
[2023/11/16-18:29:46.728] [FRT-61-FlowRunnable] [WARN] [dku.warnings] act.train_Predict_authorized_flag__binary__NP - ML_DIAGNOSTICS_DATASET_SANITY_CHECKS: The train dataset is imbalanced (balance=0.47), metrics can be misleading
[2023/11/16-18:29:46.728] [FRT-61-FlowRunnable] [WARN] [dku.warnings] act.train_Predict_authorized_flag__binary__NP - ML_DIAGNOSTICS_DATASET_SANITY_CHECKS: The test dataset is imbalanced (balance=0.48), metrics can be misleading
[2023/11/16-18:29:46.728] [FRT-61-FlowRunnable] [WARN] [dku.warnings] act.train_Predict_authorized_flag__binary__NP - ML_DIAGNOSTICS_ABNORMAL_PREDICTIONS_DETECTION: The model almost always predicts the class '1'
[2023/11/16-18:29:46.752] [FRT-61-FlowRunnable] [INFO] [dku.ml.versioning] act.train_Predict_authorized_flag__binary__NP - Dumping version info {"trainedWithDSSVersion":"12.3.1","trainedWithDSSConfVersion":"12220","trainedWithDSSBackend":"PY_MEMORY","backendCompatibilityVersion":18} in /data/dataiku/datadir/saved_models/TUT_BATCH/Z7LESED5/versions/1700159323239
[2023/11/16-18:29:46.805] [FRT-61-FlowRunnable] [INFO] [dku.flow.activity] act.train_Predict_authorized_flag__binary__NP - Run thread done for activity train_Predict_authorized_flag__binary__NP
[2023/11/16-18:29:46.885] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - activity is finished
[2023/11/16-18:29:46.885] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Executing default post-activity lifecycle hook
[2023/11/16-18:29:46.887] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Activity successful, computing metrics and running checks
[2023/11/16-18:29:47.085] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Activity checks produced 0 value
[2023/11/16-18:29:47.085] [ActivityExecutor-36] [INFO] [dku.flow.activity] running train_Predict_authorized_flag__binary__NP - Activity successful, final-committing: Thread[FRT-61-FlowRunnable,5,]
[2023/11/16-18:29:47.087] [ActivityExecutor-36] [INFO] [dku.recipes.train] running train_Predict_authorized_flag__binary__NP - Setting new version as active scoring version
[2023/11/16-18:29:47.124] [ActivityExecutor-36] [INFO] [dku.flow] running train_Predict_authorized_flag__binary__NP - Invalidate Flow memory cache
[2023/11/16-18:29:47.196] [ActivityExecutor-36] [INFO] [dku.recipes.train] running train_Predict_authorized_flag__binary__NP - Increment last train index
[2023/11/16-18:29:47.290] [ActivityExecutor-36] [INFO] [dku.recipes.train] running train_Predict_authorized_flag__binary__NP - Done Increment last train index
