> ) OOGLL ) ??7#4#4#6#?#?'' 3%% J  Y''" Mrctj|}|jtjk(rdS|jS)z+Get the logger level for the given log nameN)r^r_r\ra)r'rjs rget_logger_levelrops0   t $F<<7>>14Cv||Cr spark_contextcd|jjjdk\r^|jjj|jjj j dS|jjjS)z0Gets the current max number of concurrent tasks.z3.1r)_jscscversionmaxNumConcurrentTasksresourceProfileManagerresourceProfileFromIdrps r_get_max_num_concurrent_tasksryvs&&(E1!!$$&<<    ! ! # : : < R RST U      " 8 8 ::rcR|jjjS)zWhether it is Spark local mode)rrrsisLocalrxs r _is_localr|s"    " * * ,,rconfcx|jd}|duxr$|jdxs|jdS)Nz spark.masterzspark://z local-cluster)rW startswith)r}masters r_is_standalone_or_localclusterrs@ XXn %F   *%K):):?)Kr task_contextc| td|j}d|vr tdt|djdj S)z&Get the gpu id from the task resourcesz3_get_gpu_id should not be invoked from driver side.gpuzDCouldn't get the gpu id, Please check the GPU resource configurationr)rX resourcesint addressesstrip)rrs r _get_gpu_idrs`PQQ&&(I I R   y))!,224 55rctj}tjj |d}tjj |stj ||S)Nz xgboost-tmp)rgetRootDirectoryospathjoinexistsmakedirs)root_dir xgb_tmp_dirs r_get_or_create_tmp_dirrsF**,H'',,x7K 77>>+ & K rmodelxgb_model_creatorcf|}|jt|jd|S)zH Deserialize an xgboost.XGBModel instance from the input model. utf-8) load_model bytearrayencode)rr xgb_models rdeserialize_xgb_modelrs. "#I 5<<#89: rboosterctjjtt j d}|j |t|d5}|j}ddd|S#1swYSxYw)z Serialize the input booster to a string. Parameters ---------- booster: an xgboost.core.Booster instance .jsonrencodingN) rrrruuiduuid4 save_modelopenread)r tmp_file_namefser_model_strings rserialize_boosterrskGGLL!7!9djjl^5;QRM }% mg .$!668$ $ s A77Bct}tjjt t j d}t|dd5}|j|ddd|j||S#1swYxYw)zN Deserialize an xgboost.core.Booster from the input ser_model_string. rwrrN) rrrrrrrrwriter)rrrrs rdeserialize_boosterrsqiGGGLL!7!9djjl^5;QRM mS7 3q  }% Ns BB devicec |dvS)z&Whether xgboost is using CUDA workers.)cudarr1)rs ruse_cudars _ $$r)N)5r9r!r^rrer threadingrtypingrrrrrr r rVr r r rrpyspark.sql.sessionrxgboostrrxgboost.collectiverCCtxxgboost.trackerrr2rr+rrJrMrAr[Loggerrmroryboolr|rrrrrrrr1rrrsA BBBXX,%:(...   %(X  #s(^ &!$! . 3 4S> /CDcN , .L .S%S/!:gnn(D3D8C=D ;;#;-\-d- t 6k 6c 6 #+BL#9 w3" s w %Xc]%t%r