org.apache.spark.ml

Class Pipeline.SharedReadWrite$

java.lang.Object

org.apache.spark.ml.Pipeline.SharedReadWrite$

Enclosing class:

Pipeline

public static class Pipeline.SharedReadWrite$
extends java.lang.Object

Methods for MLReader and MLWriter shared between Pipeline and PipelineModel

Field Summary

Fields

Modifier and Type	Field and Description
static Pipeline.SharedReadWrite$	MODULE$ Static reference to the singleton instance of this Scala object.

Constructor Summary

Constructors

Constructor and Description
Pipeline.SharedReadWrite$()

Method Summary

Methods

Modifier and Type	Method and Description
java.lang.String	getStagePath(java.lang.String stageUid, int stageIdx, int numStages, java.lang.String stagesDir) Get path for saving the given stage.
scala.Tuple2<java.lang.String,PipelineStage[]>	load(java.lang.String expectedClassName, SparkContext sc, java.lang.String path) Load metadata and stages for a Pipeline or PipelineModel
void	saveImpl(Params instance, PipelineStage[] stages, SparkContext sc, java.lang.String path) Save metadata and stages for a Pipeline or PipelineModel - save metadata to path/metadata - save stages to stages/IDX_UID
void	validateStages(PipelineStage[] stages) Check that all stages are Writable

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

MODULE$

public static final Pipeline.SharedReadWrite$ MODULE$

Static reference to the singleton instance of this Scala object.

Constructor Detail

Pipeline.SharedReadWrite$

public Pipeline.SharedReadWrite$()

Method Detail

validateStages

public void validateStages(PipelineStage[] stages)

Check that all stages are Writable

saveImpl

public void saveImpl(Params instance,
            PipelineStage[] stages,
            SparkContext sc,
            java.lang.String path)

Save metadata and stages for a Pipeline or PipelineModel - save metadata to path/metadata - save stages to stages/IDX_UID

Parameters:

instance - (undocumented)

stages - (undocumented)

sc - (undocumented)

path - (undocumented)

load

public scala.Tuple2<java.lang.String,PipelineStage[]> load(java.lang.String expectedClassName,
                                                  SparkContext sc,
                                                  java.lang.String path)

Load metadata and stages for a Pipeline or PipelineModel

Parameters:

expectedClassName - (undocumented)

sc - (undocumented)

path - (undocumented)

Returns:

(UID, list of stages)

getStagePath

public java.lang.String getStagePath(java.lang.String stageUid,
                            int stageIdx,
                            int numStages,
                            java.lang.String stagesDir)

Get path for saving the given stage.