Class ColumnEncoderFeatureHash
java.lang.Object
org.apache.sysds.runtime.transform.encode.ColumnEncoder
org.apache.sysds.runtime.transform.encode.ColumnEncoderFeatureHash
- All Implemented Interfaces:
Externalizable,Serializable,Comparable<ColumnEncoder>,Encoder
Class used for feature hashing transformation of frames.
- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic classNested classes/interfaces inherited from class org.apache.sysds.runtime.transform.encode.ColumnEncoder
ColumnEncoder.EncoderType -
Field Summary
Fields inherited from class org.apache.sysds.runtime.transform.encode.ColumnEncoder
APPLY_ROW_BLOCKS_PER_COLUMN, BUILD_ROW_BLOCKS_PER_COLUMN -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoidallocateMetaData(FrameBlock meta) Pre-allocate a FrameBlock for metadata collection.voidbuild(CacheBlock<?> in) Build the transform meta data for the given block input.List<DependencyTask<?>>getBuildTasks(CacheBlock<?> in) longgetK()getMetaData(FrameBlock meta) Construct a frame block out of the transform meta data.voidinitMetaData(FrameBlock meta) Sets up the required meta data for a subsequent call to apply.voidmergeAt(ColumnEncoder other) Merges another encoder, of a compatible type, in after a certain position.voidRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.toString()voidRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.Methods inherited from class org.apache.sysds.runtime.transform.encode.ColumnEncoder
apply, apply, build, build, buildPartial, compareTo, computeMapSizeEstimate, getApplyTasks, getBuildTask, getColID, getColMapping, getDomainSize, getEstMetaSize, getEstNumDistincts, getPartialBuildTask, getPartialMergeBuildTask, initEmbeddings, isApplicable, isApplicable, prepareBuildPartial, setColID, setEstMetaSize, setEstNumDistincts, shiftCol, updateIndexRanges
-
Constructor Details
-
ColumnEncoderFeatureHash
public ColumnEncoderFeatureHash(int colID, long K) -
ColumnEncoderFeatureHash
public ColumnEncoderFeatureHash()
-
-
Method Details
-
getK
public long getK() -
build
Description copied from interface:EncoderBuild the transform meta data for the given block input. This call modifies and keeps meta data as encoder state.- Parameters:
in- input frame block
-
getBuildTasks
- Overrides:
getBuildTasksin classColumnEncoder
-
mergeAt
Description copied from class:ColumnEncoderMerges another encoder, of a compatible type, in after a certain position. Resizes as necessary.ColumnEncodersare compatible with themselves andEncoderCompositeis compatible with every otherColumnEncoders.MultiColumnEncodersare compatible with every encoder- Overrides:
mergeAtin classColumnEncoder- Parameters:
other- the encoder that should be merged in
-
allocateMetaData
Description copied from interface:EncoderPre-allocate a FrameBlock for metadata collection.- Parameters:
meta- frame block
-
getMetaData
Description copied from interface:EncoderConstruct a frame block out of the transform meta data.- Parameters:
meta- output frame block- Returns:
- output frame block?
-
initMetaData
Description copied from interface:EncoderSets up the required meta data for a subsequent call to apply.- Parameters:
meta- frame block
-
writeExternal
Description copied from class:ColumnEncoderRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd serialization.- Specified by:
writeExternalin interfaceExternalizable- Overrides:
writeExternalin classColumnEncoder- Parameters:
out- object output- Throws:
IOException- if IOException occurs
-
readExternal
Description copied from class:ColumnEncoderRedirects the default java serialization via externalizable to our default hadoop writable serialization for efficient broadcast/rdd deserialization.- Specified by:
readExternalin interfaceExternalizable- Overrides:
readExternalin classColumnEncoder- Parameters:
in- object input- Throws:
IOException- if IOException occur
-
toString
-