Class Dl4jModelReader
java.lang.Object
org.apache.lucene.analysis.synonym.word2vec.Dl4jModelReader
- All Implemented Interfaces:
Closeable
,AutoCloseable
Dl4jModelReader reads the file generated by the library Deeplearning4j and provide a
Word2VecModel with normalized vectors
Dl4j Word2Vec documentation: https://deeplearning4j.konduit.ai/v/en-1.0.0-beta7/language-processing/word2vec Example to generate a model using dl4j: https://github.com/eclipse/deeplearning4j-examples/blob/master/dl4j-examples/src/main/java/org/deeplearning4j/examples/advanced/modelling/embeddingsfromcorpus/word2vec/Word2VecRawTextExample.java
-
Field Summary
Fields -
Constructor Summary
Constructors -
Method Summary
Modifier and TypeMethodDescriptionvoid
close()
(package private) static BytesRef
decodeB64Term
(String term) private static TermAndVector
extractTermAndVector
(String[] tokens, int vectorDimension, boolean isTermB64Encoded) read()
-
Field Details
-
MODEL_FILE_NAME_PREFIX
- See Also:
-
word2VecModelZipFile
-
-
Constructor Details
-
Dl4jModelReader
-
-
Method Details
-
read
- Throws:
IOException
-
extractTermAndVector
private static TermAndVector extractTermAndVector(String[] tokens, int vectorDimension, boolean isTermB64Encoded) -
decodeB64Term
-
close
- Specified by:
close
in interfaceAutoCloseable
- Specified by:
close
in interfaceCloseable
- Throws:
IOException
-