Skip to content

Instantly share code, notes, and snippets.

View santoshdahale's full-sized avatar

Santosh Dahale santoshdahale

1 follower · 4 following
View GitHub Profile
@KexinFeng
KexinFeng / BertTranslator.java
Last active February 1, 2025 21:14
Deploying HuggingFace QA model in Java
import ai.djl.modality.nlp.DefaultVocabulary;
import ai.djl.modality.nlp.Vocabulary;
import ai.djl.modality.nlp.bert.BertToken;
import ai.djl.modality.nlp.bert.BertTokenizer;
import ai.djl.modality.nlp.qa.QAInput;
import ai.djl.ndarray.NDArray;
import ai.djl.ndarray.NDList;
import ai.djl.ndarray.NDManager;
import ai.djl.translate.Batchifier;
import ai.djl.translate.Translator;