7|h1~ddlmZddlmZmZmZddlmZddlm Z m Z m Z dZ dZ dZGdd e eZGd d eZy ) )Path)AnyDictList) Embeddings) BaseModel ConfigDictFieldz.require_model_exportEsFXI$% 1 !"%99AACCG%(<<DDFFWF #..x(BTf.U %-D4 ?3K3K3M% !+ 3 3+3~~001EFNN !()011DE "4P$,,VV=C>exportT) AutoTokenizerzQUnable to import transformers, please install with `pip install -U transformers`.)NN)super__init__optimum.intel.openvinor ImportErrorhuggingface_hubrstrrboolrfrom_pretrainedrr transformersr1r)selfrrer/r1r __class__s @r.r4zOpenVINOEmbeddings.__init__/s` "6"  J  -CG! ! %(! B sentences batch_sizeshow_progress_barconvert_to_numpyconvert_to_tensor mean_poolingnormalize_embeddingscD ddl} ddlm}  ddldt dt d t ffd } |rd }d } t |ts t|d s|g}d } g} |j|Dcgc]}|j| c}}|Dcgc]}|| }}| dt||d| D]}||||z}|jjjdjd}|j r|j#|d d d}n$|j#|d|j%d d}|jdi|}|r | ||d}n |ddddf}|r(j&j(j+|dd}|r|j-}| j/||j|Dcgc]}| | } }|r.t| rj1| } n@j3} n/|r-|j5| Dcgc]}|jc}} | r| d} | S#t$r} td| d} ~ wwxYw#t$r} td| d} ~ wwxYw#t$r} td| d} ~ wwxYwcc}wcc}wcc}wcc}w)aw Computes sentence embeddings. :param sentences: the sentences to embed. :param batch_size: the batch size used for the computation. :param show_progress_bar: Whether to output a progress bar. :param convert_to_numpy: Whether the output should be a list of numpy vectors. :param convert_to_tensor: Whether the output should be one large tensor. :param mean_pooling: Whether to pool returned vectors. :param normalize_embeddings: Whether to normalize returned vectors. :return: By default, a 2d numpy array with shape [num_inputs, output_dimension]. rNzCUnable to import numpy, please install with `pip install -U numpy`.)trangezAUnable to import tqdm, please install with `pip install -U tqdm`.zCUnable to import torch, please install with `pip install -U torch`. model_outputattention_maskrc|d}|jdj|jj}j ||zdj |j ddz S)NrrBg& .>)min) unsqueezeexpandsizefloatrKclamp)rWrXtoken_embeddingsinput_mask_expandedtorchs r.run_mean_poolingz3OpenVINOEmbeddings.encode..run_mean_poolings+  ((,334D4I4I4KLRRT 99-0CCQG%++#''*KVK FrATBatches)descdisablerBpt)padding truncationreturn_tensors max_length)rjrmrkrl)pdimr2)numpyr6tqdmrVrcrrCr8rIargsortrMrEr requestinputsget_partial_shape is_dynamicr get_lengthnn functional normalizecpuextendstackTensorasarray)r<rNrOrPrQrRrSrTnpr=rVrdinput_was_stringall_embeddingssenlength_sorted_idxidxsentences_sorted start_indexsentences_batchlengthfeatures out_features embeddingsembrcs @r.encodezOpenVINOEmbeddings.encodes.     #    3    $   i %W y. # I#  JJ9'UC):):3)?(?'UV6GHsIcNHH! s9~z GXCX  .K/{[:=UVO]]**11!4FFHKF  >>#TdSW* >>#(%002##' *)4==484L-lHEU"!&^!<!& ZZ(O(OPN +A.Nq U    S    U  6(VHFX)Ps]H7II1#J J JJ7 I I  I I. I))I.1 J : JJ forbidr2)extraprotected_namespacestextscttd|}|j|fd|ji|j}|j S)Compute doc embeddings using a HuggingFace transformer model. Args: texts: The list of texts to embed. Returns: List of embeddings, one for each text. c&|jddS)N  )r&)xs r.z4OpenVINOEmbeddings.embed_documents.. s199T3#7rerP)listmaprrrtolist)r<rrs r.embed_documentsz"OpenVINOEmbeddings.embed_documentssVS7?@ T[[  %)%7%7 ;?;M;M   ""rec,|j|gdS)Compute query embeddings using a HuggingFace transformer model. Args: text: The text to embed. Returns: Embeddings for the text. r)r)r<r?s r. embed_queryzOpenVINOEmbeddings.embed_querys##TF+A..re model_pathc|jj|jj||jj|y)NT)r halfsave_pretrainedr)r<rs r. save_modelzOpenVINOEmbeddings.save_models;  %%j1 &&z2re)FTFFT)__name__ __module__ __qualname____doc__r r__annotations__rr8r rDrrrrr9r4rJrMrr model_configrr_rrr __classcell__r>s@r.r r s_"Hc Is(#(#>L$sCx.>1$)$$?M4S>?RM4)KPKPZ///*"'!%"'"%)qqq q  q  qq#q qfH2FL#T#Y#4U 3D#" / /U / rer ceZdZUdZeZeed< dZeed< de ffd Z de ede e e fd Z d ede e fd ZxZS) OpenVINOBgeEmbeddingsaOpenVNO BGE embedding models. Bge Example: .. code-block:: python from langchain_community.embeddings import OpenVINOBgeEmbeddings model_name = "BAAI/bge-large-en-v1.5" model_kwargs = {'device': 'CPU'} encode_kwargs = {'normalize_embeddings': True} ov = OpenVINOBgeEmbeddings( model_name_or_path=model_name, model_kwargs=model_kwargs, encode_kwargs=encode_kwargs ) query_instructionembed_instructionrc Xt|di|d|jvr t|_yy)rz-zhNr2)r3r4r DEFAULT_QUERY_BGE_INSTRUCTION_ZHr)r<rr>s r.r4zOpenVINOBgeEmbeddings.__init__@s. "6" D++ +%ED " ,rerrc|Dcgc]!}|j|jddz#}}|j|fi|j}|j Scc}w)rrr)rr&rrr)r<rrLrs r.rz%OpenVINOBgeEmbeddings.embed_documentsGs_INN1''!))D#*>>NN T[[=$*<*<=   ""Os&Ar?c|jdd}|j|j|zfi|j}|j S)rrr)r&rrrr)r<r? embeddings r.rz!OpenVINOBgeEmbeddings.embed_queryTsI||D#&DKK 6 6 =TASAST !!re)rrrr DEFAULT_QUERY_BGE_INSTRUCTION_ENrr8rrrr4rr_rrrrs@r.rr)sk">s=1s4FF #T#Y #4U 3D # " "U "rerN)pathlibrtypingrrrlangchain_core.embeddingsrpydanticrr r DEFAULT_QUERY_INSTRUCTIONrrr rr2rer.rsT""011C@!$_ VJVr6".6"re