7|hfQddlZddlZddlZddlmZmZddlmZmZm Z m Z m Z m Z ddl Z ddlmZddlmZddlmZddlmZmZmZmZmZdgZGd d eeZd e eefd efd Zd e eefd efdZd e eefd efdZGddeZ GddeZ!d efdZ"d efdZ#d efdZ$ded e%fdZ&dede e%d efdZ'ded efdZ(eddd Gd!deZ)y)"N)ABCabstractmethod)AnyCallableDictListMappingOptional) deprecated)CallbackManagerForLLMRun)LLM) BaseModel ConfigDictField PrivateAttrmodel_validator Databricksc eZdZUdZeed<eed<dedededefdZdedefd Zdededefd Z e dded e e d efdefdZ edefdZy )_DatabricksClientBasez0A base JSON API client that talks to Databricks.api_url api_tokenmethodurlrequestreturncdd|ji}tj||||}|js%t d|j d|j |jS)N AuthorizationzBearer )rrheadersjsonzHTTP z error: )rrequestsrok ValueError status_codetextr)selfrrrrresponses b/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/databricks.pyrz_DatabricksClientBase.requestsi"gdnn-=$>?##sG' {{uX%9%9$:(8==/RS S}}c(|jd|dS)NGETr)r%rs r'_getz_DatabricksClientBase._get&s||E3--r(c(|jd||S)NPOSTr+)r%rrs r'_postz_DatabricksClientBase._post)s||FC11r(Ntransform_output_fn.cyN)r%rr0s r'postz_DatabricksClientBase.post,sr(cy)NFr3r%s r'llmz_DatabricksClientBase.llm1sr(r2)__name__ __module__ __qualname____doc__str__annotations__rrr,r/rr rr4propertyboolr7r3r(r'rrs: LNccc...22s2s2PT19(38:L1M Tr(rr&rc|dddS)Nchoicesrr$r3r&s r'_transform_completionsrC6s I q !& ))r(c|dddS)N candidatesrr$r3rBs r'_transform_llama2_chatrF:s L !! $V ,,r(c|ddddS)NrArmessagecontentr3rBs r'_transform_chatrJ>s I q !) ,Y 77r(ceZdZUdZeed<eed<eed<dZeed<dZe ed<dZ e eed <d effd Z e d e fd Zededeeefd efdZ ddede edefd efdZxZS) _DatabricksServingEndpointClientz:An API client that talks to a Databricks serving endpoint.host endpoint_namedatabricks_uriNclientFexternal_or_foundationtaskdatac xt|di| ddlm}||j|_|j j|j}|jddjdv|_ |j|jd|_ yy#t $r}t d|d}~wwxYw) Nr)get_deploy_clientzMFailed to create the client. Please install mlflow with `pip install mlflow`. endpoint_type)external_modelfoundation_model_apirRr3) super__init__mlflow.deploymentsrUrOrP ImportError get_endpointrNgetlowerrQrR)r%rSrUeendpoint __class__s r'r[z)_DatabricksServingEndpointClient.__init__Ls  4   <+D,?,?@DK;;++D,>,>?&.ll?B&G&M&M&OT ' # 99  V,DI  C  sB B9( B44B9rc|jdvS)N) llm/v1/chatllm/v1/completions llama2/chat)rRr6s r'r7z$_DatabricksServingEndpointClient.llmasyyPPPr(beforemodevaluesc>d|vr|d}|d}d|d|d}||d<|S)NrrMrNhttps://z/serving-endpoints/z /invocationsr3)clsrkrMrNrs r' set_api_urlz,_DatabricksServingEndpointClient.set_api_urlesC F "&>D"?3M &9- UG 'F9  r(rr0.c|jrg|jj|j|}|r||S|jdk(r t |S|jdk(r t |S|Sd|gi}|jj|j|}|d}t|tr|dn|}|jdk(r t|S|r||S|S)N)rbinputsrerfdataframe_records predictionsrrg) rQrPpredictrNrRrJrC isinstancelistrF)r%rr0respwrapped_requestr&predspreds r'r4z%_DatabricksServingEndpointClient.postos  & &;;&&0B0B7&SD"*400yyM)&t,,22-d33K 3WI>O{{**++O+H]+E)%658EDyyM)-d330C&t, M Mr(r2)r8r9r:r;r<r=rPrrQr?rRr r[r>r7r classmethodrrorr4 __classcell__rcs@r'rLrLBsD IFC#(D(D(3--s-*QTQQ(#c3hC$QUNN19(38:L1MN Nr(rLceZdZUdZeed<eed<eed<ededeee fde fd Z dd e d e e d efde fdZ y )#_DatabricksClusterDriverProxyClientzBAn API client that talks to a Databricks cluster driver proxy app.rM cluster_idcluster_driver_portrhrirkrcLd|vr|d}|d}|d}d|d|d|}||d<|S)NrrMrrrmz/driver-proxy-api/o/0//r3)rnrkrMrportrs r'roz/_DatabricksClusterDriverProxyClient.set_api_urlsR F "&>D -J/0D &=2.0.0. Error: zFFailed to load the pickled function from a hexadecimal string. Error: )r" cloudpicklerloadsbytesfromhex)rSrrras r' _load_pickled_fn_from_hex_stringrs + A  K   t!455 KEaSIJJK  TUVTW X   s,8#A AAA A3 A..A3fnc ddl} |j|j S#t$r}td|d}~wwxYw#t$r}td|d}~wwxYw)z6Pickles a function and returns the hexadecimal string.rNrzFailed to pickle the function: )rrr"dumpshex)rrras r'_pickle_fn_to_hex_stringrsxK@  $((** KEaSIJJK @:1#>??@s)&A A=A A!AA!z0.3.3z1.0z#databricks_langchain.ChatDatabricks)sinceremovalalternative_importc eZdZUdZeeZeed< ee Z eed< dZ e eed< dZ e eed< dZe eed< dZe eeefed < dZe eed < dZe ed efed < d Zeed< dZeed< dZeed< dZe eeed< dZe eed< eeZeeefed< dZe eed< dZ e!ed< e"Z#e$ed<e%dZ&e'deeeffdZ(e)de*d eeefdefd!Z+d"effd# Z,e'deeeffd$Z-e'de.eeffd%Z/e'defd&Z0 d+d'ede eed(e e1d)edef d*Z2xZ3S),ra Databricks serving endpoint or a cluster driver proxy app for LLM. It supports two endpoint types: * **Serving endpoint** (recommended for both production and development). We assume that an LLM was deployed to a serving endpoint. To wrap it as an LLM you must have "Can Query" permission to the endpoint. Set ``endpoint_name`` accordingly and do not set ``cluster_id`` and ``cluster_driver_port``. If the underlying model is a model registered by MLflow, the expected model signature is: * inputs:: [{"name": "prompt", "type": "string"}, {"name": "stop", "type": "list[string]"}] * outputs: ``[{"type": "string"}]`` If the underlying model is an external or foundation model, the response from the endpoint is automatically transformed to the expected format unless ``transform_output_fn`` is provided. * **Cluster driver proxy app** (recommended for interactive development). One can load an LLM on a Databricks interactive cluster and start a local HTTP server on the driver node to serve the model at ``/`` using HTTP POST method with JSON input/output. Please use a port number between ``[3000, 8000]`` and let the server listen to the driver IP address or simply ``0.0.0.0`` instead of localhost only. To wrap it as an LLM you must have "Can Attach To" permission to the cluster. Set ``cluster_id`` and ``cluster_driver_port`` and do not set ``endpoint_name``. The expected server schema (using JSON schema) is: * inputs:: {"type": "object", "properties": { "prompt": {"type": "string"}, "stop": {"type": "array", "items": {"type": "string"}}}, "required": ["prompt"]}` * outputs: ``{"type": "string"}`` If the endpoint model signature is different or you want to set extra params, you can use `transform_input_fn` and `transform_output_fn` to apply necessary transformations before and after the query. )default_factoryrMrNrNrr model_kwargstransform_input_fn.r0 databricksrOg temperaturenstop max_tokens extra_paramsrRFr_clientforbid)extrarc|j|jd}|jr|j|d<|j|j|d<|S)N)rrrr)rrrr)r%paramss r' _llm_paramszDatabricks._llm_paramssN ++"  99!YYF6N ?? &#'??F<  r(rhrirkc|jd}|jd}|r |r td|rd|d<n*|rn' tjx}r||d<td|jd}|r |r td|rd|d<n*| tdt |d krtd | |jd x}rd |vsJd d|vsJd|S#t$r}td|d}~wwxYw)NrrNz-Cannot set both endpoint_name and cluster_id.z"Context doesn't contain clusterId.zuNeither endpoint_name nor cluster_id was set. And the cluster_id cannot be automatically determined. Received error: rz6Cannot set both endpoint_name and cluster_driver_port.z? =UV V ,0F( ) (N $ % *<=P->-JMN N    * MMN"    ;YY.."00#22YY DL__!9!9>YY..??$($<$< DLV r(c|j|j|j|j|j|j |j |j|j|j|j|j|jdnt|j|jddSt|jdS)zReturn default params.N)rMrNrrrOrrrrrrrRrr0)rMrNrrrOrrrrrrrRrrr0r6s r'_default_paramszDatabricks._default_paramssII!////#'#;#;"11 --++II// --II&&.#')$*A*AB''/$(#  &*$*B*BC'  r(c|jSr2)rr6s r'_identifying_paramszDatabricks._identifying_paramss###r(cy)zReturn type of llm.rr3r6s r' _llm_typezDatabricks._llm_typesr(r run_managerkwargsc xd|i}|jjr|j|j|j|jxs |j |j||r||d<|j r|j di|}|jj||jS)zAQueries the LLM endpoint with the given prompt and stop sequence.rr)r0r3) rr7updaterrrrr4r0)r%rrrrrs r'_callzDatabricks._call$s$,V"4 <<   NN4++ ,t((=D,=,=>v "GFO  " "-d--88G||  d>V>V WWr()NN)4r8r9r:r;rrrMr<r=rrrNr rrrrrrrr0rOrfloatrrrrrdictrrRrr?rrrr model_configr>rrr{rr[rr rrr rr|r}s@r'rr s /b&67D#7+@AIsA$(M8C=' !%J $*.#- .2L(4S>*1 .2*1 9=(38"45<'NC&FK# AsJ7 $D(49 $ $J $3#(#>L$sCx.>7D(3--2#T1&1]G "2L T#s(^  (#*DcN*t*$*X,s,\ c3h  0$WS#X%6$$3%):> XXtCy!X67 X  X Xr()*rrrabcrrtypingrrrrr r r langchain_core._apir langchain_core.callbacksr langchain_core.language_modelsr pydanticrrrrr__all__rr<rCrFrJrLrrrrr?rrrrr3r(r'rsT #??*=. .Is@*T#s(^**-T#s(^--8d38n88FN'<FNRJ*?J2  #  #(s&)))  08   8 @ @c @  < kXkX  kXr(