7|hnddlZddlmZmZddlmZddlmZeje Z GddeZ y)N)AnyOptional)LLM)IpexLLMceZdZdZe ddddddedeedeeded eed e d e fd Z e ddd dedeedeed e d e f dZ e d efdZy)BigdlLLMzWrapper around the BigdlLLM model Example: .. code-block:: python from langchain_community.llms import BigdlLLM llm = BigdlLLM.from_model_id(model_id="THUDM/chatglm-6b") NT) tokenizer_id load_in_4bitload_in_low_bitmodel_id model_kwargsr r r kwargsreturnc >tjd ddlm}m}ddlm} m} |tjd|s td|xsi} |xs|} | j| fi| } |j|fdd i| }d | vr)| jDcic]\}}|d k7s ||} }}|d ||| | d |S#t$r tdwxYw#t$r| j| fi| } YwxYw#t$r|j|fdd i| }YwxYwcc}}w) a5 Construct object from model_id Args: model_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder. tokenizer_id: Path for the huggingface repo id to be downloaded or the huggingface checkpoint folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. 4BigdlLLM was deprecated. Please use IpexLLM instead.r AutoModelAutoModelForCausalLM AutoTokenizerLlamaTokenizerpCould not import bigdl-llm or transformers. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.z`load_in_low_bit` option is not supported in BigdlLLM and is ignored. For more data types support with `load_in_low_bit`, use IpexLLM instead.zBigdlLLM only supports loading in 4-bit mode, i.e. load_in_4bit = True. Please install it with `pip install --pre --upgrade bigdl-llm[all]`.r Ttrust_remote_coder model tokenizerr ) loggerwarningbigdl.llm.transformersrr transformersrr ImportError ValueErrorfrom_pretrained Exceptionitems)clsr r r r r rrrrr _model_kwargs _tokenizer_idrrkvs a/var/www/html/test/engine/venv/lib/python3.12/site-packages/langchain_community/llms/bigdl_llm.py from_model_idzBigdlLLM.from_model_ids2 MN   C  & NN(  W  %* $0  W5 55mU}UI 8(88'+/<E - /!.!4!4!6A!?R:R1M &     U W  2 W666}V VI W -I--'+/<E  s;B;C,C5 D&D;CC21C25DD)r c tjd ddlm}m}ddlm}m}|xsi} |xs|} |j| fi| } |j|fi| } d| vr)| jD cic]\} }| dk7s | |} } }|d|| | | d|S#t$r tdwxYw#t$r|j| fi| } YwxYw#t$r|j|fi| } YwxYwcc}} w) a Construct low_bit object from model_id Args: model_id: Path for the bigdl-llm transformers low-bit model folder. tokenizer_id: Path for the huggingface repo id or local model folder which contains the tokenizer. model_kwargs: Keyword arguments to pass to the model and tokenizer. kwargs: Extra arguments to pass to the model and tokenizer. Returns: An object of BigdlLLM. rrrrrrrr) rrr rrr!rrr"r$r% load_low_bitr&)r'r r r rrrrrr(r)rrr*r+s r,from_model_id_low_bitzBigdlLLM.from_model_id_low_bitisS0 MN   C%* $0  W5 55mU}UI F5(55hP-PE - /!.!4!4!6A!?R:R1M &     1 W   W666}V VI W  F*I**8E}EE Fs:BB-C2 C1C1B*-C  C C.-C.cy)Nz bigdl-llmr)selfs r, _llm_typezBigdlLLM._llm_types)N)__name__ __module__ __qualname____doc__ classmethodstrrdictboolrrr-r0propertyr3rr4r,rr s(,Q '+!)-Q Q tnQ sm Q  Q "#Q Q  Q Q f(,> '+ > > tn> sm >  >  > > @3r4r) loggingtypingrr#langchain_core.language_models.llmsr!langchain_community.llms.ipex_llmr getLoggerr5rrrr4r,rCs1 35   8 $awar4