jw.dZddlZddlmZmZmZmZmZmZm Z ddl Z ddl m Z ddl mZddlmZmZmZddlmZer dd lmZeZneZGd d eZy) z Support for Snowflake REST API N) TYPE_CHECKINGAnyDictListOptionalTupleUnionget_secret_str)AllMessageValues)ChatCompletionMessageToolCallFunction ModelResponse)OpenAIGPTConfig)Loggingc6eZdZdZefdZdedeefdZde de dede de f d Z d ee ee fdeeeeeffd Z d!ded ej&d edede deede de de deedee defdZ d!de dedeede de deedeede fdZdeedeedeeeeeffdZ d"deedeedede de dee defdZdee ee fdee ee ffdZdeee ee ffdeee ee fffdZdedeede de de de f d ZxZS)#SnowflakeConfiga. Reference: https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-llm-rest-api Snowflake Cortex LLM REST API supports function calling with specific models (e.g., Claude 3.5 Sonnet). This config handles transformation between OpenAI format and Snowflake's tool_spec format. c t|SN)super get_config)cls __class__s /Users/manta/Documents/Projects/TheRoad-I1/backend/.venv/lib/python3.12/site-packages/litellm/llms/snowflake/chat/transformation.pyrzSnowflakeConfig.get_config sw!##modelreturnc gdS)N) temperature max_tokenstop_presponse_formattools tool_choice)selfrs rget_supported_openai_paramsz+SnowflakeConfig.get_supported_openai_params$s   rnon_default_paramsoptional_params drop_paramscl|j|}|jD]\}}||vs |||<|S)a If any supported_openai_params are in non_default_params, add them to optional_params, so they are used in API call Args: non_default_params (dict): Non-default parameters to filter. optional_params (dict): Optional parameters to update. model (str): Model name for parameter support check. Returns: dict: Updated optional_params with supported non-default parameters. )r(items)r'r)r*rr+supported_openai_paramsparamvalues rmap_openai_paramsz!SnowflakeConfig.map_openai_params.sG$#'"B"B5"I.446LE5//).&7r content_listcd}g}t|D]\}}|jddk(r||jddz }0|jddk(sE|jdi}t|jdddt|jddt j |jdi  }|j |||r|fSd fS) a Transform Snowflake tool calls to OpenAI format. Args: content_list: Snowflake's content_list array containing text and tool_use items Returns: Tuple of (text_content, tool_calls) Snowflake format in content_list: { "type": "tool_use", "tool_use": { "tool_use_id": "tooluse_...", "name": "get_weather", "input": {"location": "Paris"} } } OpenAI format (returned tool_calls): ChatCompletionMessageToolCall( id="tooluse_...", type="function", function=Function(name="get_weather", arguments='{"location": "Paris"}') ) typetexttool_use tool_use_idfunctionnameinput)r: arguments)idr5r9N) enumerategetr rjsondumpsappend)r'r2 text_content tool_callsidx content_item tool_use_data tool_calls r._transform_tool_calls_from_snowflake_to_openaiz>SnowflakeConfig._transform_tool_calls_from_snowflake_to_openaiFs: :< !*->w-K"L !!),"9":Z??4??r raw_responsemodel_response logging_obj request_datamessageslitellm_paramsencodingapi_key json_modec t|j} |j|d| d|id| vrXt| ddkDrG| dd} d| vr;d| dvr4| dd}|j|\}}|| dd<|r|| dd <| dd=t d i| }d |j xsdz|_|||j d <|S) Nr4complete_input_dict)r;rQoriginal_responseadditional_argschoicesrmessager2contentrDz snowflake/rr&)r@ post_calllenrIrr_hidden_params)r'rrJrKrLrMrNr*rOrPrQrR response_jsonchoicer2rCrDreturned_responses rtransform_responsez"SnowflakeConfig.transform_responseys%))+ +2LA    %#mI.F*G!*K"9-a0FF"~ 9J'J%i0@ GG U 0<y!),6@F9%l39%n5):M:".2C2I2I2OR"P  8=  , ,W 5  rheadersapi_basecR| td|jddd|zdd|S)a Return headers to use for Snowflake completion request Snowflake REST API Ref: https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-llm-rest-api#api-reference Expected headers: { "Content-Type": "application/json", "Accept": "application/json", "Authorization": "Bearer " + , "X-Snowflake-Authorization-Token-Type": "KEYPAIR_JWT" } zMissing Snowflake JWT keyzapplication/jsonzBearer KEYPAIR_JWT)z Content-TypeAccept Authorizationz$X-Snowflake-Authorization-Token-Type) ValueErrorupdate)r'rarrNr*rOrQrbs rvalidate_environmentz$SnowflakeConfig.validate_environments>. ?89 9 2,!*W!48E   rch|xsdtddxs td}|xs td}||fS)Nhttps://SNOWFLAKE_ACCOUNT_ID8.snowflakecomputing.com/api/v2/cortex/inference:completeSNOWFLAKE_API_BASE SNOWFLAKE_JWTr )r'rbrQdynamic_api_keys r$_get_openai_compatible_provider_infoz4SnowflakeConfig._get_openai_compatible_provider_infosO  4N+ABCC{~ 423  "D^O%D((rstreamc(|sdtdd}|S)zc If api_base is not provided, use the default DeepSeek /chat/completions endpoint. rkrlrmr )r'rbrQrr*rOrrs rget_complete_urlz SnowflakeConfig.get_complete_urls)#N3I$J#KLDGHrr$c g}|D]s}|jddk(s|jdi}dd|jd|jddidd i}d |vr |d |dd <|j|u|S) a Transform OpenAI tool format to Snowflake tool format. Args: tools: List of tools in OpenAI format Returns: List of tools in Snowflake format OpenAI format: { "type": "function", "function": { "name": "get_weather", "description": "...", "parameters": {...} } } Snowflake format: { "tool_spec": { "type": "generic", "name": "get_weather", "description": "...", "input_schema": {...} } } r5r9 tool_specgenericr: parametersobject)r5 properties)r5r: input_schema description)r?rB)r'r$snowflake_toolstoolr9snowflake_tools r_transform_toolsz SnowflakeConfig._transform_toolss<13Dxx:-88J3 ) ( V 4(0 (%-R@)" 2!H,AI%BN;/ > &&~6'*rr%ct|tr|St|tr=|jddk(r)|jdijd}|rd|gdS|S)a Transform OpenAI tool_choice format to Snowflake format. Args: tool_choice: Tool choice in OpenAI format (str or dict) Returns: Tool choice in Snowflake format OpenAI format: {"type": "function", "function": {"name": "get_weather"}} Snowflake format: {"type": "tool", "name": ["get_weather"]} Note: String values ("auto", "required", "none") pass through unchanged. r5r9r:r~)r5r:) isinstancestrdictr?)r'r% function_names r_transform_tool_choicez&SnowflakeConfig._transform_tool_choice"sg( k3 '  k4 (v&*4 + B ? C CF K  &!. rc|jddxsd}|jdi}|jdd}|r|j||d<|jdd} | r|j| |d<|||d||S)NrrF extra_bodyr$r%)rrNrr)poprr) r'rrNr*rOrarrrr$r%s rtransform_requestz!SnowflakeConfig.transform_requestEs'**8T:Ce$((r:  ##GT2 '+'<' -1-H-H-UOM *       r)NNr) __name__ __module__ __qualname____doc__ classmethodrrrr(rboolr1rrrrr rIhttpxResponserLiteLLMLoggingObjr r`rirqrtrr rr __classcell__)rs@rrrs$$  c       01@ c3h01@ sHT"?@AA B1@|"&$(1!1!nn1!& 1! ' 1!  1!'(1!1!1!1!#1!D>1! 1!t"&"&"""'( "  "  "#"3-" "H )   )08  ) x}hsm+ , )$"&3-#      "4d4S>&:4tDcN?S4l! d38n!45! sDcN" #!F  '(         rr)rr@typingrrrrrrr rlitellm.secret_managers.mainr litellm.types.llms.openair litellm.types.utilsr rropenai_like.chat.transformationr*litellm.litellm_core_utils.litellm_loggingr_LiteLLMLoggingObjrrr&rrrsJ III 76VV>X*I oI r