jA;ddlZddlmZmZmZmZmZmZmZm Z m Z ddl m Z ddl Z ddlmZddlmZddlmZmZmZmZddlmZddlmZmZmZGd d ZGd d Zy) N) AnyDictListOptionalTypeUnioncastget_type_hintsoverload) BaseModel)verbose_logger)BaseResponsesAPIConfig)ResponseAPIUsage!ResponsesAPIOptionalRequestParamsResponsesAPIResponse ResponseText)DecodedResponseId)PromptTokensDetails SpecialEnumsUsagecxeZdZdZedeeededee deedef dZ e d!ded e d e d eeed ef d Z edeeefd e fdZee d!dedeedeeeefd efdZee d!deeefdeedeeeefd eeeffdZe d!deeeeeffdeedeeeefd eeeeefffdZedeedeeded efdZeded efdZedeed eefdZeded efdZe d!deeedefdedd edfd Zy)"ResponsesAPIRequestUtilsz2Helper utils for constructing ResponseAPI requestssupported_paramsnon_default_params drop_paramscustom_llm_providermodelc |yi}|jD]}||vs||||<|r9tjdus||durytjd|d|d|dy)NTiz does not support parameters: z , for model=zf. To drop these, set `litellm.drop_params=True` or for proxy: `litellm_settings: drop_params: true` ) status_codemessage)keyslitellmrUnsupportedParamsError)rrrrrunsupported_paramsks p/Users/manta/Documents/Projects/TheRoad-I1/backend/.venv/lib/python3.12/site-packages/litellm/responses/utils.py_check_valid_argz)ResponsesAPIRequestUtils._check_valid_arg s  # #((*A(((:1(="1%+ ""d*'K4,?44 #233QRdQeeqrwqxycd Nresponses_api_provider_configresponse_api_optional_paramsallowed_openai_paramsreturnc(ddlm}|j|}tt|}t j ||xsgz|tj|j||j||tj}||||xsg}|S)aS Get optional parameters for the responses API. Args: params: Dictionary of all parameters model: The model name responses_api_provider_config: The provider configuration for responses API Returns: A dictionary of supported parameters for the responses API r)_apply_openai_param_overrides)rrrrr)r*rr)optional_paramsrr+) litellm.utilsr.get_supported_openai_paramsr rrr'r"rrmap_openai_params)rr)r*r+r.rr mapped_paramss r&!get_optional_params_responses_apiz:ResponsesAPIRequestUtils.get_optional_params_responses_api9s$ @9TT  "$(DE 11-1F1L"M1++ = Q Q 2 6GG)E++H 6)1"7"=2 r(paramsc ddlm}ttj }|j dd}|j di}|j dd}|j |||||Dcic]}|dc}dg}d |vrtj|d }||d <d |vr+dd lm } | |d } | | |d <n|j d dtt|Scc}w) a Filter parameters to only include those defined in ResponsesAPIOptionalRequestParams. Args: params: Dictionary of parameters to filter Returns: ResponsesAPIOptionalRequestParams instance with only the valid parameters r)PreProcessNonDefaultParamsrNkwargsadditional_drop_paramsinput) passed_paramsspecial_paramsrr9default_param_values#additional_endpoint_specific_paramsprevious_response_idmetadata)add_openai_metadata) r0r7r rr!pop#base_pre_process_non_default_paramsrEHb1!',Dd!K & J J$-$7'=7A%Bz!agz%B5>$' 0$7 #4 ('**  .NN 3#O ,d 3+5 "4 (&%)3 " %%%r(rUrVcttjjj |||}t j |jdjd}d|S)z#Build the responses_api_response_idutf-8resp_) strr%LITELLM_MANAGED_RESPONSE_COMPLETE_STRvalueformatbase64 b64encodeencodedecode)rrUrV assembled_idbase64_encoded_ids r&rZz9ResponsesAPIRequestUtils._build_responses_api_response_idsl  > > D D &$h < "(!1!1,2E2Eg2N!O!V!V " ()**r(c" |jdd}tj|jdj d}d|vrt dd|S|j d}d}d}t|dk\rF|d}|d }|d }|jd d}|jd d}|jd d} n|} t ||| S#t$r3} tjd|d| t dd|cYd} ~ Sd} ~ wwxYw)z Decode the responses_api_response_id Returns: DecodedResponseId: Structured tuple with custom_llm_provider, model_id, and response_id r^r];N)rrUrVrzlitellm:custom_llm_provider:z model_id:z response_id:zError decoding response_id 'z': ) replacerc b64decodererfrsplitlen Exceptionr debug) rV cleaned_id decoded_idpartsrrUcustom_llm_provider_part model_id_part response_partdecoded_response_ides r&!_decode_responses_api_response_idz:ResponsesAPIRequestUtils._decode_responses_api_response_idsE- $,,Wb9J))**;*;G*DELLWUJ*$((,! + $$S)E#' HE a+08( %a %a &>&F&F2B'#)00bA&3&;&;NB&O#&1#$$7!/     #? }CPQs!S T$$('  s%ACA8C D(D D Dc\|ytj|}|jdxsdS)z%Get the model_id from the response_idNrUrr}rW)rVr{s r&get_model_id_from_response_idz6ResponsesAPIRequestUtils.get_model_id_from_response_ids8   $ F F{ S #&&z2:d:r(r?cPtj|}|jd|S)aS Decode the previous_response_id to the original previous_response_id Why? - LiteLLM encodes the `custom_llm_provider` and `model_id` into the `previous_response_id` this helps with maintaining session consistency when load balancing multiple deployments of the same model. - We cannot send the litellm encoded b64 to the upstream llm api, hence we decode it to the original `previous_response_id` Args: previous_response_id: The previous_response_id to decode Returns: The original previous_response_id rVr)r?r{s r&rDzUResponsesAPIRequestUtils.decode_previous_response_id_to_original_previous_response_id's0$ % F F$   #&&}6JKKr( text_formatr textrcn|2|0ddlm}||}| d|d|dd|dd|ddd i}|S|S) at Convert text_format parameter to text parameter for the responses API. Args: text_format: Pydantic model class or dict to convert to response format text: Existing text parameter (if provided, text_format is ignored) Returns: ResponseText object with the converted format, or None if conversion fails r)type_to_response_format_paramrbtype json_schemanameschemastrict)rrrr) litellm.llms.base_llm.base_utilsr)rrrresponse_formats r&!convert_text_format_to_text_paramz:ResponsesAPIRequestUtils.convert_text_format_to_text_param?so  "t| Vv F"1-"@"J"1-"@"J   r(rL)__name__ __module__ __qualname____doc__ staticmethodrrr_rboolr'rrr4rrHr rrOrrZrr}rrDrrYrrMr(r&rrs<"49- d^&c]   0 6: 11'=1'H1 (S 2 1  11f.KS#X.K *.K.Kb6: 4 %c] #4S>2     6: $S#X %c] #4S>2  c3h   6:& %&:DcN&J K&%c]&#4S>2& #T#s(^3 4 &&B +%c] +3- + + + +66 66p;8C=;Xc];;L!L LL.*.eD$5t$;<=~& . !r(rcZeZdZedeeefdefdZede eeefde fdZ y)ResponseAPILoggingUtilsusager,c8t|tryd|vrd|vryy)z1returns True if usage is from OpenAI Response APIT input_tokens output_tokensF)rXr)rs r&_is_response_api_usagez.ResponseAPILoggingUtils._is_response_api_usagecs' e- . U "%'?r( usage_inputc|tdddSt|tr tdi|n|}|jxsd}|j xsd}d}|j r5t|j j|j j}t||||z|}t|dr#|jt|d|j|S)z7Tranforms the ResponseAPIUsage object to a Usage objectNr) prompt_tokenscompletion_tokens total_tokens) cached_tokens audio_tokens)rrrprompt_tokens_detailscostrM) rrXrYrrrinput_tokens_detailsrrrhasattrrsetattr)rresponse_api_usagerrr chat_usages r&+_transform_response_api_usage_to_chat_usagezCResponseAPILoggingUtils._transform_response_api_usage_to_chat_usagels  "# +t,  +{ +  0<<A !3!A!A!FQ?C  2 2$70EESS/DDQQ% !'/&)::"7   %v .3E3J3J3V J(:(?(? @r(N) rrrrrrYrrrrrrrMr(r&rrbsaeD2B,B&C"eD*:$:;<" ""r(r)rctypingrrrrrrr r r pydanticr r"litellm._loggingr .litellm.llms.base_llm.responses.transformationrlitellm.types.llms.openairrrrlitellm.types.responses.mainrlitellm.types.utilsrrrrrrMr(r&rsQ    +Q ;HHBBJ --r(