jO)ddlZddlmZddlmZmZmZmZmZm Z m Z m Z ddl m Z ddlmZddlZddlZddlmZddlmZmZddlmZdd lmZdd lmZmZmZmZdd lm Z!dd l"m Z#dd l$m%Z%dd l&m Z'dd l(m Z)dd l*m Z+dd l,m Z-dd l.m Z/dd l0m Z1dd l2m3Z4dd l2m Z5dd l6m Z7ddl8m9Z9ddl:m;Z<dd l:m Z=ddl:m>Z?dd l@m ZAddlBmCZCddlDmEZEmFZFmGZGmHZHmIZImJZJmKZKmLZLddlMmNZNmOZOddlPmQZQmRZRmSZSmTZTmUZUmVZVmWZWmXZXmYZYmZZZddl[m\Z\m]Z]m^Z^m_Z_m`Z`maZambZbmcZcmdZdmeZeerddlfmgZhneZh dideideideeidee]deeidee eieiff dZj djd ekdeldeldeeid!eekd"eeld#eeld$eeld%eeldee]deeid&eeld'eeYd(eeNd)eQd*eid+eekd,eede eieiff&d-Z dkd.emfd/Znd0edeofd1Zp dld eekd!eekdeekfd2Zq dmd eekd.eed3eekd4eeod!eekd5eekdeekfd6Zree7d ekdeofd8Zsd.edeeYfd9Ztd:Zud)eeQd.edeeQfd;Zvdeehd?eid@eidAeidBeidCeeidDeeidEeeiddfdFZxdddgddddddddddddddddddfd eekdGedHeeid)eeQdIeekdJeekdKeeldee]deeidLeemd4eeod3eekdMeeVdNeekd5eekd>eehd+eekdeif$dOZydPe emefdeeifdQZz dodRe e`e^e_ecebeEeOeLeReGe e%f d ekd!eekd)edSdLemdTeeod3eekd4eeodUekdMeeVdNeekd5eekd>eehd+eekdeifdVZ{ dld ekd!eekd,eede eieiffdWZ|d eekd!ekd,eZde eieiffdXZ} dld ekd!eekdYeeNde eieiffdZZ~d ekd!eekd[eide eieiffd\Z dpd ekd!eekdJeekdKeeldIeekdLeemdeifd]Z dld ekd^eid!eekdeifd_Z dld`eYd ekd!eekde eieiffdaZGdbdcZGdddeeZdfeHdgeYd!ekdNekdeif dhZy)qN) lru_cache) TYPE_CHECKINGAnyListLiteralOptionalTupleUnioncast)Response) BaseModel)verbose_logger)DEFAULT_MAX_LRU_CACHE_SIZE&DEFAULT_REPLICATE_GPU_PRICE_PER_SECOND)StandardBuiltInToolCostTracking)&TranscriptionUsageObjectTransformation)CostCalculatorUtils_generic_cost_per_charactergeneric_cost_per_tokenselect_cost_metric_for_modelcost_per_token)SearchResponse)cost_per_second)get_model_params_and_category)cost_per_character) cost_router)ResponseAPILoggingUtils)HttpxBinaryResponseContentImageGenerationRequestQualityOpenAIModerationResponseOpenAIRealtimeStreamList&OpenAIRealtimeStreamResponseBaseObject!OpenAIRealtimeStreamSessionEventsResponseAPIUsageResponsesAPIResponse)RerankBilledUnitsRerankResponse) CallTypesLiteral"LiteLLMRealtimeStreamLoggingObject LlmProvidersLlmProvidersSet ModelInfoStandardBuiltInToolsParams TranscriptionUsageDurationObjectTranscriptionUsageTokensObjectUsageVectorStoreSearchResponse) CallTypes CostPerTokenEmbeddingResponse ImageResponse ModelResponseProviderConfigManagerTextCompletionResponseTranscriptionResponse_cached_get_model_info_helper token_counter)Logging prompt_tokenscompletion_tokensresponse_time_mscustom_cost_per_tokencustom_cost_per_secondreturncV||y||d|z}|d|z}||fS| ||zdz }d|fSy)zFInternal helper function for calculating cost, if custom pricing givenNinput_cost_per_tokenoutput_cost_per_tokenr)r?r@rArBrC input_cost output_costs p/Users/manta/Documents/Projects/TheRoad-I1/backend/.venv/lib/python3.12/site-packages/litellm/cost_calculator.py%_cost_per_token_custom_pricing_helperrMqsh$)?)G(*+AB]R +,CDGXX ;&&  +,/??$F +~ modelcustom_llm_providerprompt_characterscompletion_characterscache_creation_input_tokenscache_read_input_tokensnumber_of_queries usage_objectrerank_billed_units call_type!audio_transcription_file_duration service_tierresponsec | td| | }nt||||z|| }t|||| | }| |d|dfSd}d}tj}|}||dz|z}|,|d|d|}||vr|}ntj |\}}}}|}|j dd}t|dkDr|d}n|} ||vr|}n ||vr|}n||vr|}|d k(s|d k(rtj|| }t|}d }d } |d k(r^|tdj||||t|||ddd\}!}"|!|"tdj|!|"|||||!}|"} || fS|dk(rt||||\}} || fS|dk(s|dk(rt|||S|dk(s|dk(rt||t!t"|S|dk(s|dk(rt%|||S|dk(s+|dk(s&|t&j(k(s|t&j*k(rt-|||S|dk(s|dk(r!|d k(rt/|||!St1|||"S|d#k(s|d$k(r5dd%lm}#|#||| xsd|rt7|d&r|j8'Sd'S|d(k(r7t;|||)}$|$d k(rt=|||||*S|$dk(rt?|||+Sy|d,k(r tA||-S|d.k(r tC||-S|d/k(rt/|||!S|d0k(r tE||-S|d1k(r tG||-S|d2k(rtI|||3S|d4k(r tK||-S|d5k(r tM||-S|d6k(r tO||-S|d7k(r tQ||-S|d8k(r tS||-S|d9k(rdd:l*m+}%|%||-StY|| }&|&d;dkDr |&d;|z}nG|&j[dz }|&d?dkDr |&d?|z}nG|&j[d@d5|3t]j^dA||&j[d@d||&d@|zd>z }t]j^dB|||||fS)Car Calculates the cost per token for a given model, prompt tokens, and completion tokens. Parameters: model (str): The name of the model to use. Default is "" prompt_tokens (int): The number of tokens in the prompt. completion_tokens (int): The number of tokens in the completion. response_time (float): The amount of time, in milliseconds, it took the call to complete. prompt_characters (float): The number of characters in the prompt. Used for vertex ai cost calculation. completion_characters (float): The number of characters in the completion response. Used for vertex ai cost calculation. custom_llm_provider (str): The llm provider to whom the call was made (see init.py for full list) custom_cost_per_token: Optional[CostPerToken]: the cost per input + output token for the llm api call. custom_cost_per_second: Optional[float]: the cost per second for the llm api call. call_type: Optional[str]: the call type Returns: tuple: A tuple containing the cost in USD dollars for prompt tokens and completion tokens, respectively. Nz"Invalid arg. Model cannot be none.)r?r@ total_tokensrTrU)r?r@rArCrBr/rPspeechaspeechrPrQr>rzvprompt_characters must be provided for tts calls. prompt_characters={}, model={}, custom_llm_provider={}, call_type={})rPrQrRrScustom_prompt_costcustom_completion_costzcost for tts call is None. prompt_cost={}, completion_cost={}, model={}, custom_llm_provider={}, prompt_characters={}, completion_characters={}r)rPusagerQr[arerankrerank)rPrQ billed_unitsavector_store_searchvector_store_search)rPrQr\ocraocraretrieve_batchretrieve_batch)rgrPrQatranscription transcriptionzgpt-4o-mini-transcribe)rPrgr[rPrQdurationsearchasearch)search_provider_cost_per_query_hidden_params)rPrQrVoptional_params vertex_ai)rPrQrY)rPrQrRrSrg)rPrQrg anthropic)rPrgbedrockopenai databricks fireworks_aiazure)rPrgrAgeminideepseek perplexityxailemonade dashscoperrFinput_cost_per_secondz;For model=%s - input_cost_per_second: %s; response time: %srHrGoutput_cost_per_secondz +/.@&D#'.'?'?e'L$ 1 ++c1%K ;!*1~$ ~-# . .$H Y 6#22&  e yF2 3  && ( (  11 1  00 0$U@S   & &)*F , ,(!)  *$7:  h )y"8A- 3/412B C''      +(& 3 . .,*$7"3&;!  , ,(*$7! -  +'e;GG  )%EEE  (${    ,(uKHH  .*kJJ  '*{=M    ($5 DD  *&U+FF  ,(uKHH  %![AA  *&U+FF  + (e;GG2-@  , - 112]B * NN2D 9 E ,  M6=  236FFM * - . 2236GG . NN3T : F ,  N7>  347GG$N .  z  ) -  -.OOOrNcompletion_responsect}|dk(rH|jdtj}t|dtj}||z }||zdz S)Nr>createdendedrH)rrtimegetattr)r total_time!a100_80gb_price_per_second_public start_timeend_times rL get_replicate_completion_pricingrsZ)O%S(,,Y D .E * ,z 9D @@rNobjct|dS)Nrx)r)rs rLhas_hidden_paramsrs 3( ))rNc||S|y tj|\}}}}|S#t$r+}tjdt |Yd}~yd}~wwxYw)Nrazblitellm.cost_calculator.py::_get_provider_for_cost_calc() - Error inferring custom_llm_provider - )rrrrrstr)rPrQres rL_get_provider_for_cost_calcrsv&"" }'.'?'?e'L$ 1  pqtuvqwpx y  s& A!AA base_modelcustom_pricingrouter_model_idc0d}d}t||}d}|@t|trt|dd}n"t|tr|j dd}t|dd} |dur||t jvr|}nh|}ne||}n`|8| 6| j ddJt| ddkDr9| j d|}n&| $| j dd| j dd}|||}|||}|"| t|s| |d|d|}|S|d|}|S) z 1. If custom pricing is true, return received model name 2. If base_model is set (e.g. for azure models), return that 3. If completion response has model set return that 4. Check if model is passed in return that NrdrPrxTrrr`) r isinstancer rdictrrrr"_model_contains_known_llm_provider) rPrrrrQr return_modelrcompletion_response_model hidden_paramss rL _select_model_name_for_cost_calcrs#'L!%K5)<04& )9 5(/0CWd(S % +T 2(;(?(?(N %$+,?AQSW$XM  &?g>P>P+P*L L  ! " *}/H   gt , 8M'*+a/(,,WeBL rN)maxsizec:|jdd}|tvS)z: Check if the model contains a known llm provider r`r)rr,)rP_provider_prefixs rLrr2s# {{3'*  ..rNc tttttt ft |tr|jdnt|ddd}|yt |tr|S|Jt |tst |tr*tj|rtj|Stj|r0tjtttt f|St |tr tdi|St |t rtdi|j#St%j&dt)|d|y)NrgrcyNrI)xs rLz#_get_usage_object..CstrNzUnknown usage object type: z , usage_obj: rI)r r r1r%rr rrrr_is_response_api_usage+_transform_response_api_usage_to_chat_usageris_transcription_usage_object$transform_transcription_usage_objectr/r0 model_dumprrtype)r usage_objs rL_get_usage_objectr;sS e%tY67-t4 # #G ,D,e^DWM I)U#  4 (JyBR,S # : :9 E&RR    0 M M  3 W W8:XX    It $!y!! Iy ).y++-..)$y/):- { S rNct|tjxs't|txst j |S)z3Returns True if the usage obj is a known Usage type)rrr1r%rrrs rL_is_known_usage_objectsrks= 9gmm, i!1 2 1 O O  rNc||S|yt|tryt|tryt|tryt|tryt|t ryt|t ryt|try|S)N completion embeddingrrrbriimage_generationtext_completion)rr7r5r:rr(r6r9)rYrs rL_infer_call_typervs"%}5 '): ; ')> ? ')C D ' 8 ' 7! ')? @ rN base_costc |}d}d}|r_|tjvrMtj|}||z}||z }tjd|dzd|d|dd|dd|dd |||fS|||fS) a Apply provider-specific cost discount from module-level config. Args: base_cost: The base cost before discount custom_llm_provider: The LLM provider name Returns: Tuple of (final_cost, discount_percent, discount_amount) r>zApplied dz% discount to z: $z.6fz -> $z (saved $))rcost_discount_configrr)rrQ original_costdiscount_percentdiscount_amount final_costs rL_apply_cost_discountrsMO2g6R6RR"778KL'*::"_4 '+,N;N:OPc"% 3'7yQT@UUV X +_<< & 77rNlitellm_logging_objrr'cost_for_built_in_tools_cost_usd_dollartotal_cost_usd_dollarrrrc |y |j|||||||y#t$r+}tjdt |Yd}~yd}~wwxYw)aX Helper function to store cost breakdown in the logging object. Args: litellm_logging_obj: The logging object to store breakdown in prompt_tokens_cost_usd_dollar: Cost of input tokens completion_tokens_cost_usd_dollar: Cost of completion tokens (includes reasoning if applicable) cost_for_built_in_tools_cost_usd_dollar: Cost of built-in tools total_cost_usd_dollar: Total cost of request original_cost: Cost before discount discount_percent: Discount percentage applied (0.05 = 5%) discount_amount: Discount amount in USD N)rJrK total_costrrrrzError storing cost breakdown: )set_cost_breakdownrrrr) rrrrrrrrbreakdown_errors rL$_store_cost_breakdown_in_logging_objrsk." ..49,4['-+ /   =c/>R=STU  s A!A  Amessagesrsizequalitynrystandard_built_in_tools_paramslitellm_model_namec  t||xsd}|dk(s|dk(r'|%t|trt|dk(r|dk(rd}d}d}d}d}d}d}d}t | }d}|||j d }t |||||| }|g} || j|t| D]\}!} tjd ||t|tst|trt|tr|j d i}"n t|d i}"t|"tr:t|"s.t|d t!j"dFi|"j%|"i}#n#t|"tr|"j%}#n|"}#t'j(|#r$t'j*|#j%}#nZt-j.|#rCt-j0t3t4t6t8f|#}$|$|$j%}#n|#}#|#j dd}|#j dd}|#j dd}|#j dd}d|#vr1|#dik7r)|#dr$|#j di}%|%j dd}t|dd}t|dd}&|&|&j d|xsd}|&j d|}nW|t;d|d|t|dkDrt=||}nt|dkDr t=||}t=||}|t;d|d|| t!j>|\}}}'}'tEjF|r/t|tHrtEjJ|||| | | ||cS|tLjNjPk(sW|tLjRjPk(s:|tLjTjPk(s|tLjVjPk(rft|d d}"|G|"rEt|"tr|"j d d})n t|"d d})|)dd!l,m-}*|*||)|"cSt]|d|"cS|tLj^jPk(s|tLj`jPk(r"t jbje|#}n|tLjfjPk(s|tLjhjPk(rt|d$d}nV|tLjjjPk(s|tLjljPk(r~|t|tnr|jp}+|+|+j d%ixsi},ni},ts|,j d&|,j d'(}|,j d&xsd)}-|-}n|tLjtjPk(rJt|tvr:||t;d*jC||ty|jz|||+cS|tLj|jPk(rdd,l?m@}.|.j|-cSd.|vs d/|vs|d/k(rt|tM|0}n6|t jvsd1|vr |t jvrt||cS|t;d|d|||d2k(rt|dkDrCt jbjd3|id4}/t jbje|/#}|Pt|tr@t jbj|5}0t jbje|0#}tdFid6|d|d|d|d7|d|d8| d9| d:|d;|d|d|d<|d=t3t|d>|d?|d |d@|\}1}2|1|2z}3tj|||||A}4|3|4z }3|3}5t|3|B\}3}6}7t||1|2|4|3|5|6|7C|3cStAdEjC| #t@$r8}(tjdjCt|(Yd}(~(%d}(~(wwxYw#t@$rL}(tjdDjC|t|(|!t| d)z k(r|(Yd}(~(@d}(~(wwxYw#t@$r}(|(d}(~(wwxYw)Ga Calculate the cost of a given completion call fot GPT-3.5-turbo, llama2, any litellm supported llm. Parameters: completion_response (litellm.ModelResponses): [Required] The response received from a LiteLLM completion request. [OPTIONAL PARAMS] model (str): Optional. The name of the language model used in the completion calls prompt (str): Optional. The input prompt passed to the llm completion (str): Optional. The output completion text from the llm total_time (float, int): Optional. (Only used for Replicate LLMs) The total time used for the request in seconds custom_cost_per_token: Optional[CostPerToken]: the cost per input + output token for the llm api call. custom_cost_per_second: Optional[float]: the cost per second for the llm api call. Returns: float: The cost in USD dollars for the completion based on the provided parameters. Exceptions: Raises exception if model not in the litellm model cost map. Register model, via custom pricing or PR - https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.json Note: - If completion_response is provided, the function extracts token information and the model name from it. - If completion_response is not provided, the function calculates token counts based on the model and input text. - The cost is calculated based on the model, prompt tokens, and completion tokens. - For certain models containing "togethercomputer" in the name, prices are based on the model size. - For un-mapped Replicate models, the cost is calculated based on the total time used for the request. raimage_generationrNrrzdall-e-2r>)rr[)rPrrQrrrz*selected model name for cost calculation: rgrr?r@rTrUprompt_tokens_details cached_tokens _response_msrxrQrz[Model is None and does not exist in passed completion_response. Passed completion_response=z, model=)rPr)rPtextrazXlitellm.cost_calculator.py::completion_cost() - Error inferring custom_llm_provider - {})rPrQrrrrryrYduration_seconds)video_generation_cost)rPrrQ)rrtrj search_unitsr^)rr^r_zusage object and custom_llm_provider must be provided for realtime stream cost calculation. Got cost_per_token_usage_object={}, custom_llm_provider={})resultscombined_usage_objectrQr )MCPCostCalculator)rtogethercomputer together_ai)rY replicaterzr)datarY) response_objrPrArCrBrRrSrWrYrZrXr\)rPresponse_objectrgr rQ)rrQ)rrrrrrrrzXlitellm.cost_calculator.py::completion_cost() - Error calculating cost for model={} - {}z?Unable to calculat cost for received potential model names - {}rI)Orrrrrrrappend enumeraterrr rrrsetattrrr1rrrrrrrr r r/r0rr<rrrr_call_type_has_image_responser6&route_image_generation_cost_calculatorr3 create_videovalue acreate_video video_remix avideo_remix$litellm.llms.openai.cost_calculationrdefault_video_cost_calculatorrbrcutils_count_charactersrqrrrirhr(metar' arealtimer*'handle_realtime_stream_cost_calculationr call_mcp_tool6litellm.proxy._experimental.mcp_server.cost_calculatorrcalculate_mcp_tool_call_costrreplicate_modelsrrget_formatted_promptr7get_response_stringrr)rget_cost_for_built_in_toolsrr)8rrPpromptrrrrYrQrrrrrBrCryrrr r rrr[r?rRr@rSrTrUrZcost_per_token_usage_objectrXselected_modelpotential_model_namesidxr_usagetr_usager rrrrrmeta_objrjrr prompt_stringcompletion_stringrr _final_costcost_for_built_in_toolsrrrs8 rLrrs pu$Y0CDT - ->P1P!5#&E a#w.E +//359#1536)7H 38 #<@  O$?*..~>L9 3 3)!+  "0 0   ! ( ( /#$9:JCD $$@H'22I>!"5t<!"5t</33GR@"%,,?"$M !)Y7@W"+A /##MMCI,@,@,BC !(!##Iy9!*!5!5!7!*.EEfM!8!d!d""$*,@]]$J#n#n %$D$B%D!"!' $$/%-%8%8%:F!'%+JJ$BM(. 3F(J%28**5q3//5jj9RTU.V+/69"#:;rA"#:;06 ;RTV0W-2G2K2K+Q3/")) - 5(;2O6W7c99c>rct|tr|j}n|}|jdi}|rd|vr|d}|yt |dSy)Nadditional_headersz$llm_provider-x-litellm-response-cost)rr rrfloat)r_hidden_params_dictrBrs rL$get_response_cost_from_hidden_paramsrEsl-++668+,001ErJ 26H H*+QR  '(NOPP rNr)r aembeddingr acompletionatext_completionrrr  moderation amoderationrqrrrcrbrirhrurv cache_hitr5c d}||durd}|St|tr4||jd<t|drt |j}||St ||||||||| | | | |  }|S#t $r}|d}~wwxYw)z7 Returns - float or None: cost of response r>NTryrx) rrPrYrQryrrr5r r rrr[)rr rxrrErr)rrPrQrYryrKrrr5r r rrr[rprovider_response_costrs rLresponse_cost_calculatorrNsj "  Y$%6M63/95DS../@A?,<=-Q'66.*.955+$3#$7 /-%/M#5 /$7)M s# A,AA,A,, A<5A77A<cbddlm}| t||stdt ||j td|j j }| td tj||}d}||jd xsd}||z}|dfS#t$rd}Y/wxYw) aJ Args: model: str - model name custom_llm_provider: Optional[str] - custom LLM provider response: Optional[Any] - response object Returns: Tuple[float, float]: cost of OCR processing (Parent function requires a tuple, so we return a tuple. Cost is only in the first element.) r) OCRResponseNz.response must be of type OCRResponse got type=zOCR response usage_info is Nonez$OCR response pages_processed is Nonerdr>ocr_cost_per_page) (litellm.llms.base_llm.ocr.transformationrPrrr usage_infopages_processedrrrr)rPrQr\rPrTrrQtotal_ocr_processing_costs rLrrs E z(K@?F3'8?'J $c ))  s'B B.-B.cd}|d}|d|vrtj|\}}}}tjt ||}|t j d|y|j|S) zB Returns - float or None: cost of vector store search Nr}r`ra)providerapi_typez)Vector store search is not supported for r>r>)r\)rrr8!get_provider_vector_stores_configr+rrcalculate_vector_store_cost)rPrQr\rXrconfigs rLrr*s#H"& SE\.5.F.F/ +%q!# D D12F ~78K7L M   - - . rNrjc"tj||\}}}} tj|dgt |} tj ||}|j||||S#t $rd}Y"wxYw#t $r}|d}~wwxYw)zI Returns - float or None: cost of response OR none if error. rdN)rPapi_basepresent_version_paramsrW)rPrQrjr)rrr8get_provider_rerank_configr+rrcalculate_rerank_cost)rPrQrjrr\rrs rLrrLs$+#;#;)<$ AAq&AA#%!"56   .5.D.D1D/J ++ 3%! ,   J  s;"A>A-A>- A;8A>:A;;A>> BB  Brtct|||S)Nrs)rrss rLtranscription_costrcrs ")&?r/ARS!)z5;;s+;B+?*@A187)1+,->T( !%I"+ .,O"  &G,>,>">**62I ":?:K L   + ,v 5 = AArNrcL|}d}|r0|j|dr|j|dd}|d|}tjd||j dd}d}||||g}|D],}||t j vst j |}n|.|r,|d|} | t j vrt j | }|td||jd} | | |zS|jd} | | |zStjd |d y ) a~ Default video cost calculator for video generation Args: model (str): Model name duration_seconds (float): Duration of the generated video in seconds custom_llm_provider (Optional[str]): Custom LLM provider Returns: float: Cost in USD for the video generation Raises: Exception: If model pricing not found in cost map Nr`rOz!Looking up cost for video model: rfrg output_cost_per_video_per_secondrz*No cost information found for video model z<. Please add pricing to model_prices_and_context_window.jsonr>) rlrirrrrrrrinfo) rPrrQrqrrrurwrxryprefixed_modelvideo_cost_per_secondrs rLr(r(s(O<@*u//3F2Gq0IJ16"#1 %r2 .##1%K$L M <_,>">**62I " 0/0%9 W// /**>:I:?:K L  &MM*LM($'777']]+CD)%(888 4UG;wx rNrgctj||\}}}}tjd|| tj||}|sy|j d}|j d}|j d}|j d}d } d } |r|j|z} n|r|j|zd z } |r|j|z} | | fS|r|j|zd z } | | fS#t $rd}YwxYw) z+ Calculate the cost of a batch job rdzBCalculating batch cost per token. model=%s, custom_llm_provider=%sNrYinput_cost_per_token_batchesrFoutput_cost_per_token_batchesrGr>) rrrrrrrr?r@) rgrPrQrrrrFrrGtotal_prompt_costtotal_completion_costs rLrrsD$+#;#;)<$ AAqL  *1*@*@-@+ #->>2P#Q %>>*@A$.NN3R$S!&NN+BC#!//2NN    #7 81 < % % 7 7:W W 3 33   # #'< = A  3 333  sC** C87C8c,eZdZedeedefdZy)BaseTokenUsageProcessor usage_objectsrDcPddlm}m}m}|}|D]}t |D]}|j drt t||r+t||d}t||d}|Ht|ttfs_t|ttfsvt||||zt|dr|jrt|dr |js ||_ t|jjD]}t|j|s|j dr,t t|j|rLt|j|dxsd}t|j|dxsd}|t|ttfst|j|||zt|ds|j st|dr |j s ||_t|j jD]}|j drt t|j |r5t|j |d}t|j |d}|f|it|j |||z|S)zs Combine multiple Usage objects into a single Usage object, checking model keys for nested values. r)CompletionTokensDetailsWrapperPromptTokensDetailsWrapperr1rr completion_tokens_details)litellm.types.utilsrrr1dirrlcallablerrrkrCrrr r model_fieldsr) rrrr1combinedrgattr current_valnew_vals rLcombine_usage_objectsz-BaseTokenUsageProcessor.combine_usage_objectsNsb   7#EE s+HWUD=Q4R")(D!" > $ +g 5K&:;33 *EF#==786 !!@!@ANND??3/ ? ?F9'.$>>a' #*%*I*I4QR"S".;3J# ( B B $ +g 5Om#LrNN)__name__ __module__ __qualname__ staticmethodrr1rrIrNrLrrMs*ST%[SUSSrNrcdeZdZededeefdZededefdZededede fdZ y)RealtimeAPITokenUsageProcessorrrDcttt|Dcgc] }|ddk(s |c}}g}|D];}tj|dj di}|j |=|Scc}w)z< Collect usage from realtime stream results rz response.doner\rg)r rr#rrrr)rresultresponse_done_eventsrrWs rL*collect_usage_from_realtime_stream_resultszIRealtimeAPITokenUsageProcessor.collect_usage_from_realtime_stream_resultssNR 7 8") O'VF^-NV' ON &( *F'SS:&**7B7    . + Ps A3 A3 cZtj|}tj|}|S)zH Collect and combine usage from realtime stream results )rrr)rcollected_usage_objectsrs rL6collect_and_combine_usage_from_realtime_stream_resultszURealtimeAPITokenUsageProcessor.collect_and_combine_usage_from_realtime_stream_resultss8 + U U  !? T T #! %$rNrgct||S)Nrgr)r*rs rLcreate_logging_realtime_objectz=RealtimeAPITokenUsageProcessor.create_logging_realtime_objects2  rNN) rrrrr"rr1rrr*rrIrNrLrrsx) e(%)% %%   7 +  rNrrrc6d}g}|D]?}|ddk(s tt|djdd}|j|A|j|d}d}|D]"} | t | ||\} } || z }|| z }n||z} | S#t $rY7wxYw)z Handles the cost calculation for realtime stream responses. Pick the 'response.done' events. Calculate total cost across all 'response.done' events. Args: results: A list of OpenAIRealtimeStreamBaseObject objects Nrzsession.createdsessionrPr>)rPrgrQ)r r$rrrr) rrrQr received_modelr8rrFrG model_name_input_cost_per_token_output_cost_per_tokenrs rLr-r-sN &>. .!"CVLc'4   " ( ( 8   !34+  !NN)rOrrr>NNNNrrNNNNNrr>NN)r>r)NNNN)NNN) NNNrONNNNN)NNr_reN)r functoolsrtypingrrrrrr r r httpxr pydanticr rlitellm._loggingrlitellm.constantsrr@litellm.litellm_core_utils.llm_cost_calc.tool_call_cost_trackingrDlitellm.litellm_core_utils.llm_cost_calc.usage_object_transformationr.litellm.litellm_core_utils.llm_cost_calc.utilsrrrr'litellm.llms.anthropic.cost_calculationrr#litellm.llms.azure.cost_calculationr+litellm.llms.base_llm.search.transformationr%litellm.llms.bedrock.cost_calculationr'litellm.llms.databricks.cost_calculatorr%litellm.llms.deepseek.cost_calculatorr)litellm.llms.fireworks_ai.cost_calculatorr#litellm.llms.gemini.cost_calculatorr%litellm.llms.lemonade.cost_calculatorrr'rrr'litellm.llms.perplexity.cost_calculatorr(litellm.llms.together_ai.cost_calculatorr&litellm.llms.vertex_ai.cost_calculatorrrrrr litellm.llms.xai.cost_calculatorrlitellm.responses.utilsrlitellm.types.llms.openairr r!r"r#r$r%r&litellm.types.rerankr'r(rr)r*r+r,r-r.r/r0r1r2 litellm.utilsr3r4r5r6r7r8r9r:r;r<*litellm.litellm_core_utils.litellm_loggingr=LitellmLoggingObjectrCrMrrkrrboolrrrrrrrrrrrErNrrrrcrzr(rrrr-rIrNrLrso  RRR" GXYSUQ;   C       (+48.2 uo $L1  %UO eE5L!"0(+)-'++/12-.48.2'+$(7;"./2"&"7@P @P@P@Puo @P "# @P }@P$C=@P"*#@P&c]@P$L1@P%UO@P" }#@P&5/'@P*""34+@P. /@P0(-1@P43-5@P6sm7@P8 5%<9@PF A$ A*3*4* *. C=!#c],!%%))-%) A C=A!#A ATN A "# A c] Ac]AH -./c/d///-- e_-`()@C 688!#8 5% 8N&*(,'+) !"67) #() (-) .3 ) ! ) E? ) uo) e_)  ) Z "%,0!48.2&*%) $KO(,%):>"&5m C=m m  m()m 3-mc]m}m $L1!m"%UO#m$d^%m&TN'm( )m*%--G$H+m,! -m.c]/m0""671m43-5m6 7m` y) e_t!% $%)KO(,%):>"&_U"*   U U "#!U" #UJKUL~MUN OUPTNQUR SUT%--G$HUUV! WUXc]YUZ""67[U^3-_U` aUv#-* -*!#-*sm-* 5%< -*` C=( 5%< J15# #!##,-# 5%< #L %-c]>C 5%<*.!'&* SB SB!#SBc]SB} SB 3- SB d^ SB SBr*.G GG"#G GZ*.04 04 04"#04 5%< 04fUUp. %<. b+ %+ ++ +  +rN