i dZddlmZmZddlmZddlmZddlm Z ddl m Z de de fd Zde d edefd Z dde d e deedee deeeff dZy )zx Azure AI cost calculation helper. Handles Azure AI Foundry Model Router flat cost and other Azure AI specific pricing. )OptionalTuple)verbose_logger)generic_cost_per_token)Usage)get_model_infomodelreturncD|j}d|vxs d|vxs|dk(S)a< Check if the model is Azure AI Foundry Model Router. Detects patterns like: - "azure-model-router" - "model-router" - "model_router/" - "model-router/" Args: model: The model name Returns: bool: True if this is a model router model z model-router model_routerzazure-model-router)lower)r model_lowers v/Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/llms/azure_ai/cost_calculator.py_is_azure_model_routerrs7 ++-K+% / [ ( / . . prompt_tokenscnt|sytdd}|jdd}|dkDr||zSy)a  Calculate the flat cost for Azure AI Foundry Model Router. Args: model: The model name (should be a model router model) prompt_tokens: Number of prompt tokens Returns: float: The flat cost in USD, or 0.0 if not applicable r azure_ai)r custom_llm_providerinput_cost_per_tokenr)rrget)r r model_inforouter_flat_cost_per_tokens r&calculate_azure_model_router_flat_costr&sF "% ( n*UJ!+0F!J!A%999 rNusageresponse_time_ms request_modelc d}d}t|xs|duxr t|} t||d\}}|r^|r|n|}t ||j } | dkDr=tjd| d d |j d | |j z d d || z }||fS#t$r1}t|stjd|d|Yd}~d}~wwxYw)aJ Calculate the cost per token for Azure AI models. For Azure AI Foundry Model Router: - Adds a flat cost of $0.14 per million input tokens (from model_prices_and_context_window.json) - Plus the cost of the actual model used (handled by generic_cost_per_token) Args: model: str, the model name without provider prefix (from response) usage: LiteLLM Usage block response_time_ms: Optional response time in milliseconds request_model: Optional[str], the original request model name (to detect router usage) Returns: Tuple[float, float] - prompt_cost_in_usd, completion_cost_in_usd Raises: ValueError: If the model is not found in the cost map and cost cannot be calculated (except for Model Router models where we return just the routing flat cost) rNr)r rrzAzure AI Model Router: model 'z>' not in cost map, calculating routing flat cost only. Error: rz"Azure AI Model Router flat cost: $z.6fz (u tokens × $z.9fz/token))rr Exceptionrdebugrr) r rrr prompt_costcompletion_costis_router_requesterouter_model_for_calcrouter_flat_costs rcost_per_tokenr(?s(4KO/u5T!K&<]&K  '= *( $ _$1> EA !5#6#6  a   45Ec4JK''( 5EH[H[5[\_4``gi  + +K  '';   &e, ,UG3qrsqt u    sB C"'CC)rN)__doc__typingrrlitellm._loggingr.litellm.litellm_core_utils.llm_cost_calc.utilsrlitellm.types.utilsr litellm.utilsrstrboolrintfloatrr(rrr4s #+Q%(#$0#ce8),#' H( H( H(uoH(C= H(  5%< H(r