iX%VdZddlZddlmZmZmZmZddlmZddl m Z GddeZ y)z AWS Bedrock CountTokens API transformation logic. This module handles the transformation of requests from Anthropic Messages API format to AWS Bedrock's CountTokens API format and vice versa. N)AnyDictListOptional) BaseAWSLLM)get_bedrock_base_modelc ^eZdZdZdeeefdefdZdeeefdeeeffdZdeeefdeeeffdZ de ede eeeffdZ d e e eeefde eeeffd Z deeefdeeeffd Z dd edede ede edef dZdeeefdeeeffdZdeeefdd fdZy )BedrockCountTokensConfiga Configuration and transformation logic for AWS Bedrock CountTokens API. AWS Bedrock CountTokens API Specification: - Endpoint: POST /model/{modelId}/count-tokens - Input formats: 'invokeModel' or 'converse' - Response: {"inputTokens": } request_datareturnc4d|vrt|dtryy)z Detect whether to use 'converse' or 'invokeModel' input format. Args: request_data: The original request data Returns: 'converse' or 'invokeModel' messagesconverse invokeModel) isinstancelist)selfr s /Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/llms/bedrock/count_tokens/transformation.py_detect_input_typez+BedrockCountTokensConfig._detect_input_types"  %*\*5Mt*Tcr|j|}|dk(r|j|S|j|S)a Transform request to Bedrock CountTokens format. Supports both Converse and InvokeModel input types. Input (Anthropic format): { "model": "claude-3-5-sonnet", "messages": [{"role": "user", "content": "Hello!"}] } Output (Bedrock CountTokens format for Converse): { "input": { "converse": { "messages": [...], "system": [...] (if present) } } } Output (Bedrock CountTokens format for InvokeModel): { "input": { "invokeModel": { "body": "{...raw model input...}" } } } r)r_transform_to_converse_format!_transform_to_invoke_model_format)rr input_types r+transform_anthropic_to_bedrock_count_tokenszDBedrockCountTokensConfig.transform_anthropic_to_bedrock_count_tokens+s?B,,\:  #55lC C99,G Grc|jdg}|jd}|jd}g}|D]u}|jdgd}|jdd}t|tr|djd|int|tr||d<|j|wd|i} |j |} | r| | d<|j |} | r| | d <d d | iiS) z?Transform to Converse input format, including system and tools.rsystemtoolsrole)rcontentr text toolConfiginputr)getrstrappendr_transform_system_transform_tools) rr rrr user_messagesmessagetransformed_messager converse_input system_blocks tool_configs rrz6BedrockCountTokensConfig._transform_to_converse_formatSs ##J3!!(+  ) G F+3 kk)R0G'3'#I.55vw6GHGT*18#I.  !4 5 +5m)D..v6 '4N8 $++E2 +6N< (*n566rrc|gSt|trd|igSt|tr2|Dcgc]&}t|trd|j ddi(c}SgScc}w)z;Transform Anthropic system prompt to Bedrock system blocks.r"r!)rr&rdictr%)rrblocks rr(z*BedrockCountTokensConfig._transform_systemwsv >I fc "V$% % fd #$#EeT*62./#   s+Arc8|syg}|D]}|jdd}tjdd|}|r|djsd|z}|dd}|jd xs|}|jd d id }|j d ||d|idid|iS)z7Transform Anthropic tools to Bedrock toolConfig format.Nnamer!z [^a-zA-Z0-9_]_rt_@ description input_schemaobject)type propertiestoolSpecjson)r4r8 inputSchemar)r%resubisalphar')rr bedrock_toolstoolr4r8r9s rr)z)BedrockCountTokensConfig._transform_toolss D88FB'D66*C6DDGOO-d{9D((=19TK88 DL   $'2(. '=! .''rcddl}|jDcic]\}}|dk7s ||}}}ddd|j|iiiScc}}w)z&Transform to InvokeModel input format.rNmodelr$rbody)r>itemsdumps)rr r>kv body_datas rrz:BedrockCountTokensConfig._transform_to_invoke_model_formatsZ '3&8&8&:K&:daa7lQT&: K-&$**Y2G)HIJJLs AANrFaws_region_nameapi_baseaws_bedrock_runtime_endpointct|}|jdr|dd}|j|||\}}|d|d}|S)a Construct the AWS Bedrock CountTokens API endpoint using existing LiteLLM functions. Args: model: The resolved model ID from router lookup aws_region_name: AWS region (e.g., "eu-west-1") api_base: Optional custom API base URL (takes highest priority) aws_bedrock_runtime_endpoint: Optional custom Bedrock runtime endpoint Returns: Complete endpoint URL for CountTokens API zbedrock/N)rNrOrMz/model/z /count-tokens)r startswithget_runtime_endpoint) rrFrMrNrOmodel_idbase_urlr5endpoints r!get_bedrock_count_tokens_endpointz:BedrockCountTokensConfig.get_bedrock_count_tokens_endpointsd(*%0   z *|H//)E+0 ! Zwxj >rbedrock_responsec.|jdd}d|iS)z Transform Bedrock CountTokens response to Anthropic format. Input (Bedrock response): { "inputTokens": 123 } Output (Anthropic format): { "input_tokens": 123 } inputTokensr input_tokens)r%)rrXr[s r'transform_bedrock_response_to_anthropicz@BedrockCountTokensConfig.transform_bedrock_response_to_anthropics! (++M1=  --rc|jds td|j|}|dk(r|jdg}|s tdt|ts tdt |D]J\}}t|t std|dd |vrtd|d d |vs=td|d yt|d kr tdy)z Validate the incoming count tokens request. Supports both Converse and InvokeModel input formats. Args: request_data: The request payload Raises: ValueError: If the request is invalid rFzmodel parameter is requiredrrz1messages parameter is required for Converse inputzmessages must be a listzMessage z must be a dictionaryrz must have a 'role' fieldr z must have a 'content' fieldz,Request must contain content to count tokensN)r% ValueErrorrrr enumerater1len)rr rrir+s rvalidate_count_tokens_requestz6BedrockCountTokensConfig.validate_count_tokens_requests(:; ;,,\:  ##'' B7H !TUUh- !:;;'1 7!'40$xs2G%HII($xs2K%LMMG+$xs2N%OPP2< A% !OPP&r)NN)__name__ __module__ __qualname____doc__rr&rrrrrrr(r)rrWr\rcrrr r s}tCH~#$&H38n&H c3h&HP"7 cN"7 c3h"7H  $tCH~:N (d4S>23( $sCx. !(B K cN K c3h K #'6: !!!3- ! '/sm ! !F. $S#X. c3h.(&Q$sCx.&QT&Qrr ) rgr@typingrrrr!litellm.llms.bedrock.base_aws_llmr!litellm.llms.bedrock.common_utilsrr rhrrrls+ ,,8DAQzAQr