i dZddlZddlZddlZddlmZddlmZmZm Z m Z m Z m Z ddl Z ddlZddlmZddlmZddlmZddlmZdd lmZdd lmZmZmZmZmZm Z m!Z!dd l"m#Z#m$Z$dd l%m&Z&eZ' d2d e e e!fdZ( d2de efdZ)e$ d3de e*de e e*de e de e de e e*e*fde e e*efde e e*efde e e*efde e e+e jXfde e*defdZ-e$ d3de e*de e e*de e de e de e e*e*fde e e*efde e e*efde e e*efde e e+e jXfde e*de eeeeefffdZ.e$ d4de*de e*e e*fd e e d!e e/d"e e d#e e0de e e*efde e e*efde e e*efde e e+e jXfde e*de fd$Z1e$ d4de*de e*e e*fd e e d!e e/d"e e d#e e0de e e*efde e e*efde e e*efde e e+e jXfde e*de e eeee fffd%Z2e$ d5de*de e e*efde e e*efde e e*efde e e+e jXfde e*defd&Z3e$ d5de*de e e*efde e e*efde e e*efde e e+e jXfde e*de eeeeefffd'Z4e$ d6d(e e*d)e e*d*e e/d+e e*de e e*efde e e*efde e e*efde e e+e jXfde e*fd,Z5e$ d6d(e e*d)e e*d*e e/d+e e*de e e*efde e e*efde e e*efde e e+e jXfde e*fd-Z6e$ d7de*de e*de e de e e*e*fde e e*efde e e*efde e e*efde e e+e jXfde e*defd.Z7e$ d7de*de e*de e de e e*e*fde e e*efde e e*efde e e*efde e e+e jXfde e*de eeeeefffd/Z8e$ d5de*de e e*efde e e*efde e e*efde e e+e jXfde e*f d0Z9e$ d5de*de e e*efde e e*efde e e*efde e e+e jXfde e*f d1Z:y)8z@ LiteLLM SDK Functions for Creating and Searching Vector Stores N)partial)Any CoroutineDictListOptionalUnion)request_timeout)get_llm_provider)Logging)BaseLLMHTTPHandler)GenericLiteLLMParams)&VectorStoreCreateOptionalRequestParamsVectorStoreCreateResponseVectorStoreFileCountsVectorStoreResultContent&VectorStoreSearchOptionalRequestParamsVectorStoreSearchResponseVectorStoreSearchResult)ProviderConfigManagerclient)VectorStoreRequestUtils mock_resultscV|tdtddgg}tdd|S) z%Mock response for vector store searchgffffff?z5This is a sample search result from the vector store.text)rtype)scorecontentz vector_store.search_results.pagez sample query)object search_querydata)rrrrs k/Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/vector_stores/main.py!mock_vector_store_search_responser$%sG #,T#    %1#   mock_responsecR|$tdddddtdddddddddd }|S) z%Mock response for vector store createN vs_mock123 vector_storeiEezMock Vector Storer) in_progress completedfailed cancelledtotalr+) idr created_atnamebytes file_countsstatus expires_after expires_atlast_active_atmetadata)rrr&s r#!mock_vector_store_create_responser:=sS1!!$- # ( r%r1file_idsr5chunking_strategyr8 extra_headers extra_query extra_bodytimeoutcustom_llm_providerreturnc Kt} tj} d| d<| d} ttf|||||||||| d | } t j }t|j| }| jd|d{}tj|r |d{}|S|}|S7)7 #t$r}tjd| || | d}~wwxYww)z' Async: Create a vector store. TacreateNopenai) r1r;r5r<r8r=r>r?r@rAmodelrAoriginal_exceptioncompletion_kwargs extra_kwargs) localsasyncioget_event_looprcreate contextvars copy_contextrunrun_in_executor iscoroutine Exceptionlitellmexception_type)r1r;r5r<r8r=r>r?r@rAkwargs local_varsloopfuncctxfunc_with_context init_responseresponsees r#rDrDYs(J( %%' y  &"*    '/'#! 3    &&(#CGGT2"2249JKK   } -**H%HL+  $$ 3 (    sY CA7B3B/B3$B1%B3*C+B3.C/B31B33 C<CCCc  $t} | jd} | jdd} | jdddu}tdi| }|jr9t |jt rttdi|jS| d} d | vrt| dd \}} }}nd}| } tjtj| | }|td | | j| t!j"| }| j%| dd |i|d| i| t&j)||| || |||xst*|| jd }|S#t,$r}tj.d| || | d}~wwxYw)a Create a vector store. Args: name: The name of the vector store. file_ids: A list of File IDs that the vector store should use. expires_after: The expiration policy for the vector store. chunking_strategy: The chunking strategy used to chunk the file(s). metadata: Set of 16 key-value pairs that can be attached to an object. Returns: VectorStoreCreateResponse containing the created vector store details. litellm_logging_objlitellm_call_idNrDFTr9rE/rGrAlitellm_paramsproviderapi_typez)Vector store create is not supported for r1rWrGoptional_paramsrerAr) #vector_store_create_optional_paramsvector_store_provider_configrAre logging_objr=r?r@ _is_asyncrrF)rKgetpoprr& isinstancedictr:rr r!get_provider_vector_stores_configrU LlmProviders ValueErrorupdater0get_requested_vector_store_create_optional_paramupdate_from_kwargsbase_llm_http_handlervector_store_create_handlerr rTrV)r1r;r5r<r8r=r>r?r@rArWrXrarbrnrerh_rlrkr^r_s r#rNrNs<JW 17r?r@rArF) rKrLrMrsearchrOrPrQrRrSrTrUrV)r}r~rrrrr=r>r?r@rArWrXrYrZr[r\r]r^r_s r#rrs*J) %%' y  &"*   +++''#! 3   &&(#CGGT2"2249JKK   } -**H%HL+  $$ 3 (    sY CA8B4B0B4%B2&B4+C,B4/C0B42B44 C=CCCc  t} | jd} | jdd}| jdddu}| jd|}tj3|1 tjj |}| j |tdd|i| }|jrht|jttjfr>d}t|jtjr |j}t|S| d } d | vrt| dd \}} }}nd}| } t!j"tj$| | }|t'd | | j | t)j*| |}| j-| |||d|||d|j/d| t0j3||||| || ||| xst4|| jd }|S#t$rYywxYw#t$r}tj6d| || | d}~wwxYw)a[ Search a vector store for relevant chunks based on a query and file attributes filter. Args: vector_store_id: The ID of the vector store to search. query: A query string or array for the search. filters: Optional filter to apply based on file attributes. max_num_results: Maximum number of results to return (1-50, default 10). ranking_options: Optional ranking options for search. rewrite_query: Whether to rewrite the natural language query for vector search. Returns: VectorStoreSearchResponse containing the search results. rarbNrFTr}r"rErcrdrfz)Vector store search is not supported for )rl)r}r~)rbr}) exclude_nonerir) r}r~#vector_store_search_optional_paramsrlrArermr=r?r@rnrrFro)rKrprqrUvector_store_registry get_credentials_for_vector_storerwrTrr&rrstrbuiltinslistr$r rrtrurvr0get_requested_vector_store_search_optional_paramry model_dumprzvector_store_search_handlerr rV)r}r~rrrrr=r>r?r@rArWrXrarbrnvector_store_id_for_credentialsregistry_credentialsrerrhr|rlrr^r_s r#rrUs@Jn 17-  L.66 F-;; 4,O O  &"*  % %2B)$(#3 /H)1a H"5  " C C --.AB!  % ( /; !4 / )DD+0S)E 3)+'!.::h'E  i  j  $$ 3 (    sDAH(0HBHC+H HHHH H=H88H=c Kt} tj}d|d<|d}ttf||||||d|} t j } t| j| } |jd| d{} tj| r | d{} | S| } | S7)7 #t$r}tjd||||d}~wwxYww)z) Async: Retrieve a vector store. T aretrieveNrEr}r=r>r?r@rArF) rKrLrMrretrieverOrPrQrRrSrTrUrVr}r=r>r?r@rArWrXrYrZr[r\r]r^r_s r#rrsJ# %%'"{  &"*    +'#! 3    &&(#CGGT2"2249JKK   } -**H%HL+  $$ 3 (    Y CA3B/B+B/ B-!B/&C'B/*C+B/-B// C8CCCc Jt} |jd}|jdd} |jdddu} tdi|} |d}d|vrt |dd \} }} } nd} |}t j tj|| }|td ||j|dd |id| i| tj|||| ||||xst| |jd }|S#t$r}tjd||||d}~wwxYw)z Retrieve a vector store. Args: vector_store_id: The ID of the vector store to retrieve. Returns: VectorStoreCreateResponse containing the vector store details. rarbNrFTrErcrdrfz+Vector store retrieve is not supported for r}rir r}rlrArermr=r?r@rnrrFro)rKrprqrr rrtrUrurvryrzvector_store_retrieve_handlerr rTrVr}r=r>r?r@rArWrXrarbrnrerhr|rlr^r_s r#rrs&J= 17Q=RS  ...@-? 3 / )FF+)E 3)+'!.::h'G    $$ 3 (    C-C:: D"DD"afterbeforelimitorderc Kt} tj} d| d<|d}ttf|||||||||d | } t j } t| j| }| jd|d{}tj|r |d{}|S|}|S7)7 #t$r}tjd||| | d}~wwxYww)z$ Async: List vector stores. TalistNrE) rrrrr=r>r?r@rArF) rKrLrMrrrOrPrQrRrSrTrUrV)rrrrr=r>r?r@rArWrXrYrZr[r\r]r^r_s r#rros  J& %%'w  &"*    '#! 3    &&(#CGGT2"2249JKK   } -**H%HL+  $$ 3 (    Y CA6B2B.B2#B0$B2)C*B2-C.B20B22 C;CCCc  Vt} | jd} | jdd} | jdddu} tdi| }|d}d|vrt |dd \}}}}nd}|}t j tj|| }|td || j| d||||d d| i| tj|||||||| |||xst| | jd }|S#t$r}tjd||| | d}~wwxYw)a+ List vector stores. Args: after: A cursor for use in pagination. before: A cursor for use in pagination. limit: A limit on the number of objects to be returned. order: Sort order by the created_at timestamp. Returns: List of vector stores. rarbNrFTrErcrdrfz'Vector store list is not supported for )rrrrrir) rrrrrlrArermr=r?r@rnrrFro)rKrprqrr rrtrUrurvryrzvector_store_list_handlerr rTrV)rrrrr=r>r?r@rArWrXrarbrnrerhr|rlr^r_s r#rrs2JE 17r?r@rArF) rKrLrMrrwrOrPrQrRrSrTrUrV)r}r1r5r8r=r>r?r@rArWrXrYrZr[r\r]r^r_s r#rr s J& %%' y  &"*    +''#! 3    &&(#CGGT2"2249JKK   } -**H%HL+  $$ 3 (    rc  t} | jd} | jdd} | jdddu} tdi| }|d}d|vrt |dd \}}}}nd}|}t j tj|| }|td || j| tj| }| j| d||d |d| i| tj|||||| |||xst | | jd }|S#t"$r}tj$d||| | d}~wwxYw)a Update a vector store. Args: vector_store_id: The ID of the vector store to update. name: The name of the vector store. expires_after: The expiration policy for the vector store. metadata: Set of 16 key-value pairs that can be attached to an object. Returns: VectorStoreCreateResponse containing the updated vector store details. rarbNrFTrErcrdrfz)Vector store update is not supported for )r}r1rir) r}#vector_store_update_optional_paramsrlrArermr=r?r@rnrrFro)rKrprqrr rrtrUrurvrwrrxryrzvector_store_update_handlerr rTrV)r}r1r5r8r=r>r?r@rArWrXrarbrnrerhr|rlrr^r_s r#rwrwEs2JJ 17rs! >> -NSI58?+, =A4 7892:>568$($((,)-/3,0+/59)-< 3-< tCy!< D><  ~ < tCH~& < DcN+< $sCx.)< c3h(< eE5==01 2< "#< < < ~$($((,)-/3,0+/59)-u 3-u tCy!u D>u  ~ u tCH~& u DcN+u $sCx.)u c3h(u eE5==01 2u "#u  $iS:S0S&T TUu u p#%)&*$(/3,0+/59)-? ? d3i ? d^? c] ? d^ ? D> ? DcN+? $sCx.)? c3h(? eE5==01 2? "#? !? ? D#%)&*$(/3,0+/59)-N N d3i N d^N c] N d^ N D> N DcN+N $sCx.)N c3h(N eE5==01 2N "#N  $iS:S0S&T TU!N N b/3,0+/59)- 0 0 DcN+0 $sCx.)0 c3h( 0 eE5==01 2 0 "# 0 0 0 f/3,0+/59)- P P DcN+P $sCx.)P c3h( P eE5==01 2 P "# P  $iS:S0S&T TUP P f !.2,0+/59)-6 C=6 SM6  C=6  C= 6 DcN+ 6 $sCx.) 6 c3h(6 eE5==01 26 "#6 6 r !.2,0+/59)-^ C=^ SM^  C=^  C= ^ DcN+ ^ $sCx.) ^ c3h(^ eE5==01 2^ "#^ ^ B$()-.2,0+/59)-6 6 3-6 D>6 tCH~& 6 DcN+ 6 $sCx.) 6 c3h(6 eE5==01 26 "#6 6 6 r$()-.2,0+/59)-c c 3-c D>c tCH~& c DcN+ c $sCx.) c c3h(c eE5==01 2c "#c  $iS:S0S&T TUc c L/3,0+/59)- 0 0 DcN+0 $sCx.)0 c3h( 0 eE5==01 2 0 "# 0 0 f/3,0+/59)- P P DcN+P $sCx.)P c3h( P eE5==01 2 P "# P P r%