i,dZddlmZddlmZmZmZmZmZm Z m Z ddl m Z ddl mZmZddlmZddlmZer ddlmZdd lmZGd d eZy ) z Gemini-specific RAG Ingestion implementation. Gemini handles embedding and chunking internally when files are uploaded to File Search stores, so this implementation skips the embedding step and directly uploads files. ) annotations) TYPE_CHECKINGAnyDictListOptionalTuplecast)verbose_logger)get_async_httpx_clienthttpxSpecialProvider)GeminiModelInfo)BaseRAGIngestion)Router)RAGIngestOptionsceZdZdZ d d fd Z d dZ d dZ d dZ ddZ ddZ ddZ xZ S)GeminiRAGIngestionaj Gemini-specific RAG ingestion using File Search API. Key differences from base: - Embedding is handled by Gemini when files are uploaded to File Search stores - Files are uploaded using uploadToFileSearchStore API - Chunking is done by Gemini's File Search (supports custom white_space_config) - Supports custom metadata attachment cFt|||t|_y)N)ingest_optionsrouter)super__init__r model_info)selfrr __class__s w/Users/manta/Documents/Projects/TheRoad-I1/.venv/lib/python3.12/site-packages/litellm/rag/ingestion/gemini_ingestion.pyrzGeminiRAGIngestion.__init__$s! vF)+c Kyw)z Gemini handles embedding internally - skip this step. Returns: None (Gemini embeds when files are uploaded to File Search store) N)rchunkss rembedzGeminiRAGIngestion.embed,s sczK|jjd}tttt f|j}tt t|jdxstj}tt t|jdxstj} |s td| s tdd} | d| } |s*|j|| |jxsd d {}d } |r#|r!|r|j|| |||| d {} || fS7/7 w) a Store content in Gemini File Search store. Gemini workflow: 1. Create File Search store (if not provided) 2. Upload file using uploadToFileSearchStore (Gemini handles chunking/embedding) Args: file_content: Raw file bytes filename: Name of the file content_type: MIME type chunks: Ignored - Gemini handles chunking embeddings: Ignored - Gemini handles embedding Returns: Tuple of (vector_store_id, file_id) vector_store_idapi_keyapi_basezCGEMINI_API_KEY or GOOGLE_API_KEY is required for Gemini File SearchzGEMINI_API_BASE is requiredv1beta/zlitellm-rag-ingest)r$base_url display_nameN)r$r(r#filename file_content content_type)vector_store_configgetr rstrrrr get_api_key get_api_base ValueError_create_file_search_store ingest_name_upload_to_file_search_store) rr+r*r,r embeddingsr#r-r$r% api_versionr(result_file_ids rstorezGeminiRAGIngestion.store9sa222667HI"4S>43K3KL # 3 7 7 B C -**,  # 3 7 7 C D .++-  U :; ; Zq .$($B$B!!--E1E%C%O H#'#D#D! /!)) $E$N..%s$DD;D7&D;.D9/ D;9D;cK|d|}d|i}ttjddi}|j||ddid {}|jd k7r/d |j }t j|t||j} | jd d } t jd| | S7~w)a Create a Gemini File Search store. Args: api_key: Gemini API key base_url: Base URL for Gemini API display_name: Display name for the store Returns: Store name (format: fileSearchStores/xxxxxxx) z/fileSearchStores?key= displayNametimeoutN@ llm_providerparams Content-Typeapplication/jsonjsonheadersNz$Failed to create File Search store: namezCreated File Search store: ) r r RAGpost status_codetextr error ExceptionrDr.debug) rr$r(r)url request_bodyclientresponse error_msg response_data store_names rr3z,GeminiRAGIngestion._create_file_search_stores" 0 :%|4 '-11t$   #%78%     3 &>x}}oNI   +I& &  "&&vr2 ::,GH sACCA?Cc K|j||||t||xsdd{}|j||d{}|S7!7w)a Upload a file to Gemini File Search store using resumable upload. Args: api_key: Gemini API key base_url: Base URL for Gemini API vector_store_id: File Search store name filename: Name of the file file_content: File content bytes content_type: MIME type Returns: File ID or document name zapplication/octet-stream)r$r(r#r* file_sizer,N) upload_urlr+)_initiate_resumable_uploadlen_upload_file_content) rr$r(r#r*r+r,rYfile_ids rr5z/GeminiRAGIngestion._upload_to_file_search_storess0 ::+,'%C)C ;  11!%2     s!(AA AAAAcK|jdd}|d|d|}d|i} |j} | rMt| tr=| j d} | r*d| j dd | j d d d i| d <t t ttttf|jj d} | r| | d<ddt||dd} tjd|ttj ddi}|j#|| | d{}|j$dvr/d|j&}tj(|t+|tjd|j,|j,j d}|s t+dtjd||S7w) zy Initiate a resumable upload session. Returns: Upload URL for the resumable session z/v1betarHz/upload/v1beta/z:uploadToFileSearchStore?key=r;white_space_configwhiteSpaceConfigmax_tokens_per_chunki max_overlap_tokensi)maxTokensPerChunkmaxOverlapTokenschunkingConfigcustom_metadatacustomMetadata resumablestartrB)zX-Goog-Upload-ProtocolX-Goog-Upload-Commandz#X-Goog-Upload-Header-Content-Lengthz!X-Goog-Upload-Header-Content-TyperAzInitiating resumable upload: r<r=r>rCNrFzFailed to initiate upload: z$Initiate resumable upload response: zx-goog-upload-urlz*No upload URL returned in response headerszGot upload URL: )replacechunking_strategy isinstancedictr.r rrrr/rr-r rOr r rIrJrKrLrMrNrE)rr$r(r#r*rXr,r%rPrQrnr_rfrErRrSrTrYs rrZz-GeminiRAGIngestion._initiate_resumable_uploads$##Ir2 //)::WX_W`a)6x'@ !22 ,=t!D!2!6!67K!L !&-?-C-C2C.-?,B,B0#- ) 2 -. T$sCx.) *  $ $ ( (): ;  -1=.    HI I/ |<=# sD$G&G 'B&GcKtt|ddd}tjdt|dt t j ddi}|j||| d {}|jd vr/d |j}tj|t| |j}|jd dxs"|jdijd d}tjd||S7#t$r"} tjd| Yd } ~ yd } ~ wwxYww)z Upload file content to the resumable upload URL. Returns: File ID or document name from the response 0zupload, finalize)zContent-LengthzX-Goog-Upload-OffsetrjzUploading file content (z bytes)r<gr@r>)contentrENrkzFailed to upload file: rGrHfilezUpload complete. File ID: z!Could not parse upload response: uploaded)r/r[r rOr r rIputrKrLrMrNrDr.warning) rrYr+rErRrSrTrUr]es rr\z'GeminiRAGIngestion._upload_file_content%sL"#l"34$'%7  7L8I7J'RS'-11u%    $     z 11(--AI   +I& & $MMOM#''3}7H7H8c&"o   #=gY!G HN' (   " "%Fqc#J K s>A/E1D2AE4ADE ED<7E<EE)N)rz'RAGIngestOptions'rzOptional['Router'])r List[str]returnOptional[List[List[float]]]) r+zOptional[bytes]r* Optional[str]r,r|r ryr6r{rzz#Tuple[Optional[str], Optional[str]])r$r/r(r/r)r/rzr/)r$r/r(r/r#r/r*r/r+bytesr,r|rzr/)r$r/r(r/r#r/r*r/rXintr,r/rzr/)rYr/r+r}rzr/) __name__ __module__ __qualname____doc__rr!r9r3r5rZr\ __classcell__)rs@rrrsk&*,*,#,   % F/%F/ F/$ F/  F/ 0 F/ -F/P((( ( (T''' '  '  '$' 'ROOO O  O  OO Ob... .rrN)r __future__rtypingrrrrrr r litellm._loggingr &litellm.llms.custom_httpx.http_handlerr r litellm.llms.gemini.common_utilsr$litellm.rag.ingestion.base_ingestionrlitellmrlitellm.types.ragrrrrrrs@#HHH+=A2z)zr