i)ddlZddlZddlmZddlmZddlmZm Z m Z m Z ddl Z ejjdZddlmZddlmZmZdd lmZdd lmZmZmZdd lmZdd lmZdd l m!Z!ddl"m#Z#ddl$m%Z%m&Z&ddlm'Z'ddl(m)Z)m*Z*m+Z+m,Z,de-de ee-e-fddfdZ.ddddddddddede e-de-de e-de ede e e/efde eee-e fdfde ee-e-fde e'de defd Zdddddddd!dede e-de-de e-de ede e eee-e ffde ee-e-fde e'defd"Z0gd#Z1d$Z2e3ed%rejhe2&yy)'N)ThreadPoolExecutor) timedelta)DictOptionalUnionAnylancedb)connect)URI sanitize_uri)urlparse)AsyncConnection DBConnectionLanceDBConnection)StorageOptionsProvider) ClientConfig)RemoteDBConnection)vector) AsyncTableTable)Session)connect_namespaceconnect_namespace_asyncLanceNamespaceDBConnectionAsyncLanceNamespaceDBConnectionuristorage_optionsreturnct|tr|jdsyt|}|j}d|vryddh}xrt fd|D}|st d|dy) a Check if an S3 URI has a bucket name containing dots and warn if no region is specified. S3 buckets with dots cannot use virtual-hosted-style URLs, which breaks automatic region detection. See: https://github.com/lancedb/lancedb/issues/1898 zs3://N.region aws_regionc3&K|]}|v yw)N).0krs L/mnt/e/genesis-system/.venv/lib/python3.12/site-packages/lancedb/__init__.py z-_check_s3_bucket_with_dots..5s(S!o)=(SszS3 bucket name 'a' contains dots, which prevents automatic region detection. Please specify the region explicitly via storage_options={'region': ''} or storage_options={'aws_region': ''}. See https://github.com/lancedb/lancedb/issues/1898 for details.) isinstancestr startswithrnetlocany ValueError)rrparsedbucket region_keys has_regions ` r(_check_s3_bucket_with_dotsr4 s c3 s~~g'> c]F ]]F &\*K SS(S{(S%SJ vh'N O   z us-east-1)api_keyr" host_overrideread_consistency_intervalrequest_thread_pool client_configrsessionr6r"r7r8r9r:r;kwargsc jt|trp|jdr_|tjj d}|t d|t|tr t|}t||||f|||d| Stt||| rt d| t||||S)a Connect to a LanceDB database. Parameters ---------- uri: str or Path The uri of the database. api_key: str, optional If presented, connect to LanceDB cloud. Otherwise, connect to a database on file system or cloud storage. Can be set via environment variable `LANCEDB_API_KEY`. region: str, default "us-east-1" The region to use for LanceDB Cloud. host_override: str, optional The override url for LanceDB Cloud. read_consistency_interval: timedelta, default None (For LanceDB OSS only) The interval at which to check for updates to the table from other processes. If None, then consistency is not checked. For performance reasons, this is the default. For strong consistency, set this to zero seconds. Then every read will check for updates from other processes. As a compromise, you can set this to a non-zero timedelta for eventual consistency. If more than that interval has passed since the last check, then the table will be checked for updates. Note: this consistency only applies to read operations. Write operations are always consistent. client_config: ClientConfig or dict, optional Configuration options for the LanceDB Cloud HTTP client. If a dict, then the keys are the attributes of the ClientConfig class. If None, then the default configuration is used. storage_options: dict, optional Additional options for the storage backend. See available options at session: Session, optional (For LanceDB OSS only) A session to use for this connection. Sessions allow you to configure cache sizes for index and metadata caches, which can significantly impact memory use and performance. They can also be re-used across multiple connections to share the same cache state. Examples -------- For a local directory, provide a path for the database: >>> import lancedb >>> db = lancedb.connect("~/.lancedb") For object storage, use a URI prefix: >>> db = lancedb.connect("s3://my-bucket/lancedb", ... storage_options={"aws_access_key_id": "***"}) Connect to LanceDB cloud: >>> db = lancedb.connect("db://my_database", api_key="ldb_...", ... client_config={"retry_config": {"retries": 5}}) Returns ------- conn : DBConnection A connection to a LanceDB database. zdb://LANCEDB_API_KEYz1api_key is required to connect to LanceDB cloud: )r9r:rzUnknown keyword arguments: )r8rr;) r*r+r,osenvirongetr/intrrr4r) rr6r"r7r8r9r:rr;r<s r(r r AsV#sw 7 ?jjnn%67G ?PQTPUVW W )3 /"45H"I !      !4'+    s3x9 6vh?@@  ";'  r5)r6r"r7r8r:rr;c K||j}nd}t|tr tdi|}t t ||t tt||||||||d{S7w)a Connect to a LanceDB database. Parameters ---------- uri: str or Path The uri of the database. api_key: str, optional If present, connect to LanceDB cloud. Otherwise, connect to a database on file system or cloud storage. Can be set via environment variable `LANCEDB_API_KEY`. region: str, default "us-east-1" The region to use for LanceDB Cloud. host_override: str, optional The override url for LanceDB Cloud. read_consistency_interval: timedelta, default None (For LanceDB OSS only) The interval at which to check for updates to the table from other processes. If None, then consistency is not checked. For performance reasons, this is the default. For strong consistency, set this to zero seconds. Then every read will check for updates from other processes. As a compromise, you can set this to a non-zero timedelta for eventual consistency. If more than that interval has passed since the last check, then the table will be checked for updates. Note: this consistency only applies to read operations. Write operations are always consistent. client_config: ClientConfig or dict, optional Configuration options for the LanceDB Cloud HTTP client. If a dict, then the keys are the attributes of the ClientConfig class. If None, then the default configuration is used. storage_options: dict, optional Additional options for the storage backend. See available options at session: Session, optional (For LanceDB OSS only) A session to use for this connection. Sessions allow you to configure cache sizes for index and metadata caches, which can significantly impact memory use and performance. They can also be re-used across multiple connections to share the same cache state. Examples -------- >>> import lancedb >>> async def doctest_example(): ... # For a local directory, provide a path to the database ... db = await lancedb.connect_async("~/.lancedb") ... # For object storage, use a URI prefix ... db = await lancedb.connect_async("s3://my-bucket/lancedb", ... storage_options={ ... "aws_access_key_id": "***"}) ... # Connect to LanceDB cloud ... db = await lancedb.connect_async("db://my_database", api_key="ldb_...", ... client_config={ ... "retry_config": {"retries": 5}}) Returns ------- conn : AsyncConnection A connection to a LanceDB database. Nr%) total_secondsr*dictrr4r+rlancedb_connectr ) rr6r"r7r8r:rr;read_consistency_interval_secss r( connect_asyncrHsN!,)B)P)P)R&)-&-&$5}5 s3x9       *        sA)A6+A4, A6)r rHrrrrrr r rrrrrrrr __version__c.tjdy)NzLlance is not fork-safe. If you are using multiprocessing, use spawn instead.)warningswarnr%r5r(__warn_on_forkrM s MMVr5register_at_fork)before)5importlib.metadata importlibr?concurrent.futuresrdatetimertypingrrrrrKmetadataversionrI_lancedbr rFcommonr r urllib.parserdbrrriorremoter remote.dbrschemartablerrr namespacerrrrr+r4rBrH__all__rMhasattrrNr%r5r(rcsF  1--  ((3 0%!@@& )$  'S#X7   H"#'59DH?C04!%g gc]g  g C= g ( 2 g"%-?(?"@AgtCH~t;<gd38n-gg gggZ"#'59CG04!%\ \c]\  \ C= \ ( 2 \E,S#X">?@\d38n-\g \\~ ,  2!"B~.#r5