Code

Add Cosmos DB storage/cache option#1431

Code

Merged

AlonsoGuevara merged 130 commits intomainmicrosoft/graphrag:mainfrom add-cosmosdb-to-storagemicrosoft/graphrag:add-cosmosdb-to-storageCopy head branch name to clipboardDec 19, 2024

+925-302

Commits

Commits on Nov 4, 2024

• added cosmosdb constructor and database methods

  KennyZhang1

  committed
  6cae56c

• added rest of abstract method headers

  KennyZhang1

  committed
  80bd11a

• added cosmos db container methods

  KennyZhang1

  committed
  e846edc

Commits on Nov 5, 2024

• implemented has and delete methods

  KennyZhang1

  committed
  439409f

• finished implementing abstract class methods

  KennyZhang1

  committed
  b010d14

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  e1beb4d

Commits on Nov 6, 2024

• integrated class into storage factory

  KennyZhang1

  committed
  923a791

• integrated cosmosdb class into cache factory

  KennyZhang1

  committed
  8cd45cb

• added support for new config file fields

  KennyZhang1

  committed
  b041e51

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  66ace0d

Commits on Nov 7, 2024

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  b263569

Commits on Nov 8, 2024

• replaced primary key cosmosdb initialization with connection strings

  KennyZhang1

  committed
  a76eb54

Commits on Nov 11, 2024

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  73d1e42

Commits on Nov 12, 2024

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  5436166

• modified cosmosdb setter to require json

  KennyZhang1

  committed
  e0a0546

Commits on Nov 14, 2024

• Fix non-default emitters

  AlonsoGuevara

  committed
  6d2427e

• Format

  AlonsoGuevara

  committed
  d206e67

• Ruff

  AlonsoGuevara

  committed
  ea7a404

• ruff

  AlonsoGuevara

  committed
  297066c

• Merge remote-tracking branch 'origin/fix/non-default-emitters' into add-cosmosdb-to-storage

  KennyZhang1

  committed
  0982efe

• first successful run of cosmosdb indexing

  KennyZhang1

  committed
  d6c3afc

• removed extraneous container_name setting

  KennyZhang1

  committed
  d1fc4f0

• require base_dir to be typed as str

  KennyZhang1

  committed
  716bfa4

• reverted merged changed from closed branch

  KennyZhang1

  committed
  65c93bb

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  6d1a4d9

Commits on Nov 15, 2024

• removed nested try statement

  KennyZhang1

  committed
  66641d6

• readded initial non-parquet emitter fix

  KennyZhang1

  committed
  5e5f76d

• added basic support for parquet emitter using internal conversions

  KennyZhang1

  committed
  0d93d0d

Commits on Nov 18, 2024

• merged with main and resolved conflicts

  KennyZhang1

  committed
  dac0b86

• Merge branch 'main' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  594f332

• fixed more merge conflicts

  KennyZhang1

  committed
  6eb6134

• added cosmosdb functionality to query pipeline

  KennyZhang1

  committed
  31c0a7a

Commits on Nov 19, 2024

• tested query for cosmosdb

  KennyZhang1

  committed
  c5281bb

• collapsed cosmosdb schema to use minimal containers and databases

  KennyZhang1

  committed
  76511d0

Commits on Nov 20, 2024

• simplified create_database and create_container functions

  KennyZhang1

  committed
  232cd07

Commits on Nov 21, 2024

• ruff fixes and semversioner

  KennyZhang1

  committed
  297373b

• spellcheck and ci fixes

  KennyZhang1

  committed
  4ddff36

• updated pyproject toml and lock file

  KennyZhang1

  committed
  15d9e62

Commits on Nov 29, 2024

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  committed
  93afe22

Commits on Dec 2, 2024

• apply fixes after merge from main

  jgbradley1

  committed
  48b7bd9

Commits on Dec 3, 2024

• add temporary comments

  jgbradley1

  committed
  c6c7494

• refactor cache factory

  jgbradley1

  committed
  aa4a996

• refactored storage factory

  jgbradley1

  committed
  2113de6

• minor formatting

  jgbradley1

  committed
  11b5b62

• update dictionary

  jgbradley1

  committed
  8f3e44c

• fix spellcheck typo

  jgbradley1

  committed
  447cbe7

• fix default value

  jgbradley1

  committed
  6f91dfb

• fix pydantic model defaults

  jgbradley1

  committed
  c79e63c

• update pydantic models

  jgbradley1

  committed
  aeceacb

• fix init_content

  jgbradley1

  committed
  b3feb44

Commits on Dec 4, 2024

• cleanup how factory passes parameters to file storage

  jgbradley1

  committed
  03e7d35

• remove unnecessary output file type

  jgbradley1

  committed
  f2a5a4d

• update pydantic model

  jgbradley1

  committed
  dbd6737

• cleanup code

  jgbradley1

  committed
  a059333

• implemented clear method

  KennyZhang1

  committed
  a0272a6

Commits on Dec 6, 2024

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  committed
  b0e3369

• fix merge from main

  jgbradley1

  committed
  10b8996

• add test stub for cosmosdb

  jgbradley1

  committed
  91d0348

• regenerate lock file

  jgbradley1

  committed
  7f62af2

• modified set method to collapse parquet rows

  KennyZhang1

  committed
  4231189

• modified get method to collapse parquet rows

  KennyZhang1

  committed
  110b10e

• updated has and delete methods and docstrings to adhere to new schema

  KennyZhang1

  committed
  8e7a1e3

• added prefix helper function

  KennyZhang1

  committed
  2db7f83

• replaced delimiter for prefixed id

  KennyZhang1

  committed
  4726bbf

• verified empty tests are passing

  jgbradley1

  committed
  49a3639

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  committed
  0429f2f

• fix merges from main

  jgbradley1

  committed
  731b5db

Commits on Dec 7, 2024

• add find test

  jgbradley1

  committed
  e0865f9

• update cicd step name

  jgbradley1

  committed
  22429fd

Commits on Dec 9, 2024

• tested querying for new schema

  KennyZhang1

  committed
  f06ddfd

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  c290521

• resolved errors from merge conflicts

  KennyZhang1

  committed
  778d67f

• refactored set method to handle cache in new schema

  KennyZhang1

  committed
  7e47f44

• refactored get method to handle cache in new schema

  KennyZhang1

  committed
  2c3d076

Commits on Dec 10, 2024

• force unique ids to be written to cosmos for nodes

  KennyZhang1

  committed
  231ad57

Commits on Dec 13, 2024

• found bug with has and delete methods

  KennyZhang1

  committed
  02bd07e

• modified has and delete to work with cache in new schema

  KennyZhang1

  committed
  d390b51

Commits on Dec 16, 2024

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  committed
  d61e131

• fix the merge from main

  jgbradley1

  committed
  09037b6

• minor typo fixes

  jgbradley1

  committed
  b959e2b

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  committed
  cb98d7a

• update lock file

  jgbradley1

  committed
  9852d8a

• spellcheck fix

  jgbradley1

  committed
  cccd6bd

• fix init function signature

  jgbradley1

  committed
  1f8be94

• minor formatting updates

  jgbradley1

  committed
  07899b8

Commits on Dec 17, 2024

• remove https protocol

  jgbradley1

  committed
  61894a2

• change localhost to 127.0.0.1 address

  jgbradley1

  committed
  070013e

• update pytest to use bacj engine

  jgbradley1

  committed
  82f05c0

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  authored
  3ab938f

• verified cache tests

  KennyZhang1

  committed
  a1571f3

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  7c7f85c

• improved speed of has function

  KennyZhang1

  committed
  aac3c62

• resolved pytest error with find function

  KennyZhang1

  committed
  2eb102a

• added test for child method

  KennyZhang1

  committed
  3fc6001

• make container_name variable private as _container_name

  jgbradley1

  committed
  0036fc4

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  3982a3e

• minor variable name fix

  jgbradley1

  committed
  7480cff

Commits on Dec 18, 2024

• cleanup cosmos pytest and make the cosmosdb storage class operations more efficient

  jgbradley1

  committed
  20d867d

• update cicd to use different cosmosdb emulator

  jgbradley1

  committed
  fb945b2

• test with http protocol

  jgbradley1

  committed
  1cddde1

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  8d34c2d

• added pytest for clear()

  KennyZhang1

  committed
  74320c9

• add longer timeout for cosmosdb emulator startup

  jgbradley1

  committed
  16932b3

• revert http connection back to https

  jgbradley1

  committed
  dbf2be2

• add comments to cicd code for future dev usage

  jgbradley1

  committed
  6a702bf

• set to container and database clients to none upon deletion

  KennyZhang1

  committed
  2ca43ce

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  189b2be

• ruff changes

  KennyZhang1

  committed
  e2b3cf0

• add comments to cicd code

  jgbradley1

  committed
  944b9d3

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  jgbradley1

  committed
  e8e85f0

• removed unneeded None statements and ruff fixes

  KennyZhang1

  committed
  26bba96

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  KennyZhang1

  committed
  45260f3

• more ruff fixes

  KennyZhang1

  committed
  3ba1516

• Update test_run.py

  KennyZhang1

  authored
  cc9e977

• remove unnecessary call to delete container

  jgbradley1

  committed
  0c62cf7

• ruff format updates

  jgbradley1

  committed
  9bac7ef

• Reverted test_run.py

  KennyZhang1

  authored
  9c342c2

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  jgbradley1

  committed
  7b36265

• Merge branch 'add-cosmosdb-to-storage' of github.com:microsoft/graphrag into add-cosmosdb-to-storage

  jgbradley1

  committed
  998e216

• fix ruff formatter errors

  jgbradley1

  committed
  0e50eef

• cleanup variable names to be more consistent

  jgbradley1

  committed
  25c281b

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  committed
  57ae36a

• remove extra semversioner file

  jgbradley1

  committed
  04bf8c6

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  authored
  cf165ac

Commits on Dec 19, 2024

• Merge branch 'main' into add-cosmosdb-to-storage

  jgbradley1

  authored
  b059367

• revert pydantic model changes

  jgbradley1

  committed
  a6a4694

• revert pydantic model change

  jgbradley1

  committed
  143e231

• revert pydantic model change

  jgbradley1

  committed
  6926dfe

• re-enable inline formatting rule

  jgbradley1

  committed
  52dc631

• update documentation in dev guide

  jgbradley1

  committed
  c5b4c78