Skip to content

.Net: Adds a memory connector for Azure Cosmos DB for NoSQL #6148

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 27 commits into from
May 20, 2024
Merged

.Net: Adds a memory connector for Azure Cosmos DB for NoSQL #6148

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
27 commits
Select commit Hold shift + click to select a range
b7ac7b6
WIP - add Cosmos DB NoSQL Provider
Pilchie May 1, 2024
40a28f2
more WIP
Pilchie May 1, 2024
19ebe03
More WIP
Pilchie May 1, 2024
1c09ecc
Something that compiles
Pilchie May 1, 2024
5f7ad7f
Something sort of working
Pilchie May 2, 2024
7f6bef3
Fix flaky DateTime, and conditionally include embeddings
Pilchie May 2, 2024
4b449fd
Working with client side TOP
Pilchie May 2, 2024
6b58ac4
Back to query
Pilchie May 2, 2024
0a1a1da
Check length too
Pilchie May 2, 2024
ab72061
Serialize MemoryRecord with a derived type
Pilchie May 3, 2024
bcfa393
Update query for 'GetBatchAsync'
Pilchie May 3, 2024
e175661
Cleanup Tests
Pilchie May 7, 2024
86684f6
Handle large batch queries
Pilchie May 7, 2024
3fa098d
Formatting fixes
Pilchie May 7, 2024
2f5eee9
Skip Azure Cosmos DB integration tests
Pilchie May 7, 2024
e8baf68
Review feedback
Pilchie May 17, 2024
1a92fab
Make CosmosSystemTextJsonSerializer internal
Pilchie May 17, 2024
e580918
Apply indent fix
Pilchie May 17, 2024
7d061de
Multi-target to .net8.0 and netstandard2.0
Pilchie May 17, 2024
eae8d20
Fix stutter
Pilchie May 17, 2024
4f16261
Avoid reading stream into string when deserializing
Pilchie May 17, 2024
0807f3a
Optimize single collection lookup
Pilchie May 17, 2024
47a347a
Avoid text writer and serialize directly to stream
Pilchie May 17, 2024
cb27f3a
Remove `applicationName` parameter.
Pilchie May 17, 2024
38fd7d6
Use published package for Cosmos DB
Pilchie May 18, 2024
d246bf4
Fix warnings
Pilchie May 18, 2024
5cf5f87
Use QueryDefinition to avoid injection
Pilchie May 19, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion dotnet/Directory.Packages.props
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -75,7 +75,6 @@
<PackageVersion Include="DuckDB.NET.Data" Version="0.10.2" />
<PackageVersion Include="MongoDB.Driver" Version="2.25.0" />
<PackageVersion Include="Microsoft.Graph" Version="[4.51.0, 5)" />
<PackageVersion Include="Microsoft.Azure.Cosmos" Version="[3.32.3, )" />
<PackageVersion Include="Microsoft.Identity.Client.Extensions.Msal" Version="[2.28.0, )" />
<PackageVersion Include="Microsoft.OpenApi" Version="1.6.14" />
<PackageVersion Include="Microsoft.OpenApi.Readers" Version="1.6.14" />
Expand All @@ -87,6 +86,7 @@
<PackageVersion Include="YamlDotNet" Version="15.1.2" />
<PackageVersion Include="Scriban" Version="5.10.0" />
<!-- Memory stores -->
<PackageVersion Include="Microsoft.Azure.Cosmos" Version="3.41.0-preview.0" />
<PackageVersion Include="Pgvector" Version="0.2.0" />
<PackageVersion Include="NRedisStack" Version="0.12.0" />
<PackageVersion Include="Milvus.Client" Version="2.3.0-preview.1" />
Expand Down
10 changes: 10 additions & 0 deletions dotnet/SK-dotnet.sln
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -310,6 +310,7 @@ EndProject
Project("{9A19103F-16F7-4668-BE54-9A1E7A4F7556}") = "QualityCheckWithFilters", "samples\Demos\QualityCheck\QualityCheckWithFilters\QualityCheckWithFilters.csproj", "{1D3EEB5B-0E06-4700-80D5-164956E43D0A}"
EndProject
Project("{9A19103F-16F7-4668-BE54-9A1E7A4F7556}") = "TimePlugin", "samples\Demos\TimePlugin\TimePlugin.csproj", "{F312FCE1-12D7-4DEF-BC29-2FF6618509F3}"
Project("{9A19103F-16F7-4668-BE54-9A1E7A4F7556}") = "Connectors.Memory.AzureCosmosDBNoSQL", "src\Connectors\Connectors.Memory.AzureCosmosDBNoSQL\Connectors.Memory.AzureCosmosDBNoSQL.csproj", "{B0B3901E-AF56-432B-8FAA-858468E5D0DF}"
EndProject
Global
GlobalSection(SolutionConfigurationPlatforms) = preSolution
Expand Down Expand Up @@ -762,6 +763,12 @@ Global
{F312FCE1-12D7-4DEF-BC29-2FF6618509F3}.Publish|Any CPU.Build.0 = Debug|Any CPU
{F312FCE1-12D7-4DEF-BC29-2FF6618509F3}.Release|Any CPU.ActiveCfg = Release|Any CPU
{F312FCE1-12D7-4DEF-BC29-2FF6618509F3}.Release|Any CPU.Build.0 = Release|Any CPU
{B0B3901E-AF56-432B-8FAA-858468E5D0DF}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
{B0B3901E-AF56-432B-8FAA-858468E5D0DF}.Debug|Any CPU.Build.0 = Debug|Any CPU
{B0B3901E-AF56-432B-8FAA-858468E5D0DF}.Publish|Any CPU.ActiveCfg = Publish|Any CPU
{B0B3901E-AF56-432B-8FAA-858468E5D0DF}.Publish|Any CPU.Build.0 = Publish|Any CPU
{B0B3901E-AF56-432B-8FAA-858468E5D0DF}.Release|Any CPU.ActiveCfg = Release|Any CPU
{B0B3901E-AF56-432B-8FAA-858468E5D0DF}.Release|Any CPU.Build.0 = Release|Any CPU
EndGlobalSection
GlobalSection(SolutionProperties) = preSolution
HideSolutionNode = FALSE
Expand Down Expand Up @@ -867,6 +874,9 @@ Global
{3ED53702-0E53-473A-A0F4-645DB33541C2} = {5D4C0700-BBB5-418F-A7B2-F392B9A18263}
{1D3EEB5B-0E06-4700-80D5-164956E43D0A} = {5D4C0700-BBB5-418F-A7B2-F392B9A18263}
{F312FCE1-12D7-4DEF-BC29-2FF6618509F3} = {5D4C0700-BBB5-418F-A7B2-F392B9A18263}
{6EF9663D-976C-4A27-B8D3-8B1E63BA3BF2} = {5D4C0700-BBB5-418F-A7B2-F392B9A18263}
{925B1185-8B58-4E2D-95C9-4CA0BA9364E5} = {FA3720F1-C99A-49B2-9577-A940257098BF}
{B0B3901E-AF56-432B-8FAA-858468E5D0DF} = {24503383-A8C4-4255-9998-28D70FE8E99A}
EndGlobalSection
GlobalSection(ExtensibilityGlobals) = postSolution
SolutionGuid = {FBDC56A3-86AD-4323-AA0F-201E59123B83}
Expand Down
6 changes: 6 additions & 0 deletions dotnet/src/Connectors/Connectors.Memory.AzureCosmosDBNoSQL/AssemblyInfo.cs
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
// Copyright (c) Microsoft. All rights reserved.

using System.Diagnostics.CodeAnalysis;

// This assembly is currently experimental.
[assembly: Experimental("SKEXP0020")]
Loading
Loading