-
Notifications
You must be signed in to change notification settings - Fork 396
feat(BigQuery): Improve prtobuf support #15103
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
0ed9746 to
96592ec
Compare
…oBqSchema, NormalizeDescriptor, StorageSchemaToProtoDescriptor
96592ec to
4ee8de4
Compare
amanda-tarafa
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Some notes and change requests, but I haven't reviewed the code yet.
| <PackageReference Include="ConfigureAwaitChecker.Analyzer" PrivateAssets="All" /> | ||
| <PackageReference Include="Google.Api.Gax.Grpc" /> | ||
| <PackageReference Include="Grpc.Core" PrivateAssets="None" Condition="'$(TargetFramework)'=='net462'" /> | ||
| <PackageReference Include="Google.Apis.Bigquery.v2" VersionOverride="[1.69.0.3783, 2.0.0.0)" /> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm not sure about this. We avoid library cross dependencies. I wonder if it makes more sense to create a separate helper package for this.
I'll review the code as that may be the same regardless of on which package it goes to.
@jskeet @shollyman , thoughts appreciated.
| <PackageVersion Include="NLog" Version="5.5.1" /> | ||
| <PackageVersion Include="Grpc.AspNetCore" Version="2.40.0" /> | ||
| <PackageVersion Include="Microsoft.AspNetCore.Server.Kestrel.Core" Version="2.3.0" /> | ||
| <PackageVersion Include="Grpc.Tools" Version="2.61.0" /> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think this dependency is actually being used.
| <PackageReference Include="xunit" /> | ||
| <PackageReference Include="xunit.runner.visualstudio" /> | ||
| <PackageReference Include="Google.Protobuf" /> | ||
| <PackageReference Include="Grpc.Tools" IncludeAssets="runtime; build; native; contentfiles; analyzers; buildtransitive" PrivateAssets="all" /> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Even though is here, I don't see this dependency being used anywhere.
| namespace Google.Cloud.BigQuery.Storage.V1.IntegrationTests | ||
| { | ||
| [CollectionDefinition(nameof(BigQueryStorageFixture))] | ||
| public class BigQueryStorageFixture : CloudProjectFixtureBase, ICollectionFixture<BigQueryStorageFixture> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We don't need a fixture if it does nothing.
|
|
||
| namespace Google.Cloud.BigQuery.Storage.V1.IntegrationTests | ||
| { | ||
| public class SchemaAdapterUnitTests |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We have separate projects for unit and integration tests. And files are not suffixed with "UnitTests" and "IntegrationTests".
| using System.Linq; | ||
| using System.Text.RegularExpressions; | ||
|
|
||
| namespace Google.Cloud.BigQuery.Storage.V1 |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
For new files we use filed-scopes namespaces. Change here and everywhere.
|
|
||
| namespace Google.Cloud.BigQuery.Storage.V1 | ||
| { | ||
| public static partial class SchemaAdapter |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is this class partial?
|
We are going to take some more time looking into this. We'll keep the PR in draft for now. |
#13873
reference: https://pkg.go.dev/cloud.google.com/go/bigquery/storage/managedwriter/adapt