Skip to content

Duplicated properties on massive parallel batch upload #136

@1pxone

Description

@1pxone

The problem:

When batch upload used in parallel without "blank shot" of upcoming data in some scenarios (massive paralleled batch) may cause duplicated properties.

There are at least two possible solutions:

  • Properties deduplication query called with debounce mechanisms (call dedupe after all batches out)
  • Somehow apply throttling when batch upload occur for the first batch (this may lead to queues-based solution and will be more complex)

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't workingcoreThis issue or pull request is related to Core

    Type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions