Skip to content

Multiple Inputs & Outputs #30

@nickzoic

Description

@nickzoic

We've kind of gotten away with having a single input queue and output queue for each node.
However, this has led to some weird behavioural differences:

  • For ProductPlugins, eg: Join, there must be exactly two inputs and they are consumed separately
  • For everything else, there can be multiple inputs and they are consumed indiscriminately

This might not seem like much of a difference but it adds significant weirdness to the pipeline code.
Maybe it'd make sense for nodes to have 0, 1 or 2 input "ports" and have this visible in the UI.

Also, a lot of "filter" operations, eg: selecting records matching a pattern, could use a second output for
"failures". Effectively an "else" output. Sure you can add another complementary filter node but there's always
the risk that you'll miss something. Plus there's no output from writers. So maybe it'd make sense for nodes to have 0, 1 or 2 output "ports" and have this visible in the UI.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions