-
Notifications
You must be signed in to change notification settings - Fork 0
Description
Plugboard currently includes some builtin components for data egress such as FileWriter and SQLWriter. These components can be configured with a set of fields for which to receive data to output to a storage backend. Support for event based models has been introduced in #46. The implementation there does not provide any event based mechanism for triggering data persistence. As mentioned in the comments on that PR it would be good to have such an event based mechanism to facilitate data egress from purely event based models.
It would be nice to be able to save the output of event-driven components to CSV or similar. We could have event-driven versions of the
FileWriter,SQLWritercomponents, but is there a way we could make these configurable so that they could be used in either mode?
FileWriter and SQLWriter inherit from DataWriter which has an IOController with fields configurable at runtime. A possible implementation could be to allowing passing a set of events as a separate argument to these constructors, and have some generic logic for writing event data which does not require specific implementations (event handler methods) to handle specific events.