Stack Overflow
Stack Overflow

Questions tagged [dataflow]

Dataflow programming is a programming paradigm in which computations are modeled through directed graphs: nodes are instructions and data flows through the connections between them.

Dataflow programming is a programming paradigm which models programs as directed graphs and calculation proceeds in a way similar to electrical circuits. More precisely:

  • nodes are instructions that takes one or more inputs, perform calculation on them and present the result(s) as output;
  • edges connects inputs and outputs of the instructions -- this way the output of an instruction can be fed directly to the input on another node to trigger another calculation;
  • data "travels" using the directed edges and triggers the instructions as they pass through the nodes.

Often dataflow programming languages are visual, the most prominent example being LabView.

Resources

964 questions
79
votes
10 answers

Dataflow Programming Languages

What is a dataflow programming language? Why use it? And are there any benefits to it?
Anton
  • 11,675
  • 20
  • 59
  • 83
28
votes
1 answer

What is the difference between Dataflow programming and Reactive programming?

I really can't see the difference between them. They are both about data flowing through instructions and the propagation of changes in the input data. I've read this book (authored by Matt Carcki) and it clearly says that they are both the same. On…
Augusto Altman Quaranta
  • 1,366
  • 1
  • 19
  • 30
26
votes
2 answers

What is low latency access of data?

What do you mean by low latency access of data? I am actually confused about the definition of the term "LATENCY". Can anyone please elaborate the term "Latency".
Debashisenator
  • 1,333
  • 3
  • 14
  • 15
21
votes
2 answers

Dataflow anomaly analysis warnings from PMD

I am using Eclipse with the PMD Plug-in (4.0.0.v20130510-1000) and get a lot of those violations: Found 'DD'-anomaly for variable 'freq' (lines '187'-'189'). Found 'DU'-anomaly for variable 'freq' (lines '189'-'333'). In this SO answer, it says that…
brimborium
  • 8,880
  • 9
  • 46
  • 73
19
votes
10 answers

Does this language feature already exist?

I'm currently developing a new language for programming in a continuous environment (compare it to electrical engineering), and I've got some ideas on a certain language construction. Let me explain the feature by explanation and then by…
Pindatjuh
  • 10,215
  • 1
  • 37
  • 65
18
votes
4 answers

How to call TriggerBatch automagically after a timeout if the number of queued items is less than the BatchSize?

Using Dataflow CTP (in the TPL) Is there a way to call BatchBlock.TriggerBatch automatically if the number of currently queued or postponed items is less than the BatchSize, after a timeout ? And better: this timeout should be reset to 0 each time…
Softlion
  • 11,311
  • 10
  • 52
  • 78
18
votes
10 answers

What is the best programming language to implement neural networks?

I'm not looking for a Neural Networks library, since I'm creating new kinds of networks. For that I need a good "dataflow" language. Of course you can do this in C, C++, Java and co. but dealing from scratch with the multithreading etc. would be a…
Blacksad
  • 13,286
  • 14
  • 63
  • 78
17
votes
1 answer

Apparent BufferBlock.Post/Receive/ReceiveAsync race/bug

cross-posted to http://social.msdn.microsoft.com/Forums/en-US/tpldataflow/thread/89b3f71d-3777-4fad-9c11-50d8dc81a4a9 I know... I'm not really using TplDataflow to its maximum potential. ATM I'm simply using BufferBlock as a safe queue for message…
spender
  • 106,080
  • 28
  • 202
  • 324
16
votes
11 answers

Dataflow Programming - Patterns and Frameworks

I just came across the proposed Boost::Dataflow library. It seems like an interesting approach and I was wondering if there are other such alternative frameworks for C++, and if there are any related design patterns. I have not ruled out…
Styrac
14
votes
3 answers

Dataflow setting Controller Service Account

I try to set up controller service account for Dataflow. In my dataflow options I have: options.setGcpCredential(GoogleCredentials.fromStream( new FileInputStream("key.json")).createScoped(someArrays));…
Magda Kiwi
  • 383
  • 2
  • 12
14
votes
3 answers

What is the difference between Data Flow Analysis and Abstract Interpretation

What is the difference between Data Flow Analysis and Abstract Interpretation and are they used for the same purpose? What are the pros and cons of these two relative to each other.
MetallicPriest
  • 25,675
  • 38
  • 166
  • 299
13
votes
1 answer

What are the use cases for TPL Dataflow over Reactive Extensions (Rx)

I'm specifically looking at writing some signal processing algorithms in one or other, or maybe some combination of both of these. Performance isn't a big concern, clarity of expressing intent is more important. I'd be looking to implement the…
stevenrcfox
  • 1,417
  • 14
  • 33
13
votes
3 answers

Lazy data-flow (spreadsheet like) properties with dependencies in Python

My problem is the following: I have some python classes that have properties that are derived from other properties; and those should be cached once they are calculated, and the cached results should be invalidated each time the base properties are…
fortran
  • 67,715
  • 23
  • 125
  • 170
12
votes
0 answers

Is it possible to write a luigi wrapper task that tolerates failed sub-tasks?

I have a luigi task that performs some non-stable computations. Think of an optimization process that sometimes does not converge. import luigi MyOptimizer(luigi.Task): input_param: luigi.Parameter() output_filename =…
DalyaG
  • 2,067
  • 2
  • 12
  • 14
11
votes
8 answers

Graphical dataflow composition framework

I am interested to embed a MathWorks Simulink like type tool into my application. In this embedded tool units are expressed as blocks with their input and output ports and parameters for each block using my block definition files written in any way…
iCode
  • 4,208
  • 9
  • 37
  • 74
1
2 3
…
64 65