Questions tagged [data-stream]

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In Connection-oriented communication, a data stream is a sequence of digitally encoded coherent signals (packets of data or data packets) used to transmit or receive information that is in the process of being transmitted.

In electronics and computer architecture, a data flow determines for which time which data item is scheduled to enter or leave which port of a systolic array, a Reconfigurable Data Path Array or similar pipe network, or other processing unit or block.

Often the data stream is seen as the counterpart of an instruction stream, since the von Neumann machine is instruction-stream-driven, whereas its counterpart, the Anti machine, is data stream driven.

The term "data stream" has many more meanings, such as by the definition from the context of systolic arrays.

Wikipedia: http://en.wikipedia.org/wiki/Data_stream

211 questions
43
votes
10 answers

Is list better than vector when we need to store "the last n items"?

There are a lot of questions which suggest that one should always use a vector, but it seems to me that a list would be better for the scenario, where we need to store "the last n items" For example, say we need to store the last 5 items…
Rahul Iyer
  • 17,034
  • 15
  • 76
  • 159
43
votes
3 answers

Streaming data with Node.js

I want to know if it is possible to stream data from the server to the client with Node.js. I want to post a single AJAX request to Node.js, then leave the connection open and continuously stream data to the client. The client will receive this…
Saif Bechan
  • 14,061
  • 22
  • 74
  • 122
16
votes
5 answers

FIFO/Queue buffer specialising in byte streams

Is there any .NET data structure/combination of classes that allows for byte data to be appended to the end of a buffer but all peeks and reads are from the start, shortening the buffer when I read? The MemoryStream class seems to do part of this,…
Deanna
  • 22,939
  • 7
  • 65
  • 142
15
votes
4 answers

Disk-persisted-lazy-cacheable-List ™ in Scala

I need to have a very, very long list of pairs (X, Y) in Scala. So big it will not fit in memory (but fits nicely on a disk). All update operations are cons (head appends). All read accesses start in the head, and orderly traverses the list until…
Hugo Sereno Ferreira
  • 8,665
  • 6
  • 41
  • 88
15
votes
7 answers

spark ssc.textFileStream is not streamining any files from directory

I am trying to execute below code using eclipse (with maven conf) with 2 worker and each have 2 core or also tried with spark-submit. public class StreamingWorkCount implements Serializable { public static void main(String[] args) { …
Kaushal
  • 2,981
  • 3
  • 27
  • 44
12
votes
2 answers

Java based library for sensor data collection

I'm looking for an embeddable Java library that is suitable for collecting real-time streams of sensor data in a general-purpose way. I plan to use this to develop a "hub" application for reporting on multiple disparate sensor streams, running on a…
mikera
  • 101,777
  • 23
  • 241
  • 402
9
votes
1 answer

What is shards in kinesis data stream

What is shards in kinesis data stream and partition key. I read aws documents but I don't get it. Can someone explain it in simple terms?
Desp
  • 95
  • 1
  • 3
8
votes
1 answer

Transform data stream using processor implemented via Flow APIs

I was going through the Community#DOC-1006738 from Oracle related to the concurrency concepts of Flow.Publisher and Flow.Subscriber. There on one can find the Sample code to transform data stream using processor which has these two lines of code,…
Naman
  • 23,555
  • 22
  • 173
  • 290
8
votes
0 answers

How to correctly stream data via Bluetooth to Android

I'm in the process of developing an application which reads data from a DAQ that streams its data over Bluetooth. The packet sizes can change, as can the sampling rate (1Hz - 512Hz), and I'm able to loop through and read the data off the device…
ritchie888
  • 451
  • 3
  • 11
  • 25
7
votes
4 answers

What's the use cases of Streams and Firehose?

I am working on an application that will read and analyze the logs of payment transactions. I know I will use Kinesis Analytics as per my requirements, which takes the input from the Data Streams and Firehose. But I am having trouble deciding which…
7
votes
3 answers

Hash algorithm for dynamic growing/streaming data?

Are there any algorithms that you can continue hashing from a known hash digest? For example, the client upload a chunk of file to ServerA, I can get a md5 sum of the uploaded content, then the client upload the rest of the file chunk to ServerB,…
est
  • 10,087
  • 10
  • 63
  • 112
6
votes
2 answers

Apache Flink - Send event if no data was received for x minutes

How can I implement an operator with Flink's DataStream API that sends an event when no data was received from a stream for a certain amount of time?
madhairsilence
  • 3,473
  • 1
  • 30
  • 60
6
votes
1 answer

Get file name of DataStream with Flink

I have a streaming process with flink working with csv files in a single path. I want to know the file name of each processed file. I am currently using this function to read csv files into the path(dataPath). val recs:DataStream[CallCenterEvent] =…
5
votes
4 answers

Flutter DataStream not closing and re-building properly. [Bad state: Stream has already been listened to.]

Okay, so I'm aware that a stream can be manufactured to listen to a stream more than once, using a broadcast system, but that's specifically NOT what I'm trying to do here. I'm also editing this as the one answer I have received isn't currently able…
ArthurEKing
  • 73
  • 1
  • 10
5
votes
1 answer

what does this mean 'Parsing a text file or data stream' and does it apply with serializables

This is my second post and I am getting used to the function of things on here now! this is more of a theory question for computer science but, my question is what does this mean? 'Parsing a text file or data stream' This is an assignment and the…
1
2 3
14 15