Questions tagged [throughput]

369 questions
83
votes
4 answers

IOPS versus Throughput

What is the key difference between IOPS and Throughput in large data storage? Does file size have an effect on IOPS? Why?
halilenver
  • 995
  • 2
  • 8
  • 16
43
votes
5 answers

What is the difference between latency, bandwidth and throughput?

I am struggling to draw a clear line between latency, bandwidth and throughput. Can someone explain me in simple terms and with easy examples?
kgs
  • 1,294
  • 2
  • 14
  • 18
40
votes
1 answer

ElasticSearch - high indexing throughput

I'm benchmarking ElasticSearch for very high indexing throughput purposes. My current goal is to be able to index 3 billion (3,000,000,000) documents in a matter of hours. For that purpose, I currently have 3 windows server machines, with 16GB RAM…
Roman
  • 2,020
  • 1
  • 16
  • 20
16
votes
7 answers

Low latency serial communication on Linux

I'm implementing a protocol over serial ports on Linux. The protocol is based on a request answer scheme so the throughput is limited by the time it takes to send a packet to a device and get an answer. The devices are mostly arm based and run Linux…
JustMaximumPower
  • 1,147
  • 3
  • 9
  • 22
15
votes
2 answers

Why does Wi-Fi have so much more bandwidth than Bluetooth?

While researching wireless communication protocols for a potential application, I came across this page on Wikipedia which lists throughput rates for both Bluetooth and 802.11 networks: http://en.wikipedia.org/wiki/List_of_device_bit_rates Here is a…
senbrow
  • 568
  • 1
  • 4
  • 10
14
votes
2 answers

High throughput vs low latency in HDFS

I tried to define what the high throughput vs low latency means in HDFS in my own words, and came up with the following definition: HDFS is optimized to access batches of data set quicker (high throughput), rather then particular records in that…
spacemonkey
  • 18,852
  • 14
  • 39
  • 59
12
votes
2 answers

Getting ProvisionedThroughputExceededException error when iterating over dynamodb table

I am trying to back up a DynamoDB table to S3. Since for some reason doing it through Export on the AWS console does not work and also since the table is not that big I am trying to do it using a boto-based script. Here's the main block of my…
I Z
  • 4,959
  • 15
  • 46
  • 93
10
votes
5 answers

BLE peripheral throughput limit

We are developing a BLE sensor Peripheral to work with an iPad, that requires the following throughput of data on the BLE notification characteristic (no acknowledge) using a TI CC2541 BLE module and a custom profile: One 20 bytes (GATT maximum…
user2683370
  • 101
  • 1
  • 1
  • 4
9
votes
6 answers

What is the difference between latency and response time?

I started to read famous Martin Flowler book(patterns of enterprise application architecture) I have to mention that I am reading the book translated into my native language so it might be a reason of my misunderstanding. I found there…
gstackoverflow
  • 31,683
  • 83
  • 267
  • 574
8
votes
3 answers

How to avoid Boost ASIO reactor becoming constrained to a single core?

TL;DR: Is it possible that I am reactor throughput limited? How would I tell? How expensive and scalable (across threads) is the implementation of the io_service? I have a farily massively parallel application, running on a…
Jon Watte
  • 5,534
  • 4
  • 40
  • 51
8
votes
2 answers

Stack Exchange API compliant request throttle implementation on Google App Engine Cloud infrastructure

I have been writing a Google Chrome extension for Stack Exchange. It's a simple extension that allows you to keep track of your reputation and get notified of comments on Stack Exchange sites. Currently I've encountered with some issues that I can't…
8
votes
1 answer

Jmeter deviation vs throughput

can you give some.explanation on how to interpret deviation vs.throughput? Is 1000++ deviation result means a poor performance of web under test? And how can you also say that the web under test performs good? Is it base on.throughput result?…
ningpra
  • 337
  • 2
  • 4
  • 9
8
votes
4 answers

How to use the cachegrind output to optimize the application

I need to improve the throughput of the system. The usual cycle of optimization has been done and we have already achieved 1.5X better throughput. I am now beginning to wonder if I can utilize the cachegrind output to improve the system's…
rajeshnair
  • 1,387
  • 14
  • 27
7
votes
1 answer

Surprisingly slow insertion to mongodb capped collections

I'm using mongodb's capped collections + tailable cursors as a pubsub engine, using pymongo. (This approach is described here). My environment includes several topics, several publishers, and a few dozen subscribers. This works great, except that…
shx2
  • 53,942
  • 9
  • 107
  • 135
7
votes
1 answer

C Disk I/O - write after read at the same offset of a file will make read throughput very low

Background: I'm developing a database related program, and I need to flush dirty metadata from memory to disk sequentially. /dev/sda1 is volumn format, so data on /dev/sda1 will be accessed block by block and the blocks are adjacent physically if…
Chia
  • 102
  • 5
1
2 3
24 25