Questions tagged [distributed]

Multiple computers working together, using a network to communicate

A distributed system consists of multiple autonomous computers that communicate through a . The computers interact with each other in order to achieve a common goal. A computer program that runs in a distributed system is called a distributed program, and distributed programming is the process of writing such programs.

2066 questions
127
votes
5 answers

How to copy a local Git branch to a remote repo

I've taken the following steps so far: Cloned a remote Git repo Branched the master branch to an experimental edited/tested/committed code in the experimental branch Now, I'm not ready to merge experimental into master. I do however want to push…
Coocoo4Cocoa
  • 41,896
  • 50
  • 148
  • 175
122
votes
13 answers

Real World Use of Zookeeper

I've been looking at Zookeeper recently and wondered whether anybody was using it currently and what they were specifically using it for storing. The most common use case is for configuration information, but what kind of data and how much data are…
Jon
  • 55,763
  • 30
  • 120
  • 149
79
votes
6 answers

In Apache Kafka why can't there be more consumer instances than partitions?

I'm learning about Kafka, reading the introduction section here https://kafka.apache.org/documentation.html#introduction specifically the portion about Consumers. In the second to last paragraph in the Introduction it reads Kafka does it better. By…
almel
  • 5,614
  • 10
  • 36
  • 52
75
votes
7 answers

.net service bus recommendations?

We are in need of a distributed architecture messaging system/service bus with the capability of Publish/Subscribe. Does anyone have any reccomendations for a framework that we can use for .net applications?
Chris Kooken
  • 29,979
  • 14
  • 79
  • 113
57
votes
3 answers

Web Services vs EJB vs RMI, advantages and disadvantages?

My web server would be overloaded quickly if all the work were done there. I'm going to stand up a second server behind it, to process data. What's the advantage of EJB over RMI, or vice versa? What about web services (SOAP, REST)?
Dean J
  • 35,669
  • 13
  • 61
  • 92
52
votes
15 answers

alternative to memcached that can persist to disk

I am currently using memcached with my java app, and overall it's working great. The features of memcached that are most important to me are: it's fast, since reads and writes are in-memory and don't touch the disk it's just a key/value store…
Mike W
  • 727
  • 2
  • 7
  • 10
50
votes
10 answers

What tools do distributed programmers lack?

I have a dream to improve the world of distributed programming :) In particular, I'm feeling a lack of necessary tools for debugging, monitoring, understanding and visualizing the behavior of distributed systems (heck, I had to write my own logger…
jkff
  • 16,670
  • 3
  • 46
  • 79
46
votes
3 answers

Spread vs MPI vs zeromq?

In one of the answers to Broadcast like UDP with the Reliability of TCP, a user mentions the Spread messaging API. I've also run across one called ØMQ. I also have some familiarity with MPI. So, my main question is: why would I choose one over…
Ben Collins
  • 19,889
  • 16
  • 119
  • 182
42
votes
4 answers

The lock supplied is invalid. Either the lock expired, or the message has already been removed from the queue

I'm using a Microsoft azure service bus queue to process calculations and my program runs fine for a few hours but then I start to get this exception for every message that I process from then on. I have no clue where to start since everything runs…
DarthVegan
  • 1,501
  • 4
  • 23
  • 34
40
votes
10 answers

Best way to aggregate multiple log files from several servers

I need a simple way to monitor multiple text log files distributed over a number of HP-UX servers. They are a mix of text and XML log files from several distributed legacy systems. Currently we just ssh to the servers and use tail -f and grep, but…
Claes Mogren
  • 2,046
  • 1
  • 25
  • 31
34
votes
7 answers

Conflict-free Replicated Data Types (CRDT) vs Paxos or Raft

When is it a good idea to use something like CRDT instead of paxos or raft?
Eric des Courtis
  • 4,317
  • 4
  • 21
  • 37
31
votes
1 answer

How scalable is distributed Erlang?

Part A: Erlang has a lot of success stories about running concurrent agents e.g. the millions of simultaneous Facebook chats. That's millions of agents, but of course it's not millions of CPUs across a network. I'm having trouble finding metrics on…
G__
  • 6,688
  • 5
  • 33
  • 51
31
votes
2 answers

What are the essentials of real-time distributed systems?

I am getting my foot into contracting and have had today my first round interview for a contractor position. I have passed it however I was told - being mainly a UI developer - I only covered the basics of what they needed for their backend, and I…
Houman
  • 58,044
  • 75
  • 235
  • 407
31
votes
5 answers

JMeter - Loopback address error when launching jmeter-server on Linux

I'm trying to set up a distributed load testing environment using JMeter. I need to set up the remote clients using something portable like a Linux Live CD, but whenever I attempt to launch jmeter-server in Linux, I receive the following…
Syndog
  • 1,400
  • 4
  • 16
  • 24
31
votes
2 answers

Redis,distributed or not?

Question 1: I know Redis load all the data into memory, thus improving the read/write speed. So, does it mean that if my memory size is 2G, the maximum dataset size should not be larger than 2G? Now my database has a 100G+ data, the memory of my…
wuchang
  • 2,774
  • 5
  • 38
  • 58
1
2 3
99 100