Questions tagged [distributed]

Multiple computers working together, using a network to communicate

A distributed system consists of multiple autonomous computers that communicate through a . The computers interact with each other in order to achieve a common goal. A computer program that runs in a distributed system is called a distributed program, and distributed programming is the process of writing such programs.

2066 questions
22
votes
8 answers

Distributed Computing Framework (.NET) - Specifically for CPU Intensive operations

I am currently researching the options that are available (both Open Source and Commercial) for developing a distributed application. "A distributed system consists of multiple autonomous computers that communicate through a computer network."…
holsee
  • 1,954
  • 2
  • 26
  • 42
21
votes
4 answers

Keeping distributed databases synchronized in a unstable network

I'm facing the following challenge: I have a bunch of databases in different geographical locations where the network may fail a lot (I'm using cellular network). I need to keep all the databases synchronized but there is no need to be in real time.…
jassuncao
  • 4,595
  • 3
  • 26
  • 35
20
votes
5 answers

Distributed ProjectManagement/Bug Tracking

Now that we have DSCMs, are there any Project Management / Bug Tracking tools that are distributed?
BubbaT
  • 1,802
  • 4
  • 21
  • 24
20
votes
1 answer

What is the dIfference between a distributed system and a clustered system?

Both are defined to be a set of computers that work together and give the end users a perception of a single computer running behind it. So what is the difference here?
batman
  • 4,216
  • 9
  • 44
  • 77
19
votes
7 answers

Search/Find a file and file content in Hadoop

I am currently working on a project using Hadoop DFS. I notice there is no search or find command in Hadoop Shell. Is there a way to search and find a file (e.g. testfile.doc) in Hadoop DFS? Does Hadoop support file content search? If so, how to…
leon
  • 8,725
  • 18
  • 57
  • 73
19
votes
5 answers

What algorithms there are for failover in a distributed system?

I'm planning on making a distributed database system using a shared-nothing architecture and multiversion concurrency control. Redundancy will be achieved through asynchronous replication (it's allowed to lose some recent changes in case of a…
Esko Luontola
  • 71,072
  • 15
  • 108
  • 126
19
votes
9 answers

Horizontal vs Vertical Fragmentation in Distributed Database Management Systems (DDBMS)

In the context in DDBMS, what is the difference between Vertical Fragmentation and Horizontal Fragmentation? Is it such that the relation's extension is fragmented for vertical fragmentation and intension fragmentation is horizontal fragmentation?
DreX
  • 313
  • 1
  • 4
  • 16
19
votes
10 answers

What are the faster Paxos-related algorithms for consensus in distributed systems?

I've read Lamport's paper on Paxos. I've also heard that it isn't used much in practice, for reasons of performance. What algorithms are commonly used for consensus in distributed systems?
Rob Lachlan
  • 13,870
  • 4
  • 46
  • 92
19
votes
5 answers

How do you keep two related, but separate, systems in sync with each other?

My current development project has two aspects to it. First, there is a public website where external users can submit and update information for various purposes. This information is then saved to a local SQL Server at the colo facility. The second…
jeremcc
  • 8,304
  • 10
  • 41
  • 55
18
votes
2 answers

Distributed issue tracker for git with usable Eclipse Mylyn support?

I'm using git for version control but I'm currently lacking a good issue/bug/ticket tracker with Eclipse Mylyn integration. The features I'm looking for: Open source implementation (so that I can add the features I need in the future. GPL, LGPL,…
Mikko Rantalainen
  • 9,490
  • 8
  • 53
  • 86
18
votes
1 answer

Distributing Haskell on a cluster

I have a piece of code that process files, processFiles :: [FilePath] -> (FilePath -> IO ()) -> IO () This function spawns an async process that execute an IO action. This IO action must be submitted to a cluster through a job scheduling system…
felipez
  • 1,144
  • 7
  • 19
17
votes
7 answers

GUI recommandations for eventual consistency?

When using distributed and scalable architecture, eventual consistency is often a requirement. Graphically, how to deal with this eventual consistency? Users are used to click save, and see the result instantaneously... with eventual consistency…
Steve B
  • 34,941
  • 18
  • 92
  • 155
17
votes
5 answers

Distributed Java Compiler

Is there a distributed compiler for Java, analogous to distcc for C/C++?
Boolean
  • 13,126
  • 28
  • 82
  • 127
16
votes
5 answers

Actor-based distributed concurrency libraries for Ocaml and other languages

Question Can anyone recommend a library for Ocaml that offers an actor-based concurrency model for distributed computing? Note here the "actor-based" and "distributed" - I'd like the actor-based model, but also I want seamless handling of…
MGwynne
  • 3,352
  • 1
  • 20
  • 34
16
votes
4 answers

How to determine distributed architecture?

I'm trying to get my head around the thought process when designing a large scale application. Let's say I have a client who needs a new customer website and he is estimating 40,000 orders per day with an already 25,000 user base. When desiging the…
Marco
  • 2,335
  • 3
  • 23
  • 35