Questions tagged [ganglia]

Ganglia is a scalable distributed system monitor tool for high-performance computing systems such as clusters and grids. It allows the user to remotely view live or historical statistics (such as CPU load averages or network utilization) for all machines that are being monitored.

Ganglia is based on a hierarchical design targeted at federations of clusters. It relies on a multicast-based listen/announce protocol to monitor state within clusters and uses a tree of point-to-point connections amongst representative cluster nodes to federate clusters and aggregate their state. It leverages widely used technologies such as XML for data representation, XDR for compact, portable data transport, and RRDtool for data storage and visualization.

References

153 questions
25
votes
1 answer

Nagios vs Ganglia

Maybe a strange and green question, however Is there anything that Nagios or Ganglia can do that the other can't? In terms of monitoring, alerts in general. I'm looking for a general solution for my school's computer club, in my mind its like…
laycat
  • 4,153
  • 4
  • 29
  • 41
9
votes
1 answer

How to get a spark job's metrics?

we have a cluster which has about 20 nodes. This cluster is shared among many users and jobs. Therefore, it is very difficult for me to observe my job so that I can get some metrics such as CPU usage, I/O, Network, Memory etc... How can I get a…
diplomaticguru
  • 665
  • 3
  • 8
  • 18
8
votes
1 answer

Unable to view ganglia dashboard

I have made ganglia setup using rpm files, OS: centOS 6.3 Server; httpd gmond and gmetad are running, when i load it in browser am getting "Forbidden error" Forbidden You don't have permission to access /ganglia on this server. I can also see…
Sreedhar GS
  • 2,461
  • 1
  • 19
  • 26
8
votes
1 answer

How set RRD to store for 2 years?

I'm monitoring more than 300 servers, for that I'm using Ganglia. Which use RRD as database to collect and store data related the resources of each server. I would like to have a history about 2 years or more, so reading this article, I think that…
Valter Silva
  • 15,646
  • 48
  • 123
  • 210
8
votes
2 answers

How to get data from ganglia's database

I want use ganglia's data to analyze our cluster, But I don't know where is the ganglia's database. Anyone had do this before?
Julian.zhang
  • 699
  • 1
  • 6
  • 11
7
votes
0 answers

How to store rrd file into influxdb

I'm using ganglia for monitoing. ganglia store its data as rrd file. It is rrd files that stores metrics data on gmetad. Usually the default path is /var/lib/ganglia/rrds/// where each metric is stored in a single rrd file…
Shahriar
  • 11,101
  • 5
  • 66
  • 84
7
votes
3 answers

Is there a api for ganglia?

Hello I would like to enquire if there is an API that can be used to retrieve Ganglia stats for all clients from a single ganglia server?
laycat
  • 4,153
  • 4
  • 29
  • 41
6
votes
3 answers

Sending Data from ganglia to graphite

I am currently collecting monitoring metrics with Ganglia and I would like to show graphs with that data with Graphite. I know such an integration is possible, and I found an article describing how it should be done. I am not quite sure exactly how…
Nadav Leibo
  • 63
  • 1
  • 5
5
votes
1 answer

custom Ganglia cluster graphs - how to show average metric value, rather than total metric value

How do you show mean values in custom graphs, rather than total values? Previously I've had success generating cluster summary graphs by creating custom .php files, as described…
Travis Bear
  • 10,755
  • 5
  • 36
  • 45
4
votes
1 answer

What means load_one metric Y-Axis in Ganglia/RRD Tool?

I'm using Ganglia + RRDTool for monitoring a web farm. Many graphs are very clear but when I see load_one metric, I don't have Y-axis legend. So, what the Y-axis means? Thanks.
adrian
  • 41
  • 1
  • 2
4
votes
4 answers

Amazon Elastic Map Reduce : Listing job flows in command line tools Issue?

I'm new to Amazon web services, I'm trying to run job flows on Amazon elastic map reduce jobs using command line interface tools. I followed the steps from amazon developer guide of this developer guide from aws.But things are not getting clear to…
4
votes
2 answers

Convert .rrd file to json in python

Is there any python module available for converting the .rrd file to json format ?
mraj
  • 128
  • 1
  • 5
4
votes
1 answer

How do I exclude a monitoring server from ganglia reports?

I'm running ganglia in EC2 and reporting works well. I'm running gmetad to monitor a database cluster from an admin reporting instance that is a centralized dashboard for all our systems. I don't want this instance to be included in the monitoring.…
Dave Stern
  • 480
  • 2
  • 7
  • 13
4
votes
7 answers

remote node monitoring recommendations

I am looking for a solution to monitor several (atleast 50) remote nodes. These remote nodes are behind a firewall and hence i cannot poll from a central server for information. the connection needs to be from a Node -> central server. I have used…
Linus
  • 765
  • 4
  • 17
  • 33
3
votes
4 answers

Cannot install Ganglia on EMR 4.0.0

I'm following this guide to install Spark on the latest AMI / EMR cluster: http://docs.aws.amazon.com/ElasticMapReduce/latest/ReleaseGuide/emr-spark-launch.html I'd like to install Ganglia to monitor the cluster so I added Name=Ganglia to the list…
d18s
  • 53
  • 8
1
2 3
10 11