Stack Overflow
Stack Overflow

Questions tagged [ganglia]

Ganglia is a scalable distributed system monitor tool for high-performance computing systems such as clusters and grids. It allows the user to remotely view live or historical statistics (such as CPU load averages or network utilization) for all machines that are being monitored.

Ganglia is based on a hierarchical design targeted at federations of clusters. It relies on a multicast-based listen/announce protocol to monitor state within clusters and uses a tree of point-to-point connections amongst representative cluster nodes to federate clusters and aggregate their state. It leverages widely used technologies such as XML for data representation, XDR for compact, portable data transport, and RRDtool for data storage and visualization.

References

153 questions
3
votes
1 answer

Add applications (Ganglia, Impala, Hunk) to running EMR Cluster

I created an EMR cluster but I forgot to add some applications that I'd like to play around with. It's a "long running" cluster so I cannot just create a new one. How can I add Ganglia, Impala, and Hunk to a running cluster? Also, is there anything…
Marsellus Wallace
  • 15,881
  • 21
  • 79
  • 143
3
votes
0 answers

How to interpret Ganglia cpu wio chart

I am trying to understand what are performance issues with our system The CPU wait IO says Max is 255m and now is 9.5m What is this m , how to interpret the stats
user2230605
  • 2,199
  • 4
  • 25
  • 37
3
votes
1 answer

Ambari dashboard retrieving no statistics

I have a fresh install of Hortonworks Data Platform 2.2 installed on a small cluster (4 machines) but when I login to the Ambari GUI, the majority of dashboard stats boxes (HDFS disk usage, Network usage, Memory usage etc) are not populated with any…
ScottFree
  • 472
  • 5
  • 16
3
votes
2 answers

Spark Monitoring with Ganglia

I'm testing the framework Apache Spark. I need monitoring some aspects about my cluster like network and resources. Ganglia looks like a good option for what I need. Then, I found out that Spark has support to Ganglia. On the Spark monitoring…
Danilo Pinto
  • 63
  • 1
  • 4
3
votes
1 answer

what exactly is "Memory used" (versus "Memory cached") in ganglia?

What exactly is "Memory Used" in ganglia (versus "Memory Cached")? Does "Memory Used" refer to physical memory, virtual memory, resident memory, or shared memory? Does it include memory used by code, data, and shared memory among tasks? What about…
morfys
  • 1,719
  • 2
  • 21
  • 28
3
votes
3 answers

Monitoring disk I/O on hadoop cluster with ganglia

I deployed hadoop 2 (HDP2), and would like to get the disk i/o metrics of my slave nodes in ganglia. I didn't find any relevant metric so far. What metric do you suggest to use or to add to ganglia ? Thanks
mathieu
  • 2,040
  • 2
  • 23
  • 40
2
votes
1 answer

Ganglia fails communicate between meta and monitored nodes

We've been advised to try Ganglia as a monitoring tool for our cluster. The installation was pretty smooth but I have a problem with connectivity between gmond and gmetad. Meta node is able to see(on web) only local gmond host (itself). The…
Greg Dan
  • 379
  • 2
  • 8
  • 14
2
votes
1 answer

How can I monitor/generate aggregated report of CPU/RAM utilization from code for spark application?

I know ganglia can be used to monitor resource utilization in a cluster like Spark. But it will provide an overall report for my application. But if I want to know how much resource is being utilized by a specific portion of my code, is there any…
user3086871
  • 511
  • 6
  • 20
2
votes
0 answers

ganglia is missing some metrics of some nodes

I use ganglia to monitor performance-related metrics of cluster nodes. I installed gmond python modules for richer functionality. However, some metrics from some nodes are missing (i.e. disk_*_read_bytes_per_sec) There are a few nodes that work as…
syko
  • 2,767
  • 3
  • 22
  • 40
2
votes
1 answer

what is 'st' the param in ganglia web url

i redirected to this url when i want json data from graph …
Ravindhar Konka
  • 143
  • 2
  • 13
2
votes
0 answers

Point Graphite to Ganglia RRDs

I am following the instructions "Point Graphite to Ganglia RRDs" at https://github.com/ganglia/monitor-core/wiki/Ganglia-Graphite to analyze Ganglia RRD files. My rrdcached was running. I see the navigation tree of metrics. If I select a metric, I…
David Y.
  • 21
  • 1
  • 2
2
votes
2 answers

ganglia vs sensu vs icinga vs nagios

I am looking for a monitoring tool for hosts and services running under AWS. We are not looking for paid solutions, but we would like to run a monitoring server. In our cloud, we will launch and remove services (web servers, queues, etc) and hosts.…
pabloa98
  • 562
  • 6
  • 16
2
votes
1 answer

Cassandra production Monitoring

I am new to Cassandra and trying to setup monitoring to Cassandra production cluster. Apart from monitoring using nodetool commands in crontab what else is recommended? is it a general practice to use ganglia for monitoring? can you direct me to a…
kotaru chakravarthy
  • 105
  • 1
  • 6
2
votes
2 answers

EC2 Spark can not connect to Ganglia

I am trying to investigate all the possible methods how to monitor Spark. Ganglia seems to me as very interesting option, but unfortunately I have problem to set it up. Particularly I am using Spark and it's build in command ./spark-ec2 with option…
ziky90
  • 2,347
  • 4
  • 27
  • 46
2
votes
0 answers

Ganglia - Default graphs not showing up

I am using Ganglia UI to monitor a bunch of distributed clusters. All the graphs are working except the default graphs (load, memory, cpu and network). Ganglia gmond is not storing those information in rrd. This is the error I am getting while…
Himanshu
  • 1,373
  • 4
  • 23
  • 35
1
2
3
…
10 11