Stack Overflow
Stack Overflow

Questions tagged [gfs]

GFS can mean either Google File System, or "GFS2" which is a cluster file system available in Linux.

GFS can mean either Google File System, or "GFS2" which is a cluster file system available in Linux.

42 questions
121
votes
5 answers

What is an SSTable?

In BigTable/GFS and Cassandra terminology, what is the definition of a SSTable?
knorv
  • 45,461
  • 71
  • 205
  • 289
21
votes
2 answers

Is it possible to append to HDFS file from multiple clients in parallel?

Basically whole question is in the title. I'm wondering if it's possible to append to file located on HDFS from multiple computers simultaneously? Something like storing stream of events constantly produced by multiple processes. Order is not…
maximdim
  • 7,449
  • 3
  • 30
  • 43
9
votes
1 answer

Apache Hadoop vs Google Bigdata

Can any one explain me the key difference between Apache Hadoop vs Google Bigdata Which one is better(hadoop or google big data).
MST
  • 117
  • 1
  • 8
7
votes
2 answers

Google File System Consistency Model

I was reading about GFS and its consistency model but I'm failing to grasp some of it. In particular, can someone provide me with a specific example scenario (or an explanation of why it cannot happen) of: concurrent record append that could…
Simone
  • 2,131
  • 2
  • 16
  • 27
4
votes
0 answers

Node.JS Convert Base64 String into Binary and write to MongoDB GridFS

I have a Base64 string that I am converting to binary like this: var b64string = req.body.image.substr(23);//The base64 has a imageURL var buf = new Buffer(b64string, 'base64'); I need to insert this into MongoDB GridFS. The problem I am having…
Rob
  • 9,671
  • 10
  • 32
  • 53
4
votes
0 answers

Shared storage FS (GFS2, GlusterFS, ?) comparison and test

Problem description: For our application (RHEL 5,6) we use shared storage (EVA) and need to find OCFS2 replacement (not supported on RHEL 6) for several FS shared between nodes (2-7). Current tips are GFS2 and GlusterFS. Usage: System receives…
Jan Kohout
  • 83
  • 1
  • 7
3
votes
0 answers

How do I get access to the noaa rest api of the gfs data

I am interested in getting the GFS forecast data for Europe which is available for free from the following website: https://www.ncdc.noaa.gov/data-access/model-data/model-datasets/global-forcast-system-gfs According this site noaa provides rest apis…
McDizzy
  • 81
  • 5
3
votes
2 answers

White area on matplotlib plot with pygrib data between 359.5 and 360 degrees

What I try is to plot output of the gfs weather model with matplotlib using pygrib to save the data, which is saved in grib files. Nearly everything works fine, the output looks like this: It appears that the program isn't closing the gap between…
Dremet
  • 838
  • 1
  • 7
  • 21
3
votes
2 answers

Google File System block size

Why is block size in GFS 64Mb though it may lead to internal fragmentation when the file size is not in the multiple of 64?
naman wats
  • 31
  • 3
3
votes
0 answers

How to check whether a file is open anywhere in a cluster using GFS and lvm?

I wonder if it is possible to check if a file has already been opened by another node in the same GFS cluster. For example, the fuser command runs cluster-wide in TruCluster. Is it possible to query the lock manager's data via a command or API?
anonymous platypus
2
votes
1 answer

What are some examples of “Appending Operations” as to Random Write Operations?

I have just finished reading the Google File System (GFS) paper. The paper says that GFS is optimized for appending operations rather than random writes. Seeing that this characteristic is emphasized throughout the paper, I take it that it must…
Some Noob Student
  • 12,826
  • 8
  • 58
  • 99
2
votes
1 answer

Persistent Logging in Gnome-Shell-Extension development?

I'm trying around with the Javascript-based bindings to build an own Gnome-Shell-Extension which just embeds an webkitview. But the following 3 lines let completely crash the gnome-shell (top panel disappears, need to re-login to start it again).…
kraiz
  • 1,968
  • 1
  • 19
  • 22
2
votes
2 answers

Why doesn't Hadoop file system support random I/O?

The distributed file systems which like Google File System and Hadoop doesn't support random I/O. (It can't modify the file which were written before. Only writing and appending is possible.) Why did they design file system like this? What are the…
Benjamin
  • 8,715
  • 14
  • 72
  • 121
2
votes
2 answers

GFS/Hadoop master's storage capacity

I'm reading GFS paper but unable to understand one point, does master maintains 64kb of metadata for each replica of file(s) too? Say if master's memory is 8 gb and I store 1000 files of 1 kb each, how much memory it's going to take? if replication…
endurance
  • 31
  • 2
2
votes
1 answer

Is there any abstraction layer to work with GFS or HDFS?

The SQL and NOSQL databases are used by facebook 1.Whether it uses GFS or HDFS or BOTH or some other? 2.What are the different Abstraction application layer available to work on HDFS AND GFS ?? 3.I heard about HADOOP , How Map Reduce works ?…
JAVA Beginner
  • 391
  • 3
  • 15
1
2 3