Stack Overflow
Stack Overflow

Questions tagged [google-cloud-bigtable]

Google Cloud Bigtable is a fast, fully managed, massively scalable NoSQL database service designed for applications requiring terabytes to petabytes of data. Cloud Bigtable doesn't require you to sacrifice speed, scale, or cost efficiency when your applications grow.

Google Cloud Bigtable is a fast, fully managed, massively scalable NoSQL database service designed for applications requiring terabytes to petabytes of data. Cloud Bigtable doesn't require you to sacrifice speed, scale, or cost efficiency when your applications grow.

Cloud Bigtable is exposed to applications through a supported extension to the Apache HBase 1.0 Java library.

515 questions
137
votes
9 answers

Google Cloud Bigtable vs Google Cloud Datastore

What is the difference between Google Cloud Bigtable and Google Cloud Datastore / App Engine datastore, and what are the main practical advantages/disadvantages? AFAIK Cloud Datastore is build on top of Bigtable.
Andrei F
  • 3,759
  • 6
  • 28
  • 60
22
votes
6 answers

Google Bigtable vs BigQuery for storing large number of events

Background We'd like to store our immutable events in a (preferably) managed service. Average size of one event is less than 1 Kb and we have between 1-5 events per second. The main reason for storing these events is to be able to replay them…
Johan
  • 29,394
  • 26
  • 118
  • 185
17
votes
1 answer

Price aside, why ever choose Google Cloud Bigtable over Google Cloud Datastore?

If I have a use case for both huge data storage and searchability, why would I ever choose Google Cloud Bigtable over Google Cloud Datastore? I've seen a few questions on SO and other sides "comparing" Bigtable and Datastore, but it seems to boil…
zeBugMan
  • 175
  • 1
  • 9
12
votes
2 answers

Which HBase connector for Spark 2.0 should I use?

Our stack is composed of Google Data Proc (Spark 2.0) and Google BigTable (HBase 1.2.0) and I am looking for a connector working with these versions. The Spark 2.0 and the new DataSet API support is not clear to me for the connectors I have…
ogen
  • 712
  • 1
  • 6
  • 20
11
votes
3 answers

Google Cloud Bigtable backup and recovery

I am new to Google Cloud Bigtable and have a very basic question as to whether the cloud offering protects my data against user error or application corruption? I see a lot of mention on the Google website that the data is safe and protected but…
JStorage
  • 229
  • 2
  • 10
9
votes
2 answers

BigQuery with BigTable connection, cannot execute any query

I want to generate some reports based on the data in BigTable. For that I wanted to create a query which will get the latest data from the BigTable and pass it over onto the data studio report. Now the problem is that when I create a BigTable…
Kris
  • 5,465
  • 2
  • 25
  • 45
8
votes
1 answer

Google Cloud Bigtable Durability/Availability Guarantees

I would like someone from Google to provide some guidelines on the durability and availability guarantees provided by the Cloud Bigtable service. Here is my understanding so far: The fact that the minimum cluster requires 3 nodes suggests that, at…
Tav
  • 136
  • 5
8
votes
1 answer

Google Cloud Bigtable coprocessor support

Google Cloud BigTable doesn't support coprocessors: Coprocessors are not supported. You cannot create classes that implement the interface org.apache.hadoop.hbase.coprocessor. https://cloud.google.com/bigtable/docs/hbase-differences I can…
Sergei Rodionov
  • 3,078
  • 5
  • 21
  • 40
7
votes
0 answers

BigTable: Improve BigTable queries performance using the Python client

We are facing some performance issues while querying BigTable. We are getting about 500 rows/sec in the monitoring dashboard when querying for about 1400 rows, and it takes about 1.6 seconds when running the next snippet in a machine in the same…
josemazo
  • 321
  • 1
  • 5
7
votes
1 answer

How to connect to Bigtable Emulator from a GoLang application? How to use it?

I am trying to use BigTable Emulator. I have never used it before. I followed the documentation but not able to understand, How to connect an application to Emulator. How to set BIGTABLE_EMULATOR_HOST environment variable. Please help by…
yogesh_desai
  • 379
  • 3
  • 18
6
votes
2 answers

Trying to simulate cell level TTL in bigtable but whole column family data is getting removed by garbage collection

created a table with the following rules: so with this, data should expire after 1 second (as per docs) async function createTable() { console.log("Creating Table"); const options = { families: [ { name:…
Sumeet.Jain
  • 1,207
  • 5
  • 19
6
votes
1 answer

Maintain data in Google Bigtable for longer periods

We have use-cases where we would like to store a large volume of data in Google Bigtable for long periods: during product development for performance tuning for demos We need to store the data but we don't really need it to be "online" all the…
Sachin Hejip
  • 63
  • 4
6
votes
1 answer

How to handle BigTable Scan InvalidChunk exceptions?

I am trying to scan BigTable data where some rows are 'dirty' - but this fails depending on the scan, causing (serialization?) InvalidChunk exceptions. the code is as follows: from google.cloud import bigtable from google.cloud import…
Josh Reuben
  • 279
  • 1
  • 7
6
votes
2 answers

How to connect to a running bigtable emulator from java

I am trying to use the bigtable emulator from gcloud beta emulators. I launch the emulator, grab the hostname (localhost) and port (in this instance 8885) gcloud beta emulators bigtable start Executing:…
user1568967
  • 1,596
  • 2
  • 13
  • 18
6
votes
1 answer

Bigtable / HBase: Rich column family vs a single JSON Object

I want to store quite a big amount of data on Google Cloud Bigtable (A few PetaBytes) for serving purposes. I plan to access the data using the primary key, sometimes by a key-prefix-query. No data updates are planned. Only appends to existing…
Forepick
  • 567
  • 1
  • 3
  • 27
1
2 3
…
34 35