Stack Overflow
Stack Overflow

Questions tagged [google-cloud-logging]

Google Cloud Logging collects and stores logs from applications and services on the Google Cloud Platform

Introduction

Google Cloud Logging collects and stores logs from applications and services on the Google Cloud Platform:

  • View your logs with the Logs Viewer.
  • Export your logs to Google Cloud Storage, Google BigQuery, or Google Cloud Pub/Sub.
  • Integrate third-party logs from your virtual machine instances by installing the logging agent, google-fluentd.

Cloud Logging saves metadata with every log entry so that you can tell when the log entry was created, from what resource or instance it came, what its severity level is, and so forth. The log entry's original content, or payload, might be saved as a text string or as a structured object, depending on the log type.

Official documentation

345 questions
16
votes
2 answers

Output from Dataproc Spark job in Google Cloud Logging

Is there a way to have the output from Dataproc Spark jobs sent to Google Cloud logging? As explained in the Dataproc docs the output from the job driver (the master for a Spark job) is available under Dataproc->Jobs in the console. There are two…
Thomas Oldervoll
  • 310
  • 3
  • 9
15
votes
3 answers

Regular Expressions in Google Cloud Console Logging

How do you search Google App Engine logs in the new Cloud Console using regular expressions? This blog post suggests you just need to type regex:my.*query to search, but that does not seem to work in the logging console. When I do that, it…
speedplane
  • 14,130
  • 14
  • 78
  • 128
14
votes
1 answer

Show only certain payload field in stackdriver logging webview

We use Stackdriver as our logging agent for a Docker environment that we have. Payload comes in form: structPayload: { container: {…} data: "[2016-11-16 08:15:49] INFO Domain xxx apiKey validation passed." instance: {…} } The web…
jelums
  • 308
  • 2
  • 9
11
votes
1 answer

Error using Google Stackdriver Logging in App Engine Standard python

My Stack: Google App Engine Standard Python (2.7) Goal: To create named logs in Google Stackdriver Logging, https://console.cloud.google.com/logs/viewer Docs - Stackdriver…
Brian B
  • 181
  • 7
11
votes
1 answer

"gcloud app logs tail" shows week old data

I'm trying to stream logs for my Google Cloud Platform application. The first thing I notice is that Google sends about 10 healthchecks per second, at a minimum, so I have to grep -v /health to get any useful info. Is that standard? The second thing…
Kevin Burke
  • 49,451
  • 66
  • 163
  • 280
11
votes
2 answers

How do I map my java app logging events to corresponding cloud logging event levels in GCP Felexible non-compat App Engine?

I am new to GCP AppEngine and I chose the Flexible environment for several reasons. However, I am shocked to find out that the flexible environment's non-"compatible" runtimes appear to not allow me to map my app's logging events to the appropriate…
successhawk
  • 2,251
  • 2
  • 16
  • 34
11
votes
4 answers

Logs are Not Nested Under Requests in Flexible VM

I have a module running in App Engine Classic and another module running in App Engine Flexible. When viewing logs running in App Engine Classic, the log entries are nested within each request. However, when viewing logs running in App Engine…
speedplane
  • 14,130
  • 14
  • 78
  • 128
8
votes
2 answers

Find usage of HTTP Batch in storage api

I got notified that Googles JSON-RPC and Global HTTP Batch Endpoints are deprecated. The affected api is "storage@v1" and "Global Batch Endpoints" in my case. I tried to find, where the depricated api call comes from. But I'm using 24 buckets with…
anon6789
  • 173
  • 1
  • 6
7
votes
0 answers

How do I nest app logs in request log and also tag it with an operation id?

When I use Google App Engine, I can: (A) nest app logs (e.g. the info log below) (B) see the summary of a request log in the top "collapsed" row (C) get tags with an operation id that I can click to easily filter the log stream by Is it possible…
Andrey Fedorov
  • 7,836
  • 20
  • 63
  • 95
7
votes
2 answers

Can't see application log in Google Cloud Logs

How can I view log messages on Google Cloud?: https://console.cloud.google.com/logs This is what I see in the terminal when I run dev_appserver.py (locally running): INFO 2016-05-16 14:00:45,118 module.py:787] default: "GET…
Petrus K.
  • 1,081
  • 5
  • 22
  • 50
7
votes
2 answers

Logging to the Google Cloud in Google Container/Compute Engine with Go

I have a GKE application with 20 nodes running Go. I would like to consolidate all the logs to view in the Google Developers Console log viewer, but I am having 2 problems. I can't get severity filtering, and each newline in my log message starts a…
Michael
  • 436
  • 2
  • 6
  • 19
6
votes
0 answers

Stack Driver logging with SLF4J not logging properly in scala

I am using Logback with SLF4J for Stackdriver logging and I am following the example from Google Cloud. My application is written in Scala and running on Dataproc cluster on GCP. logback.xml have the following contents.
Khalid Shah
  • 2,948
  • 3
  • 15
  • 35
6
votes
1 answer

ChromeOS errors in GCP Logging

I'm seeing errors in StackDriver logging for my Compute instance. The logs are showing repeated issues every hour, creating a lot of noise. I have a Spring Boot API deployed in a container to a VM in Compute Engine using latest stable version of…
TheDubiousDubber
  • 169
  • 1
  • 1
  • 9
6
votes
1 answer

The Google Cloud Logging driver for Docker

I'm not able to authenticate the google cloud driver gcplogs for Docker despite the fact that I've set the env var GOOGLE_APPLICATION_CREDENTIALS to the path/file where the JSON credentials of my service account is. The error message is the…
Layo
  • 667
  • 4
  • 15
6
votes
2 answers

No data in Cloud Monitoring from user-defined metrics in Cloud Logging

I have created 2 user-defined metrics in the Cloud Logging UI. Those metrics show up in Cloud Monitoring, but their graphs are perpetually showing "no graph data found". Are there any steps to troubleshoot this or are there other requirements to…
MDrollette
  • 6,632
  • 1
  • 34
  • 49
1
2 3
…
22 23