Category "google-cloud-platform"

Can not find NVIDIA driver after stop and start a deep learning VM

[TL;DR] First, wait for a couple of minutes and check if the Nvidia driver starts to work properly. If not, stop and start the VM instance again. I created a De

Apache beam FixedWindow doesn't do anything after GroupByKey transform

I built a pipeline which reads from confluent kafka it processes the records and then use side outputs to split them into rejected and approved pcollections, th

constructing reference call with for_each in line

Whats going on? I have created a couple of "google_compute_health_check" on GCP To re-use the health checks, my variables refer to whatever health_check they n

How to remove an image from Artifact Registry automatically

Using gcloud I can list and remove the images I want through those commands: gcloud artifacts docker images list LOCATION/PROJECT-ID/RESPOSITORY-ID/IMAGE \ --

Do GKE clusters need a bastion host?

I'm hosting my frontend & backend servers with GKE (Gcloud Kubernetes Engine) with private nodes in a default VPC network like this gcloud beta container cl

Neo4j Browser Connection

From neo4j browser, when I connect to the database I get the below error. This is purely a cloud based instance. ServiceUnavailable: Could not perform discovery

Dataproc: Can user create workers of different instance types?

scenario: master: x1 machine type workers: x2-machine type, x3-machine type. For the above scenario: AWS EMR instance fleet allows users to create different wor

GCP OPS agent transfer nginx log to cloud logging problem

I followed this link steps to configure nginx.conf and the config.yaml of google-cloud-ops-agent. https://cloud.google.com/stackdriver/docs/solutions/agents/ops

Can GKE filter logs by application?

We are GKE managing several applications: app1 app2 app3 In GCP Error Reporting dashboard, errors are intermixed for all the applications. For example, the err

GKE GCE Ingress FrontendConfig redirect non-www to www

I want to redirect all non-www traffic to www traffic. E.g. mydomain.com to www.mydomain.com GKE Ingress (GCE) uses Frontendconfig. Is there a way to configure

Apache Beam with Dataflow: flag 'ignore_unknown_columns' for WriteToBigQuery not working

I am building a streaming pipeline using Apache Beam (Python SDK version 2.37.0) and Google Dataflow to write some data I receive via Pubsub to BigQuery. I proc

ERROR: (gcloud.app.deploy): The App Engine appspot and App Engine flexible environment service accounts must have permissions on the image

I have the following error when I try to build my app on GCP App Engine, my app environment is ideed a flexible one. But I don't know if my App Engine environme

Vertex AI - how to monitor training progress?

Question Is there a way to monitor the console output of model training progress during the Vertex AI training? Background Suppose we have a Tensorflow/Keras mo

Load balancer giving failed_to_pick_backend with internet network endpoint group

I have a load balancer setup pointing to an external url via internet network endpoint group (internet NEG) Now the load balancer returns 502 status code &

Permission denied to google cloud secret on firebase function deploy

I have a firebase project with a google cloud function like this: export const myFun = functions.region("europe-west1") .runWith({ timeoutSeconds: 10, secre

Google Cloud App Engine (GAE) Flexible: Load Balancer error: backend_connection_closed_before_data_sent_to_client

I have GAE flexible this app.yaml: # [START runtime] runtime: python env: flex entrypoint: gunicorn -b :$PORT ******.wsgi automatic_scaling: min_num_instance

Cannot create GCP VM, public images are empty

When attempting to create a new GCP VM on a new account, the list of public images is empty. If I try to launch an image from the public marketplace, the boot d

quotas are exceeded error while deploying Vertex AI Matching Engine Index

I am following this example notebook and used custom word embeddings of my own. i am getting the following error while deploying the index at this step r = inde

quotas are exceeded error while deploying Vertex AI Matching Engine Index

I am following this example notebook and used custom word embeddings of my own. i am getting the following error while deploying the index at this step r = inde

SCD2 on nested table in GCP big query

I am new to gcp big query. I am trying to model scd2 implementation on both outer and nested table on GCP big query. I would like to know your suggestions wethe