Category "google-bigquery"

Avoid formatting comments

Is there anyway to avoid formatting the comments? To reproduce, paste below example SQL code to BQ: --important comment on table info select * from mytable1;

Bigquery An internal error occurred and the request could not be completed. Error: 60909208

I'm trying to run the following query but it keeps throwing this error after it keeps running for around 1 to 2 hours An internal error occurred and the reques

Syntax error: Unexpected keyword UNNEST at [12:8] while using unnest

I want to use unnest in the following function to use INkeyword but it is throwing error unexpected keyword UNNEST while using unnest. CREATE TEMPORARY FUNCT

Array specified for non-repeated field, Can I load JSON Format "{a:[1,2,3]}" into BQ

I want upload JSON data which is in the below form {a:[1,2,3]}, into BigQuery, I am familiar Record Field-Type with repeat Mode. I am getting error Array spe

SAS BigQuery Logistic Regression

Is there a way I can match SAS logistic regression results with BigQuery ML logistic regression results (coefficient / intercept values for same data)?

Firebase - Perform Analytics from database/firestore data

I am using Firebase as my authentication and database platform in my React Native-Expo app. I have not yet decided if I will be using the realtime-database or F

Need help creating schema for loading CSV into BigQuery

I am trying to load some CSV files into BigQuery from Google Cloud Storage and wrestling with schema generation. There is an auto-generate option but it is poor

Data Transfers to Big Query error "Error while reading data, error message: JSON table encountered too many errors, giving up. Rows: 1; errors: 1"

Hello im currently trying to establish daily data transfers from Google Cloud Storage to Big Query tables. Theses tables are just meant to store raw data (JSON

BigQuery - extract the most used tables

I'm using the Google BigQuery and looking on the default audit dataset. I know that this dataset contains various data about the queries the users are running.

Big Query - Table 'Copy' from Console Not working, But the same works fine from bq CLI

Across project level when trying to Copying the tables in big query, it works fine using bq CLI but not from Console. Big Query --> Project:Dataset.tableXYZ

Number of rows affected by BigQuery query

I run daily commands to insert new records into a BigQuery table, and would like to log how many records get inserted each day. I create a QueryJob object that

Is there a way to upload the byte type created with zlib to Google bigquery?

I want to input string data into bigquery by implied by pyhton's zlib library. Here is an example code that uses zlib to generate data: import zlib import p

How do I produce a new column with values based on a Partition of one column while also based on the values of two additional columns (BigQuery)?

I have a table that records all the different statuses for a list of Jobs with timestamps. So the ID column has many Ids that appear several times as their stat

GBQ Transpose Dynamically without Execute Immediate

Hi All trying to figure out a way to transpose data in columns dynamically. In the data the distinct number of Traits will increase/decrease. I know I can hardc

BigQuery Results to Panda DataFrame in Chunks

I am trying to save the results of a BigQuery query to a Panda DataFrame using bigquery.Client.query.to_dataframe() This query can return millions of rows. Gi

GBQ Execute Immediate into a CTE

I am building an application/script for users that do not have write access to the database. Normally I would use Execute Immediate and save that result into a

TensorFlow SavedModel output output had no dimensions when loading a model with BigQuery ML

I'm trying to use BigQuery ML to load a saved tensorflow model to make predictions. However when I run the query that read the saved model in GCS I got the foll

BigQuery standard SQL: how to group by an ARRAY field

My table has two columns, id and a. Column id contains a number, column a contains an array of strings. I want to count the number of unique id for a given arra

Discrepancy in Daily user engagement between Firebase Analytics dashboard and BigQuery

I'm trying to develop a query against Firebase Analytics data linked to BigQuery to reproduce the "Daily user engagement" graph from the Firebase Analytics dash

How to avoid double counting while using SQL

I have a transaction table which contains date, transaction_id and category (it is a sales table of clothes). It looks like this: ndate transaction_id category