Convert BigQuery RowIterator to Pandas DataFrame

When querying data in Google BigQuery using the Python client library, the result is returned as a RowIterator object. While this is efficient for streaming results, most data scientists and engineers prefer working with Pandas DataFrames for further analysis.

Step 1: Install Required Libraries

pip install google-cloud-bigquery pandas

Step 2: Execute the Query and Convert the Result

from google.cloud import bigquery
import pandas as pd

# Initialize BigQuery client
client = bigquery.Client()

# Example query
query = "SELECT name, age FROM `project.dataset.table`"
query_job = client.query(query)

# This gives you a RowIterator
row_iterator = query_job.result()

# Convert to DataFrame
df = row_iterator.to_dataframe()

print(df.head())

Also Read:

Cloud Migration Costs