Best way to automate the loading of data daily into google big query from SQL Server

Posted on

Question :

Best way to load/copy/insert data from a SQL Server database into a table in Google Big Query on a daily schedule.

I.E data from a table in a SQL Server database to a table in Google Big Query

I was hoping to use SSIS but there are no native data sources/destinations only 3rd party offerings?

I was thinking of using SSIS to create a CSV file then using Google BQ commandline push the CSV file to big query?

Does anyone have any other better suggestions/methods?

Answer :

See this Q&A at Stack Overflow: Migrate SQL Server database to BigQuery

SQLCMD is your friend. It dumps the results of a query into a CSV.

Leave a Reply

Your email address will not be published. Required fields are marked *