python - SQL query output to .csv

0
votes

I am running SQL query from python API and want to collect data in Structured(column-wise data under their header).CSV format.

This is the code so far I have.

sql = "SELECT id,author From researches WHERE id < 20 " 
cursor.execute(sql)
data = cursor.fetchall()
print (data)
with open('metadata.csv', 'w', newline='') as f_handle:
    writer = csv.writer(f_handle)
    header = ['id', 'author']
    writer.writerow(header)
    for row in data:
        writer.writerow(row)

Now the data is being printed on the console but not getting in .CSV file this is what I am getting as output:

What is that I am missing?

3
pythonapicsvexport-to-csv
What problem are you having? Python has csv.writer to write CSV to a file, so all you have to do is read the SQL results into a list. - Barmar
What have you tried so far ? - Mahesh Karia
The problem is I don't know how to do it. Can you help me the sample code based on this query? - Hayat
I have edited the code. Now I am able to get the Data but to write it to a .csv file I am facing difficulty. - Hayat
Check out the examples in the docs. I'm not sure, but you might be able to write rows from the cursor directly into a csv.writer(). - user8651755

3 Answers

2
votes

Here is a simple example of what you are trying to do: 

import sqlite3 as db
import csv

# Run your query, the result is stored as `data`
with db.connect('vehicles.db') as conn:
    cur = conn.cursor()
    sql = "SELECT make, style, color, plate FROM vehicle_vehicle"
    cur.execute(sql)
    data = cur.fetchall()

# Create the csv file
with open('vehicle.csv', 'w', newline='') as f_handle:
    writer = csv.writer(f_handle)
    # Add the header/column names
    header = ['make', 'style', 'color', 'plate']
    writer.writerow(header)
    # Iterate over `data`  and  write to the csv file
    for row in data:
        writer.writerow(row)
1
votes
import pandas as pd

import numpy as np

from sqlalchemy import create_engine

from urllib.parse import quote_plus

params = quote_plus(r'Driver={SQL Server};Server=server_name;                        Database=DB_name;Trusted_Connection=yes;')

engine = create_engine("mssql+pyodbc:///?odbc_connect=%s" % params)

sql_string = '''SELECT id,author From researches WHERE id < 20 '''

final_data_fetch = pd.read_sql_query(sql_string, engine)

final_data_fetch.to_csv('file_name.csv')

Hope this helps!

0
votes

You can dump all results to the csv file without looping:

data = cursor.fetchall()
...
writer.writerows(data)