python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - csv

AWS boto iterator returns bytes instead of strings: _csv.Error: iterator should return strings, not bytes (did you open the file in text mode?)

We have a large .csv file on an S3 bucket. We want to read it into a dictionary for processing line by line. botocore.response.StreamingBody provides an iterator that you can get with iter_lines(). Ho...
test-img

Stan Ostrovskii

python

amazon-web-services

csv

boto

Votes: 0

Answers: 1

Latest Answer

Worked for me in Python 3 by wrapping iter_lines with str. Try this - csv_reader = csv.DictReader(str(body.iter_lines(chunk_size=1024)), fieldnames=FIELDNAMES) iter_lines returns bytes. Converting it...
test-img

Pankaj Saini

In Interop.Excel, the Worksheet.SaveAs has a CSV option. How can I use this if my *.xlsx file has line feeds in some cells (Alt+Enter)

Writing a c# app to digest some old spreadsheets. When reading an Excel file that contains line feeds (by using Alt-Enter while in a cell), I can't seem to use "Worksheet.SaveAs" to save a ...
test-img

Mike McCoin

excel

csv

excel-interop

linefeed

Votes: 0

Answers: 0

How to download a csv file in Python

I am trying to download a csv file from the url https://qubeshub.org/publications/1220/supportingdocs/1#supportingdocs . the file is Elephant Morphometrics and Tusk Size-originaldata-3861.csv I have t...
test-img

Mossman

python

pandas

csv

Votes: 0

Answers: 3

Latest Answer

Try: import requests url = "https://qubeshub.org/publications/1220/serve/1/3861?el=1&download=1" r = requests.get(url) filename = r.headers["Content-Disposition"].split('&quo...
test-img

Andrej Kesely

Writing a bash script to merge multiple .csv files into one and keeping the same header

I am trying to write a script to merge multiple .csv files(could be an empty file as well) into one .csv file. One way I found was using cat. cat *.csv > outputFile.csv This is working just fine. ...
test-img

tsunade

bash

csv

awk

sed

Votes: 0

Answers: 1

Latest Answer

I would use awk: awk ' FNR == 1 && NR != 1 {next} # skip all headers except the first one /^,*$/ {next} # skip all empty CSV rows !seen[$0]++ # print un...
test-img

Fravadona

Posts

Questions

Blogs

Jobs