Large .csv files

Beta releases, announcements and anything else that doesn't fit below. Please read the <B>Welcome</B> topic.

Moderator: DPlotAdmin

Post Reply
Phillip Mathis
Posts: 21
Joined: Thu Dec 10, 2009 10:55 pm

Large .csv files

Post by Phillip Mathis »

All,

Once again, the powers that be are dumping more and more data (1500 columns) into a .csv file. As you are aware, Excel cannot handle this much data. I only use a fraction of the data for analysis, but some of the information is past the 256th column.

Does anyone have any suggested programs that will allow me to sift out columns of data without corrupting the original file?
User avatar
DPlotAdmin
Posts: 2312
Joined: Tue Jun 24, 2003 9:34 pm
Location: Vicksburg, Mississippi
Contact:

Post by DPlotAdmin »

My best suggestion is to tell them to stop doing that :)

But a better suggestion might be to update Excel. Excel 2010 will work with 1,048,576 rows by 16,384 columns.
Visualize Your Data
support@dplot.com
jsc
Posts: 222
Joined: Fri Dec 02, 2005 8:56 am

Post by jsc »

Not sure about this, but CSVFileView from Nirsoft might help you open the file, cut some columns, then resave what you need. From the developer, when I asked how many columns it could handle, "There is no official limitation for number of columns in CSVFileView. It depends on the 'ListView' control of Windows that is used to display the csv data."

Nirsoft is at www dot nirsoft dot net.
Phillip Mathis
Posts: 21
Joined: Thu Dec 10, 2009 10:55 pm

Post by Phillip Mathis »

I wish that I had that kind of power :(

They add sophisticated equipment to reduce operator workload, then add more equipment to increase capability. What happed to just aim and shoot.

jsc, I appreciate yor assitance. I will look at the link to see if it fits our needs.
Post Reply