I have a csv file that is 133mb in size and has over 1.3 million lines of data. Each line of data has its own lat/long and I was wondering what would be the best way to display those points based off the lat/longs in ArcGIS Desktop 10 and ultimately turn it into a point shapefile?
So far I have tried the "Make XY Event Layer" tool but that keeps failing...
ERROR 000212: Cannot create XY event source Failed to execute (MakeXYEventLayer).
The csv file is properly formatted and the lat/long fields are numeric so I have no idea why it keeps crashing.
Here is what the first 2 lines of my CSV look like, the first line is what should be the header:
"LAT","LONG","CUSTOMER_MASTER_ID","STORE_NBR","TRANSACTION_DT","SKU_DIVISION_ID","SKU_DEPARTMENT_ID","SKU_CLASS_ID","SKU_CATEGORY_ID","SKU_NBR","SALES_AMT"
"32.363544","-110.969778","2000000792627","2940","8/11/2010","2060","3920","5120","84021","5127866","13.99"
Any ideas?
Answer
Ths may be a bit more complicated, but if my two-cents are worth anything (and if you're using MS Office products), I'd recommend importing your .csv into an MS Access .mdb database as a table. (Note: there is a 2GB size limit for an .mdb database).
You can then add that Access .mdb table into your ArcMap document and do a right-click > "Display x,y data":
By keeping your data in a database and reading from that table to display your x,y data points, you can make changes to your data and those changes will automatically be reflected in the x,y data points the next time you refresh the map display instead of having to create a new shapefile or layer view every time. This also seems like a more robust way to manage such a large amount of data.
No comments:
Post a Comment