Search
 
SCRIPT & CODE EXAMPLE
 

PYTHON

read a large dataframe in pandas

filename='../input/*.csv'
chunksize=10**6
reader = pd.read_csv(filename,chunksize=chunksize, 
                    low_memory=False)    
train=pd.DataFrame()
for i, chunk in enumerate(reader):
    train=pd.concat([train,chunk],axis=0)
Comment
PREVIOUS NEXT
Code Example
Python :: Python - Count the Number of Keys in a Python Dictionary 
Python :: python file location path 
Python :: Print the norm of a vector and a matrix using numpy. 
Python :: from random import choice 
Python :: mean of torch tensor 
Python :: find the area of a circle in python 
Python :: python3 hello world 
Python :: how to count range in django template 
Python :: python list of all characters 
Python :: how to update the kali linux os from python2 to python3 
Python :: python bz2 install 
Python :: pandas to_csv no index 
Python :: how to make a randomized pasword genirator in python 
Python :: format string to 2 decimal places python 
Python :: cast tensor type pytorch 
Python :: how to use variables in string in python 
Python :: bar plot matplotlib 
Python :: fyit download 
Python :: converting month number to month name python 
Python :: list adding to the begining python 
Python :: python read line into list 
Python :: python turn true or false into 0 or 1 
Python :: python game engine 
Python :: how to run python file from cmd in dockerfile 
Python :: discord py get channel id by name 
Python :: how to print palindrome in 100 between 250 in python 
Python :: python merge list into string 
Python :: list to sentence python 
Python :: rename key in python dictionary 
Python :: python print utf-8 
ADD CONTENT
Topic
Content
Source link
Name
6+1 =