Python

Search

pyspark dropna in one column

ou can use Column.isNull / Column.isNotNull:

df.where(col("dt_mvmt").isNull())

df.where(col("dt_mvmt").isNotNull())
If you want to simply drop NULL values you can use na.drop with subset argument:

df.na.drop(subset=["dt_mvmt"])

Comment

PREVIOUS	NEXT

Code Example
Python :: debug mode: on flask pythin window
Python :: python recursively print directory
Python :: python how to remove commas from string
Python :: pyqt5 keypressevent
Python :: Pandas categorical dtypes
Python :: insert data in table python
Python :: find different between list
Python :: python how to draw a square
Python :: odd or even in python
Python :: pandas pass two columns to function
Python :: best python ide for ubuntu
Python :: python read file from same directory
Python :: what if we multiply a string in python
Python :: scaling data
Python :: Python Program to Find Armstrong Number in an Interval
Python :: back button django template
Python :: python flatten list
Python :: python check if key exists
Python :: select rows from dataframe pandas
Python :: pyspark rdd filter
Python :: numpy 3 dimensional array
Python :: python mode
Python :: add one row to dataframe
Python :: how to get the first key of a dictionary in python
Python :: python datetime format string
Python :: Python t date from a timestamp
Python :: check if variable is of type decimal.Decimal python
Python :: sorting tuples
Python :: python how to count items in array
Python :: python edit global variable in function

Search

PYTHON

pyspark dropna in one column

ADD CONTENT