R - How to create a new column with spark_apply

Search

R

in spark to adding new column


+-----+------+
|EmpId|Salary|
+-----+------+
|111  |50000 |
|222  |60000 |
|333  |40000 
+-----+------+

Comment

How to create a new column with spark_apply

library(sparklyr)
sc <- spark_connect(master = "local")

df <- sdf_len(sc, 100)
df <- sdf_repartition(df, 5) %>%
    spark_apply(function(df){
        df['new']<-df$id * 10
        df
    })

Comment

PREVIOUS	NEXT

Code Example
R :: logistic inverse CDF in r
R :: end the program in r
R :: cut function R
R :: gsub function r
R :: Significance codes
R :: excel date format r
R :: dummify data in r
R :: vector with real numbers R
R :: how the print backslash in r
R :: meaning of %% R
R :: r for data science
Rust :: rust lang sleep
Rust :: rust create directory
Rust :: rust sleep
Rust :: rust .0
Rust :: rust write to file
Rust :: calculator in rust
Rust :: armanriazi•rust•vec
Rust :: rust comment types
Rust :: armanriazi•rust•error•[E0507]: cannot move out of `self.step` which is behind a mutable reference self.curr += self.step;
Rust :: hwllo world in rust
Rust :: armanriazi•rust•error•[E0046]: not all trait items implemented, missing: `summarize_author`
Rust :: armanriazi•rust•t•opt•?
Rust :: Rust Options Some None using closures
Rust :: rustlang get substring
Lua :: how to delete a key in a table lua
Lua :: luau how to loop through all players
Lua :: roblox brick color
Lua :: Startswith function in lua
Lua :: lua string split

Search

R

in spark to adding new column

How to create a new column with spark_apply

ADD CONTENT