Sparklyr - change column names in a Spark frame

Question

df <- data.frame(old1 = LETTERS, old2 = 1)
df_tbl <- copy_to(sc,df,"df")

df_tbl <- df_tbl %>% dplyr::rename(old1 = new1, old2 = new2)

returns:

> head(df_tbl)
Error: `new1`, `new2` contains unknown variables

Is there an easy way to change column names using Sparklyr?

+3

Igor 04 Aug 17 at 20:20

1 answer

user8371915 · Accepted Answer · 2017-08-04T20:49:37+0000

First of all you mixed order:

df_tbl %>% rename(new1 = old1, new2 = old2)

but with Sparklyr you have to use select

:

df_tbl %>% select(new1 = old1, new2 = old2)