Reshaping Data
This lesson is called Reshaping Data, part of the R in 3 Months (Fall 2022) course. This lesson is called Reshaping Data, part of the R in 3 Months (Fall 2022) course.
Transcript
Click on the transcript to go to that point in the video. Please note that transcripts are auto generated and may contain minor inaccuracies.
Your Turn
Start with the
enrollment_18_19
data frameselect()
thedistrict_id
variable as well as those about number of students by race/ethnicity and get rid of all others (hint: use thecontains()
helper function withinselect()
)Use
pivot_longer()
to convert all of the race/ethnicity variables into one variableWithin
pivot_longer()
, use the names_to argument to call that variablerace_ethnicity
Within
pivot_longer()
, use the values_to argument to call that variablenumber_of_students
Learn More
The best place to learn more about pivot_longer()
and pivot_wider()
is the pivoting vignette from the tidyr
package.
There’s also a nice article by Gavin Simpson of University College, London about pivoting. That article includes the animations below, made by Garrick Aden-Buie and Mara Averick, that gave a visual demonstration of pivoting.
RStudio has a nice primer on reshaping data, complex with a few exercises.
Finally, a heads up: if you ever see references to the functions gather()
and spread()
, these are the previous iterations of the pivot
functions. They still work (as the tweet below from tidyverse developer Hadley Wickham indicates), but the pivot
functions are, in my view (and the view of many others), much easier to use.
You may have heard a rumour that gather/spread are going away. This is simply not true (they’ll stay around forever) but I am working on better replacements which you can learn about at https://t.co/sU2GzWeBaf. Now is a great time for feedback! #rstats
— Hadley Wickham (@hadleywickham) March 19, 2019
Have any questions? Put them below and we will help you out!
Course Content
142 Lessons
You need to be signed-in to comment on this post. Login.
IBRAH SENINDE • April 22, 2021
Hi David, I typed the following code, but the new data frame still the original structure. What could be the problem? enrollment_by_race_ethnicity_18_19 % select(-contains("grade")) %>% select(-contains("kindergarten")) %>% select(-contains("percent")) %>% pivot_longer(cols = "district_id", names_to = "race_ethnicity", values_to = "number_of_students")
Harold Stanislaw • April 22, 2021
I used select(!contains ("percent")) instead of select(-contains ("percent")), mainly because the helper page listed the exclamation option rather than the minus sign. Are there any differences between the two?
Matt M • November 9, 2021
I only have enrollment_17_18 and enrollment_18_19 files. Where did the math scores files come from that is shown at 5:40 of this lesson? My code matches what's in the Solutions for the Importing Data lesson and I don't think there was anything we downloaded in the Tidy Data lesson.
Alberto Espinoza • September 10, 2022
Hi David, is there a way to enter the name of each column we want to remove within one select(-contains(" ")) argument rather than writing each one separately?
Nadia Chang • November 24, 2022
Hi David! by using pivot_longer it means that it will always arrange the data by 3 columns?