Importing Data

fyi - I was able to download both .xlsx files, but when creating objects with the 17-18 data I got this error message: > download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-17-18.xlsx",

          destfile = "data-raw/enrollment-17-18.xlsx")

trying URL 'https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-17-18.xlsx' Content type 'application/octet-stream' length 47088 bytes (45 KB) downloaded 45 KB

> enrollment_17_18 %

clean_names() Error: Evaluation error: zip file 'data-raw/enrollment-17-18.xlsx' cannot be opened.

I was able to download the file to my computer, then copy it into the 'data-raw' folder manually and turn it into an object with R script successfully. So I'm moving on with the assignment but thought you would want to know.

Jody Oconnor

I did not have the same problem with the 18-19 data.

David Keyes

Thanks for the heads up! Did you try adding mode = "wb" (see orange box above)? That may help with this issue.

Jody Oconnor

looking back at my script... I did use mode = "wb" for the 18-19 data download, but not for the 17-18 dataset. So that is probably why one worked and the other didn't.

Abby Isaacson

I am having a problem just downloading the files. My code (with or without the mode = "wb",):

download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx", destfile = "data-raw-gd/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx")

and I get these two errors:

Warning messages: 1: In download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx", : URL https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx: cannot open destfile 'data-raw/enrollment-18-19.xlsx', reason 'No such file or directory' 2: In download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx", : download had nonzero exit status

This also happens with my own project file links (from Tidy Tuesday).

David Keyes

Do you have a folder called data-raw-gd? That's where the download.file() function is trying to put the file it downloads, but if that folder doesn't exist, it won't work.

Abby Isaacson

yes, I created it before I tried to download.

David Keyes

Actually, take a look back at your destfile argument:

destfile = “data-raw-gd/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx”

It's going to try to put the data in the data-raw-gd/going-deeper/raw/master/data-raw/ folder. Try this instead and let me know if it works:

              destfile = "enrollment-18-19.xlsx")```

That will put the file in the root of the project you're working in. You did create a completely new project for this course, correct?

Abby Isaacson

ah! I was copying too much of the url including forward slashes that were not right. Simple but frustrating, thanks!

Abby Isaacson

this is what worked: download.file(url="https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx", destfile= "data-raw-gd/enrollment-18-19.xlsx")

Abby Isaacson

April 20, 2021

And I went through the steps to create a new project in a new Directory, but I am still saving everything in an "R in 3 mo" folder. I think I have some troubleshooting yet to do about keeping projects truly separate.

Nithin Pradeep

October 8, 2021

The excel file I am downloading is not getting opened in excel. The following dialog box appears-"file format or file extension not valid. Verify the file has not been corrupted and that file extension matches the format".

Matt M

You recommended data cleaning in R script but reporting in RMarkdown. What if I want my report to be 100% reproducible by someone else? Should I then do all my data cleaning within RMarkdown?

David Keyes

Either an R script file or an RMarkdown file will be reproducible because other people can run your code so it shouldn't matter on that front. Others do their data cleaning in RMarkdown and that works fine as well. I just have a preference to do it in an R script file. In the end, it's up to you!

Matt M

At about 9:38 you said “let me highlight all of these” because keyboard shortcuts are faster. Did you use CTRL A to select all or something else to select just that chunk/those lines?

David Keyes

Yup, command (Mac) or control (Windows) and A to select all lines in an R script file.

Niger Sultana

April 28, 2022

Hi David, What was your key at 12:38 second, that hash tag showed up before two lines R code ?

Charlie Hadley

April 28, 2022

Hi Niger, David is using code comments, I've recorded a very quick video demonstrating how they work. Thanks, Charlie

Niger Sultana

April 29, 2022

Hi I was trying to import data from two excels(field_data_AA and predictor season13July) where 4 spread sheets (name are Autumn, Spring, Winter and Summer. I found following messages. I first run code with Spring and data imported then run code with all seasons? It did not work. Can you suggest me please how can I fix cell reference in excel files ?

> field_data_2018
> field_data_2019 <- read_excel(path = "Data-raw/predictor season13July.xlsx",

                          sheet = &quot;Autumn&quot;,&quot;Spring&quot;,&quot;Winter&quot;,&quot;Summer&quot;)

Error: Can't guess format of this cell reference: Spring In addition: Warning message: Cell reference follows neither the A1 nor R1C1 format. Example: Spring NAs generated.

Cheers Niger

Charlie Hadley

May 3, 2022

Hello Niger,

The read_excel() function will only allow you to read in one sheet at a time, eg

read_excel(path = "Data-raw/predictor season13July.xlsx", sheet = "Autumn")

You would need to import each of these sheets separately and to then combine them together with bind_rows(). As you're a member of R in 3 Months I'd recommend asking about how to combine these in a submission and I can help you.

Thanks,

Charlie

Esther Okoye

May 5, 2022

Hello whenever i try to run my code it keeps giving me an error mesage;

source("~/.active-rstudio-document", echo=TRUE) Error in source("~/.active-rstudio-document", echo = TRUE) : ~/.active-rstudio-document:6:107: unexpected symbol 5: 6: download.file(url="https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-mode = "wb ^

Charlie Hadley

May 5, 2022

Hi Esther,

This error usually comes from an unexpected character in your code. Could you copy and paste the code you're trying to run please?

Thanks,

Charlie

Esther Okoye

May 11, 2022

library(tidyverse) library(janitor) library(readxl)

download.file(url="https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-mode = "wb", destfile = "data-raw/enrollment-18-19.xlsx")

download.file(url= "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-mode = "wb", destfile = "data-raw/enrollment-17-18.xlsx")

#import data

enrollment_18_19 <- read_excel(path = "data-raw/enrollment-18-19.xlsx", sheet = "Sheet 1")

enrollment_17_18 <- read_excel(path= "data-raw/enrollment-17-18.xlsx", sheet = "Sheet 1")

enrollment_18_19 <- read_excel(path = "data-raw/enrollment-18-19.xlsx", sheet = "Sheet 1")

enrollment_17_18 <- read_excel(path = "data-raw/enrollment-17-18.xlsx", sheet = "Sheet 1")

Charlie Hadley

May 11, 2022

Hello Esther,

Ah! Okay, this is a slightly difficult thing to explain.

There are two types of double quotation characters, the curly ones you're using “ and the straight one " which are what you need to use in R code. Almost without exception the curly bracket cannot be used in programming languages.

The next issue is a missing closing quotation mark at the end of the URL and the argument "mode". The code you need to write is as follows:

library(tidyverse)
library(janitor)
library(readxl)


download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-18-19.xlsx",
              mode = "wb",
              destfile = "data-raw/enrollment-18-19.xlsx")

download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-17-18.xlsx",
              mode = "wb",
              destfile = "data-raw/enrollment-17-18.xlsx")

#import data

enrollment_18_19 <- read_excel(path = "data-raw/enrollment-18-19.xlsx",
                               sheet = "Sheet 1")

enrollment_17_18 <- read_excel(path= "data-raw/enrollment-17-18.xlsx",
                               sheet = "Sheet 1")

enrollment_18_19 <- read_excel(path = "data-raw/enrollment-18-19.xlsx",
                               sheet = "Sheet 1")

enrollment_17_18 <- read_excel(path = "data-raw/enrollment-17-18.xlsx",
                               sheet = "Sheet 1")

Thanks,

Charlie

Esther Okoye

May 11, 2022

Thank you Charlie

Julia Nee

What's the difference between the "destfile" argument and "dest" in read_excel, which seems to have also put my downloads into the folder I directed them to? Are they two ways of doing the same thing?

Charlie Hadley

Hi Julia,

Could you help me understand your question a little bit? The read_excel() function doesn't have arguments contains "dest" - see here (https://www.rdocumentation.org/packages/readxl/versions/0.1.1/topics/read_excel). The download.file() function has an argument called destfile that determines where the file is downloaded.

Cheers, Charlie

Julia Nee

Yes! I used this code: download.file(url = "https://github.com/rfortherestofus/going-deeper/raw/master/data-raw/enrollment-17-18.xlsx", dest = "data-raw/enrollment-17-18.xlsx") ...and it downloaded the data to inside my "data-raw" folder. I was confused then when I watched the solutions video, because yeah, it seems like "dest" should not be accepted because it's not an allowed argument; only "destfile" should work I would think.

Charlie Hadley