Skip to content
Join our email list to get $100 off Ally. The code expires October 31 →
R for the Rest of Us Logo

Ally Livestream Free

Your first data analysis with AI

Transcript

Click on the transcript to go to that point in the video. Please note that transcripts are auto generated and may contain minor inaccuracies.

I livestreamed while figuring out how to teach a lesson called "Your first data analysis with AI," using arrests data from the Deportation Data Project. I had Claude describe the data, then checked its claims myself, and ended up settling on having it write a Quarto document so I could run and review the code.

You'll learn:

  • How to ask AI to describe a dataset first (what a row represents, the time period, oddities) without writing analysis code yet
  • A way to check AI's claims about your data, like the date range and the number of distinct IDs, by running quick checks yourself
  • How to have AI write a Quarto exploratory data analysis document so you can run and review the code behind each output
  • How to ask AI to add plain-English comments to each line of code so it is easier to review
  • Why giving AI the codebook or documentation can change its recommendation, such as switching to a different data file

Tools mentioned: Claude, Claude Code, Positron, Quarto, ggplot2, Air, arrow

Key moments:

  • 01:53 Claude-generated livestream run sheet
  • 02:48 Introducing the arrests data and parquet import
  • 08:26 Asking Claude to describe the data before analysis
  • 15:51 Checking Claude's claims in R
  • 17:41 Asking about duplicate drop rows and the codebook
  • 21:11 Trust but verify approach explained
  • 22:08 Dictating a request for a Quarto EDA document
  • 29:38 Reviewing the monthly arrests code and chart
  • 33:37 Asking for code to answer a question, not just a yes or no
  • 38:30 Testing a question the data can't answer
  • 44:34 Adding plain-English comments to the code
  • 46:46 Deciding to frame the lesson around the Quarto workflow
  • 47:47 Next stream preview on data security with AI