Class 03: Exploratory Data Analysis

Learning Objectives

  • List the key components of Exploratory Data Analysis (EDA)
  • Describe and memorize the modes of EDA
  • Infer possible data sources from interactive visualizations
  • Make an oral presentation from a data analysis

Exploratory Data Analysis

Exploratory data analysis (EDA) is the process of trying to understand what a dataset can tell us outside of a narrowly focused probability statement. It relies heavily on graphical devices and summary statistics. EDA is a very important aspect of data analysis and will contribute a large part of what we work on this semester.

Today

It will take a few weeks before we have covered all of the core skills needed to do an exploratory analysis of a dataset. We’ll get there eventually, but I think it is useful to see at the start what exactly is involved in such an analysis. So, today, we will be looking at some online, interactive visualizations that we can explore without involving R or any data processing skills.

Types of data sets

When I talk about data I tend to think of a broader meaning to the term than some people might. Data can include such things as text:

Maps:

And here, even one with sound:

Today the projects groups will look at will cover a similarly wide range of data set types.

Exploratory data analysis

What’s the point an exploratory, visual analysis? At a high level we are trying to understand something about the world around us. The EDA phase of analysis let’s us discover what the data at hand is specifically telling us and indicates directions for future studies.

Here is a project from the Digital Scholarship Lab (DSL) at the University of Richmond that does a great job of showing how visualizations can be powerful argumentative tools:

If you are not familiar with the DSL, I encourage you to check out their projects and visit the group’s space in the library. I plan to have someone from the DSL join us for a class later in the semester.

Modes of Analysis in EDA

Generally, when doing EDA we are looking at understanding patterns contained within the data. I tend see that interesting observations come in one of three forms:

  • pattern description: an observation about a general pattern or trend found in the dataset
  • anomaly detection: identification of data points that, in some way, seem to not follow the general pattern or otherwise behave in some extreme or anomalous way
  • perspective: we have a special interest in a small set of data points (often just one) and are interested in how this point falls relative to the rest of the data; like anomaly detection, but we decide which points to care about ahead of the analysis

These do not function in a vacuum and good analyses will often pull from multiple types of observations.

Questions

For today, here are some questions to answer about as we look at interactive visualizations:

  1. What is the source of the data?
  2. What are some of the variables (measurements) being used in the visualization?
  3. What types of visualizations are being used? If you don’t know the exact name of something, just describe it.
  4. What are 2-3 interesting observations you found in the dataset?

I’ll answer these for the Forced Migration dataset, then let you work on these questions in small groups.

Groups

Now, its your turn. I have gather several interactive visualizations that I find particularly interesting. You’ll be split into groups of and assigned one of these datasets.

Spend about 15 minutes playing around with the visualization and understanding the data within it. Then, answer the four questions above. Finally, designate one person to come up and explain the answers to your dataset.

Assignment

The assignment for next time is to download, complete, and submit the third lab. You can find a link to this lab on the main course website. Going forward I will stop explicitly mentioning that you need to complete the next lab. So don’t forget!