Run in Google Colab

View on GitHub

Homework 5: Exploratory Data Analysis (EDA)¶

In this assignment, you are going to perform exploratory data analysis (EDA) on a small dataset of your choice. You can choose any dataset you like, but you are encouraged to pick a dataset that you are interested in. You can use the datasets you have used in the previous assignments or you can choose a new dataset. If you don't have a dataset in mind, you can choose one from the datasets in the Datasets folder of the course repository.

Instructions¶

1. Follow the instructions on how to setup your Python and Jupyter (or VSCode) environment and cloning or downloading our repository. Instructions can be found in the class notes: https://filipinascimento.github.io/usable_ai/m00-setup/class
2. Ensure that you have Python and Jupyter Notebook working. (You can also try using Google Colab. This is not the preferred method for this homework, but it is an option)
3. Load the dataset of your choice into a Pandas dataframe
4. Perform exploratory data analysis (EDA) on the dataset. Your analysis should include the following:
   • Summary statistics of the dataset
   • Data cleaning and preprocessing
   • Data visualization (e.g., histograms, scatterplots, etc.)
   • You should write a brief summary of the insights and conclusions you have drawn from your analysis. You can use the exploratory_data_analysis.ipynb as a reference.
5. Important: Create both code and markdown cells in your notebook to document your analysis.
6. Submit your completed notebook as a HTML export, or a PDF file.

Submission Guidelines¶

• Submit your completed notebook as a HTML export, or a PDF file.

To export to HTML, if you are on Jupyter, select File > Export Notebook As > HTML.

If you are on VSCode, you can use the Jupyter: Export to HTML command.

• Open the command palette (Ctrl+Shift+P or Cmd+Shift+P on Mac).
  • Search for Jupyter: Export to HTML.
  • Save the HTML file to your computer and submit it via Canvas.

---

Using Generative AI Responsibly

You're welcome to use Generative AI to assist your learning, but focus on understanding the concepts rather than just solving the assignment. For example, instead of copying and pasting the question into the model, ask it to explain the concept in the question. Try asking: How can I open a file in Python? Can you give me examples? or What functions and methods can I use to extract the words of a text file? Can you explain how they work with some examples?

This way, you will learn how the solution works while building your skills. Remember to give context to the generative AI, so it can better assist you. Talk to the instructor and AIs if you have any questions or need insights.

Create your cells below this one. Hint: start by imporint the necessary libraries and loading your dataset.