Press "Enter" to skip to content

Tag: DataFrame

How to Read SAS Files in Python with Pandas

Erik Marsja Erik Marsja
October 13, 2019
Leave a Comment
How to Read SAS Files in Python with Pandas

In this post, we are going to learn how to read SAS (.sas7dbat) files in Python.

As previously described (in the read .sav files in Python post) Python is a general-purpose language that also can be used for doing data analysis and data visualization.

One potential downside, however, is that Python is not really user-friendly for data storage. This has, of course, lead to that our data many times are stored using Excel, SPSS, SAS, or similar software. See, for instance, the posts about reading .sav and .xlxs files in Python:

Continue ReadingHow to Read SAS Files in Python with Pandas

How to use iloc and loc for Indexing and Slicing Pandas Dataframes

Erik Marsja Erik Marsja
September 29, 2019
2 Comments
How to use iloc and loc for Indexing and Slicing Pandas Dataframes

In this post, we are going to work with Pandas iloc, and loc. More specifically, we are going to learn slicing and indexing by iloc and loc examples.

Once we have a dataset loaded as a Pandas dataframe, we often want to start accessing specific parts of the data based on some criteria. For instance, if our dataset contains the result of an experiment comparing different experimental groups, we may want to calculate descriptive statistics for each experimental group separately.

Continue ReadingHow to use iloc and loc for Indexing and Slicing Pandas Dataframes

How to Read & Write SPSS Files in Python using Pandas

Erik Marsja Erik Marsja
September 8, 2019
2 Comments
How to Read & Write SPSS Files in Python using Pandas

In this post we are going to learn 1) how to read SPSS (.sav) files in Python, and 2) how to write to SPSS (.sav) files using Python. 

Python is a great general-purpose language as well as for carrying out statistical analysis and data visualization. However, Python is not really user-friendly when it comes to data storage. Thus, often our data will be archived using Excel, SPSS or similar software.

For example, learn how to import data from other file types, such as Excel and SPSS in the following two posts:

Continue ReadingHow to Read & Write SPSS Files in Python using Pandas

Python Pandas Groupby Tutorial

Erik Marsja Erik Marsja
December 6, 2018
Leave a Comment

In this Pandas groupby tutorial, we are going to learn how to organize Pandas dataframes by groups. More specifically, we are going to learn how to group by one and multiple columns.

Furthermore, we are going to learn how calculate some basics summary statistics (e.g., mean, median), convert Pandas groupby to dataframe, calculate the percentage of observations in each group, and many more useful things.

First of all we are going to import pandas as pd, and read a CSV file, using the read_csv method, to a dataframe. In the example below, we use index_col=0 because the first row in the dataset is the index column.

Continue ReadingPython Pandas Groupby Tutorial

Data Manipulation with Pandas: A Brief Tutorial

Erik Marsja Erik Marsja
November 5, 2018
Leave a Comment

Learn three data manipulation techniques with Pandas in this guest post by Harish Garg, a software developer and data analyst, and the author of Mastering Exploratory Analysis with pandas.

Modifying a Pandas DataFrame Using the inplace Parameter

In this section, you’ll learn how to modify a DataFrame using the inplace parameter. You’ll first read a real dataset into Pandas. You’ll then see how the inplace parameter impacts a method execution’s end result. You’ll also execute methods with and without the inplace parameter to demonstrate the effect of inplace.

Continue ReadingData Manipulation with Pandas: A Brief Tutorial