___

Copyright by Pierian Data Inc. For more information, visit us at www.pieriandata.com

NOTE: BEFORE WE CAN CONTINUE WITH THIS PROJECT WE NEED TO PERFORM FEATURE ENGINEERING. THE NEXT SECTION OF THE COURSE WILL FOCUS ON TEACHING YOU FEATURE ENGINEERING ON THIS DATASET.¶

JUMP FORWARD TO THE FEATURE ENGINEERING SECTION¶

The dataset we will be working with later on in the next section:

Ames Iowa Data Set: http://jse.amstat.org/v19n3/decock.pdf

In [1]:

import pandas as pd

In [14]:

df = pd.read_csv("..\DATA\Ames_Housing_Data.csv")

In [15]:

df.head()

Out[15]:

	PID	MS SubClass	MS Zoning	Lot Frontage	Lot Area	Street	Alley	Lot Shape	Land Contour	Utilities	...	Pool QC	Fence	Misc Feature	Misc Val	Mo Sold	Yr Sold	Sale Type	Sale Condition	SalePrice
0	526301100	20	RL	141.0	31770	Pave	NaN	IR1	Lvl	AllPub	...	NaN	NaN	NaN	0	5	2010	WD	Normal	215000
1	526350040	20	RH	80.0	11622	Pave	NaN	Reg	Lvl	AllPub	...	NaN	MnPrv	NaN	0	6	2010	WD	Normal	105000
2	526351010	20	RL	81.0	14267	Pave	NaN	IR1	Lvl	AllPub	...	NaN	NaN	Gar2	12500	6	2010	WD	Normal	172000
3	526353030	20	RL	93.0	11160	Pave	NaN	Reg	Lvl	AllPub	...	NaN	NaN	NaN	0	4	2010	WD	Normal	244000
4	527105010	60	RL	74.0	13830	Pave	NaN	IR1	Lvl	AllPub	...	NaN	MnPrv	NaN	0	3	2010	WD	Normal	189900

5 rows × 81 columns

In [16]:

df.info()

<class 'pandas.core.frame.DataFrame'>
RangeIndex: 2930 entries, 0 to 2929
Data columns (total 81 columns):
 #   Column           Non-Null Count  Dtype  
---  ------           --------------  -----  
 0   PID              2930 non-null   int64  
 1   MS SubClass      2930 non-null   int64  
 2   MS Zoning        2930 non-null   object 
 3   Lot Frontage     2440 non-null   float64
 4   Lot Area         2930 non-null   int64  
 5   Street           2930 non-null   object 
 6   Alley            198 non-null    object 
 7   Lot Shape        2930 non-null   object 
 8   Land Contour     2930 non-null   object 
 9   Utilities        2930 non-null   object 
 10  Lot Config       2930 non-null   object 
 11  Land Slope       2930 non-null   object 
 12  Neighborhood     2930 non-null   object 
 13  Condition 1      2930 non-null   object 
 14  Condition 2      2930 non-null   object 
 15  Bldg Type        2930 non-null   object 
 16  House Style      2930 non-null   object 
 17  Overall Qual     2930 non-null   int64  
 18  Overall Cond     2930 non-null   int64  
 19  Year Built       2930 non-null   int64  
 20  Year Remod/Add   2930 non-null   int64  
 21  Roof Style       2930 non-null   object 
 22  Roof Matl        2930 non-null   object 
 23  Exterior 1st     2930 non-null   object 
 24  Exterior 2nd     2930 non-null   object 
 25  Mas Vnr Type     2907 non-null   object 
 26  Mas Vnr Area     2907 non-null   float64
 27  Exter Qual       2930 non-null   object 
 28  Exter Cond       2930 non-null   object 
 29  Foundation       2930 non-null   object 
 30  Bsmt Qual        2850 non-null   object 
 31  Bsmt Cond        2850 non-null   object 
 32  Bsmt Exposure    2847 non-null   object 
 33  BsmtFin Type 1   2850 non-null   object 
 34  BsmtFin SF 1     2929 non-null   float64
 35  BsmtFin Type 2   2849 non-null   object 
 36  BsmtFin SF 2     2929 non-null   float64
 37  Bsmt Unf SF      2929 non-null   float64
 38  Total Bsmt SF    2929 non-null   float64
 39  Heating          2930 non-null   object 
 40  Heating QC       2930 non-null   object 
 41  Central Air      2930 non-null   object 
 42  Electrical       2929 non-null   object 
 43  1st Flr SF       2930 non-null   int64  
 44  2nd Flr SF       2930 non-null   int64  
 45  Low Qual Fin SF  2930 non-null   int64  
 46  Gr Liv Area      2930 non-null   int64  
 47  Bsmt Full Bath   2928 non-null   float64
 48  Bsmt Half Bath   2928 non-null   float64
 49  Full Bath        2930 non-null   int64  
 50  Half Bath        2930 non-null   int64  
 51  Bedroom AbvGr    2930 non-null   int64  
 52  Kitchen AbvGr    2930 non-null   int64  
 53  Kitchen Qual     2930 non-null   object 
 54  TotRms AbvGrd    2930 non-null   int64  
 55  Functional       2930 non-null   object 
 56  Fireplaces       2930 non-null   int64  
 57  Fireplace Qu     1508 non-null   object 
 58  Garage Type      2773 non-null   object 
 59  Garage Yr Blt    2771 non-null   float64
 60  Garage Finish    2771 non-null   object 
 61  Garage Cars      2929 non-null   float64
 62  Garage Area      2929 non-null   float64
 63  Garage Qual      2771 non-null   object 
 64  Garage Cond      2771 non-null   object 
 65  Paved Drive      2930 non-null   object 
 66  Wood Deck SF     2930 non-null   int64  
 67  Open Porch SF    2930 non-null   int64  
 68  Enclosed Porch   2930 non-null   int64  
 69  3Ssn Porch       2930 non-null   int64  
 70  Screen Porch     2930 non-null   int64  
 71  Pool Area        2930 non-null   int64  
 72  Pool QC          13 non-null     object 
 73  Fence            572 non-null    object 
 74  Misc Feature     106 non-null    object 
 75  Misc Val         2930 non-null   int64  
 76  Mo Sold          2930 non-null   int64  
 77  Yr Sold          2930 non-null   int64  
 78  Sale Type        2930 non-null   object 
 79  Sale Condition   2930 non-null   object 
 80  SalePrice        2930 non-null   int64  
dtypes: float64(11), int64(27), object(43)
memory usage: 1.8+ MB

14 KiB Raw Blame History Unescape Escape

NOTE: BEFORE WE CAN CONTINUE WITH THIS PROJECT WE NEED TO PERFORM FEATURE ENGINEERING. THE NEXT SECTION OF THE COURSE WILL FOCUS ON TEACHING YOU FEATURE ENGINEERING ON THIS DATASET.¶

JUMP FORWARD TO THE FEATURE ENGINEERING SECTION¶

14 KiB

Raw Blame History Unescape Escape