Dataset statistics
Number of variables | 16 |
---|---|
Number of observations | 891 |
Missing cells | 869 |
Missing cells (%) | 6.1% |
Duplicate rows | 0 |
Duplicate rows (%) | 0.0% |
Total size in memory | 99.3 KiB |
Average record size in memory | 114.1 B |
Variable types
Numeric | 5 |
---|---|
Categorical | 8 |
Boolean | 3 |
who is highly correlated with sex and 1 other fields | High correlation |
embark_town is highly correlated with embarked | High correlation |
pclass is highly correlated with class | High correlation |
embarked is highly correlated with embark_town | High correlation |
sex is highly correlated with who and 1 other fields | High correlation |
alive is highly correlated with survived | High correlation |
adult_male is highly correlated with who and 1 other fields | High correlation |
survived is highly correlated with alive | High correlation |
class is highly correlated with pclass | High correlation |
age has 177 (19.9%) missing values | Missing |
deck has 688 (77.2%) missing values | Missing |
df_index is uniformly distributed | Uniform |
df_index has unique values | Unique |
sibsp has 608 (68.2%) zeros | Zeros |
parch has 678 (76.1%) zeros | Zeros |
fare has 15 (1.7%) zeros | Zeros |
Reproduction
Analysis started | 2021-03-07 04:46:26.980366 |
---|---|
Analysis finished | 2021-03-07 04:46:33.952795 |
Duration | 6.97 seconds |
Software version | pandas-profiling v2.11.0 |
Download configuration | config.yaml |
Distinct | 891 |
---|---|
Distinct (%) | 100.0% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 445 |
---|---|
Minimum | 0 |
Maximum | 890 |
Zeros | 1 |
Zeros (%) | 0.1% |
Memory size | 7.1 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 44.5 |
Q1 | 222.5 |
median | 445 |
Q3 | 667.5 |
95-th percentile | 845.5 |
Maximum | 890 |
Range | 890 |
Interquartile range (IQR) | 445 |
Descriptive statistics
Standard deviation | 257.353842 |
---|---|
Coefficient of variation (CV) | 0.5783232405 |
Kurtosis | -1.2 |
Mean | 445 |
Median Absolute Deviation (MAD) | 223 |
Skewness | 0 |
Sum | 396495 |
Variance | 66231 |
Monotocity | Strictly increasing |
Value | Count | Frequency (%) |
890 | 1 | 0.1% |
292 | 1 | 0.1% |
303 | 1 | 0.1% |
302 | 1 | 0.1% |
301 | 1 | 0.1% |
300 | 1 | 0.1% |
299 | 1 | 0.1% |
298 | 1 | 0.1% |
297 | 1 | 0.1% |
296 | 1 | 0.1% |
Other values (881) | 881 |
Value | Count | Frequency (%) |
0 | 1 | |
1 | 1 | |
2 | 1 | |
3 | 1 | |
4 | 1 |
Value | Count | Frequency (%) |
890 | 1 | |
889 | 1 | |
888 | 1 | |
887 | 1 | |
886 | 1 |
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.1 KiB |
0 | |
---|---|
1 |
Value | Count | Frequency (%) |
0 | 549 | |
1 | 342 |
Value | Count | Frequency (%) |
0 | 549 | |
1 | 342 |
Most occurring characters
Value | Count | Frequency (%) |
0 | 549 | |
1 | 342 |
Most occurring categories
Value | Count | Frequency (%) |
Decimal Number | 891 |
Most frequent character per category
Value | Count | Frequency (%) |
0 | 549 | |
1 | 342 |
Most occurring scripts
Value | Count | Frequency (%) |
Common | 891 |
Most frequent character per script
Value | Count | Frequency (%) |
0 | 549 | |
1 | 342 |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 891 |
Most frequent character per block
Value | Count | Frequency (%) |
0 | 549 | |
1 | 342 |
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.1 KiB |
3 | |
---|---|
1 | |
2 |
Value | Count | Frequency (%) |
3 | 491 | |
1 | 216 | |
2 | 184 | 20.7% |
Value | Count | Frequency (%) |
3 | 491 | |
1 | 216 | |
2 | 184 | 20.7% |
Most occurring characters
Value | Count | Frequency (%) |
3 | 491 | |
1 | 216 | |
2 | 184 | 20.7% |
Most occurring categories
Value | Count | Frequency (%) |
Decimal Number | 891 |
Most frequent character per category
Value | Count | Frequency (%) |
3 | 491 | |
1 | 216 | |
2 | 184 | 20.7% |
Most occurring scripts
Value | Count | Frequency (%) |
Common | 891 |
Most frequent character per script
Value | Count | Frequency (%) |
3 | 491 | |
1 | 216 | |
2 | 184 | 20.7% |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 891 |
Most frequent character per block
Value | Count | Frequency (%) |
3 | 491 | |
1 | 216 | |
2 | 184 | 20.7% |
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.1 KiB |
male | |
---|---|
female |
Value | Count | Frequency (%) |
male | 577 | |
female | 314 |
Value | Count | Frequency (%) |
male | 577 | |
female | 314 |
Most occurring characters
Value | Count | Frequency (%) |
e | 1205 | |
m | 891 | |
a | 891 | |
l | 891 | |
f | 314 | 7.5% |
Most occurring categories
Value | Count | Frequency (%) |
Lowercase Letter | 4192 |
Most frequent character per category
Value | Count | Frequency (%) |
e | 1205 | |
m | 891 | |
a | 891 | |
l | 891 | |
f | 314 | 7.5% |
Most occurring scripts
Value | Count | Frequency (%) |
Latin | 4192 |
Most frequent character per script
Value | Count | Frequency (%) |
e | 1205 | |
m | 891 | |
a | 891 | |
l | 891 | |
f | 314 | 7.5% |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 4192 |
Most frequent character per block
Value | Count | Frequency (%) |
e | 1205 | |
m | 891 | |
a | 891 | |
l | 891 | |
f | 314 | 7.5% |
Distinct | 88 |
---|---|
Distinct (%) | 12.3% |
Missing | 177 |
Missing (%) | 19.9% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 29.69911765 |
---|---|
Minimum | 0.42 |
Maximum | 80 |
Zeros | 0 |
Zeros (%) | 0.0% |
Memory size | 7.1 KiB |
Quantile statistics
Minimum | 0.42 |
---|---|
5-th percentile | 4 |
Q1 | 20.125 |
median | 28 |
Q3 | 38 |
95-th percentile | 56 |
Maximum | 80 |
Range | 79.58 |
Interquartile range (IQR) | 17.875 |
Descriptive statistics
Standard deviation | 14.52649733 |
---|---|
Coefficient of variation (CV) | 0.4891221855 |
Kurtosis | 0.1782741536 |
Mean | 29.69911765 |
Median Absolute Deviation (MAD) | 9 |
Skewness | 0.3891077823 |
Sum | 21205.17 |
Variance | 211.0191247 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) |
24 | 30 | 3.4% |
22 | 27 | 3.0% |
18 | 26 | 2.9% |
28 | 25 | 2.8% |
19 | 25 | 2.8% |
30 | 25 | 2.8% |
21 | 24 | 2.7% |
25 | 23 | 2.6% |
36 | 22 | 2.5% |
29 | 20 | 2.2% |
Other values (78) | 467 | |
(Missing) | 177 | 19.9% |
Value | Count | Frequency (%) |
0.42 | 1 | |
0.67 | 1 | |
0.75 | 2 | |
0.83 | 2 | |
0.92 | 1 |
Value | Count | Frequency (%) |
80 | 1 | |
74 | 1 | |
71 | 2 | |
70.5 | 1 | |
70 | 2 |
Distinct | 7 |
---|---|
Distinct (%) | 0.8% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 0.5230078563 |
---|---|
Minimum | 0 |
Maximum | 8 |
Zeros | 608 |
Zeros (%) | 68.2% |
Memory size | 7.1 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 0 |
Q3 | 1 |
95-th percentile | 3 |
Maximum | 8 |
Range | 8 |
Interquartile range (IQR) | 1 |
Descriptive statistics
Standard deviation | 1.102743432 |
---|---|
Coefficient of variation (CV) | 2.108464374 |
Kurtosis | 17.88041973 |
Mean | 0.5230078563 |
Median Absolute Deviation (MAD) | 0 |
Skewness | 3.695351727 |
Sum | 466 |
Variance | 1.216043077 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) |
0 | 608 | |
1 | 209 | 23.5% |
2 | 28 | 3.1% |
4 | 18 | 2.0% |
3 | 16 | 1.8% |
8 | 7 | 0.8% |
5 | 5 | 0.6% |
Value | Count | Frequency (%) |
0 | 608 | |
1 | 209 | 23.5% |
2 | 28 | 3.1% |
3 | 16 | 1.8% |
4 | 18 | 2.0% |
Value | Count | Frequency (%) |
8 | 7 | 0.8% |
5 | 5 | 0.6% |
4 | 18 | |
3 | 16 | |
2 | 28 |
Distinct | 7 |
---|---|
Distinct (%) | 0.8% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 0.3815937149 |
---|---|
Minimum | 0 |
Maximum | 6 |
Zeros | 678 |
Zeros (%) | 76.1% |
Memory size | 7.1 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 0 |
Q1 | 0 |
median | 0 |
Q3 | 0 |
95-th percentile | 2 |
Maximum | 6 |
Range | 6 |
Interquartile range (IQR) | 0 |
Descriptive statistics
Standard deviation | 0.8060572211 |
---|---|
Coefficient of variation (CV) | 2.112344071 |
Kurtosis | 9.778125179 |
Mean | 0.3815937149 |
Median Absolute Deviation (MAD) | 0 |
Skewness | 2.749117047 |
Sum | 340 |
Variance | 0.6497282437 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) |
0 | 678 | |
1 | 118 | 13.2% |
2 | 80 | 9.0% |
5 | 5 | 0.6% |
3 | 5 | 0.6% |
4 | 4 | 0.4% |
6 | 1 | 0.1% |
Value | Count | Frequency (%) |
0 | 678 | |
1 | 118 | 13.2% |
2 | 80 | 9.0% |
3 | 5 | 0.6% |
4 | 4 | 0.4% |
Value | Count | Frequency (%) |
6 | 1 | 0.1% |
5 | 5 | 0.6% |
4 | 4 | 0.4% |
3 | 5 | 0.6% |
2 | 80 |
Distinct | 248 |
---|---|
Distinct (%) | 27.8% |
Missing | 0 |
Missing (%) | 0.0% |
Infinite | 0 |
Infinite (%) | 0.0% |
Mean | 32.20420797 |
---|---|
Minimum | 0 |
Maximum | 512.3292 |
Zeros | 15 |
Zeros (%) | 1.7% |
Memory size | 7.1 KiB |
Quantile statistics
Minimum | 0 |
---|---|
5-th percentile | 7.225 |
Q1 | 7.9104 |
median | 14.4542 |
Q3 | 31 |
95-th percentile | 112.07915 |
Maximum | 512.3292 |
Range | 512.3292 |
Interquartile range (IQR) | 23.0896 |
Descriptive statistics
Standard deviation | 49.6934286 |
---|---|
Coefficient of variation (CV) | 1.543072528 |
Kurtosis | 33.39814088 |
Mean | 32.20420797 |
Median Absolute Deviation (MAD) | 6.9042 |
Skewness | 4.78731652 |
Sum | 28693.9493 |
Variance | 2469.436846 |
Monotocity | Not monotonic |
Value | Count | Frequency (%) |
8.05 | 43 | 4.8% |
13 | 42 | 4.7% |
7.8958 | 38 | 4.3% |
7.75 | 34 | 3.8% |
26 | 31 | 3.5% |
10.5 | 24 | 2.7% |
7.925 | 18 | 2.0% |
7.775 | 16 | 1.8% |
26.55 | 15 | 1.7% |
0 | 15 | 1.7% |
Other values (238) | 615 |
Value | Count | Frequency (%) |
0 | 15 | |
4.0125 | 1 | 0.1% |
5 | 1 | 0.1% |
6.2375 | 1 | 0.1% |
6.4375 | 1 | 0.1% |
Value | Count | Frequency (%) |
512.3292 | 3 | |
263 | 4 | |
262.375 | 2 | |
247.5208 | 2 | |
227.525 | 4 |
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 2 |
Missing (%) | 0.2% |
Memory size | 7.1 KiB |
S | |
---|---|
C | |
Q |
Value | Count | Frequency (%) |
S | 644 | |
C | 168 | 18.9% |
Q | 77 | 8.6% |
(Missing) | 2 | 0.2% |
Value | Count | Frequency (%) |
s | 644 | |
c | 168 | 18.9% |
q | 77 | 8.7% |
Most occurring characters
Value | Count | Frequency (%) |
S | 644 | |
C | 168 | 18.9% |
Q | 77 | 8.7% |
Most occurring categories
Value | Count | Frequency (%) |
Uppercase Letter | 889 |
Most frequent character per category
Value | Count | Frequency (%) |
S | 644 | |
C | 168 | 18.9% |
Q | 77 | 8.7% |
Most occurring scripts
Value | Count | Frequency (%) |
Latin | 889 |
Most frequent character per script
Value | Count | Frequency (%) |
S | 644 | |
C | 168 | 18.9% |
Q | 77 | 8.7% |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 889 |
Most frequent character per block
Value | Count | Frequency (%) |
S | 644 | |
C | 168 | 18.9% |
Q | 77 | 8.7% |
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.1 KiB |
Third | |
---|---|
First | |
Second |
Value | Count | Frequency (%) |
Third | 491 | |
First | 216 | |
Second | 184 | 20.7% |
Value | Count | Frequency (%) |
third | 491 | |
first | 216 | |
second | 184 | 20.7% |
Most occurring characters
Value | Count | Frequency (%) |
i | 707 | |
r | 707 | |
d | 675 | |
T | 491 | |
h | 491 | |
F | 216 | 4.7% |
s | 216 | 4.7% |
t | 216 | 4.7% |
S | 184 | 4.0% |
e | 184 | 4.0% |
Other values (3) | 552 |
Most occurring categories
Value | Count | Frequency (%) |
Lowercase Letter | 3748 | |
Uppercase Letter | 891 | 19.2% |
Most frequent character per category
Value | Count | Frequency (%) |
i | 707 | |
r | 707 | |
d | 675 | |
h | 491 | |
s | 216 | 5.8% |
t | 216 | 5.8% |
e | 184 | 4.9% |
c | 184 | 4.9% |
o | 184 | 4.9% |
n | 184 | 4.9% |
Value | Count | Frequency (%) |
T | 491 | |
F | 216 | |
S | 184 | 20.7% |
Most occurring scripts
Value | Count | Frequency (%) |
Latin | 4639 |
Most frequent character per script
Value | Count | Frequency (%) |
i | 707 | |
r | 707 | |
d | 675 | |
T | 491 | |
h | 491 | |
F | 216 | 4.7% |
s | 216 | 4.7% |
t | 216 | 4.7% |
S | 184 | 4.0% |
e | 184 | 4.0% |
Other values (3) | 552 |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 4639 |
Most frequent character per block
Value | Count | Frequency (%) |
i | 707 | |
r | 707 | |
d | 675 | |
T | 491 | |
h | 491 | |
F | 216 | 4.7% |
s | 216 | 4.7% |
t | 216 | 4.7% |
S | 184 | 4.0% |
e | 184 | 4.0% |
Other values (3) | 552 |
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 7.1 KiB |
man | |
---|---|
woman | |
child |
Value | Count | Frequency (%) |
man | 537 | |
woman | 271 | |
child | 83 | 9.3% |
Value | Count | Frequency (%) |
man | 537 | |
woman | 271 | |
child | 83 | 9.3% |
Most occurring characters
Value | Count | Frequency (%) |
m | 808 | |
a | 808 | |
n | 808 | |
w | 271 | 8.0% |
o | 271 | 8.0% |
c | 83 | 2.5% |
h | 83 | 2.5% |
i | 83 | 2.5% |
l | 83 | 2.5% |
d | 83 | 2.5% |
Most occurring categories
Value | Count | Frequency (%) |
Lowercase Letter | 3381 |
Most frequent character per category
Value | Count | Frequency (%) |
m | 808 | |
a | 808 | |
n | 808 | |
w | 271 | 8.0% |
o | 271 | 8.0% |
c | 83 | 2.5% |
h | 83 | 2.5% |
i | 83 | 2.5% |
l | 83 | 2.5% |
d | 83 | 2.5% |
Most occurring scripts
Value | Count | Frequency (%) |
Latin | 3381 |
Most frequent character per script
Value | Count | Frequency (%) |
m | 808 | |
a | 808 | |
n | 808 | |
w | 271 | 8.0% |
o | 271 | 8.0% |
c | 83 | 2.5% |
h | 83 | 2.5% |
i | 83 | 2.5% |
l | 83 | 2.5% |
d | 83 | 2.5% |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 3381 |
Most frequent character per block
Value | Count | Frequency (%) |
m | 808 | |
a | 808 | |
n | 808 | |
w | 271 | 8.0% |
o | 271 | 8.0% |
c | 83 | 2.5% |
h | 83 | 2.5% |
i | 83 | 2.5% |
l | 83 | 2.5% |
d | 83 | 2.5% |
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 1019.0 B |
True | |
---|---|
False |
Value | Count | Frequency (%) |
True | 537 | |
False | 354 |
Distinct | 7 |
---|---|
Distinct (%) | 3.4% |
Missing | 688 |
Missing (%) | 77.2% |
Memory size | 7.1 KiB |
C | |
---|---|
B | |
D | |
E | |
A | |
Other values (2) |
Value | Count | Frequency (%) |
C | 59 | 6.6% |
B | 47 | 5.3% |
D | 33 | 3.7% |
E | 32 | 3.6% |
A | 15 | 1.7% |
F | 13 | 1.5% |
G | 4 | 0.4% |
(Missing) | 688 |
Value | Count | Frequency (%) |
c | 59 | |
b | 47 | |
d | 33 | |
e | 32 | |
a | 15 | 7.4% |
f | 13 | 6.4% |
g | 4 | 2.0% |
Most occurring characters
Value | Count | Frequency (%) |
C | 59 | |
B | 47 | |
D | 33 | |
E | 32 | |
A | 15 | 7.4% |
F | 13 | 6.4% |
G | 4 | 2.0% |
Most occurring categories
Value | Count | Frequency (%) |
Uppercase Letter | 203 |
Most frequent character per category
Value | Count | Frequency (%) |
C | 59 | |
B | 47 | |
D | 33 | |
E | 32 | |
A | 15 | 7.4% |
F | 13 | 6.4% |
G | 4 | 2.0% |
Most occurring scripts
Value | Count | Frequency (%) |
Latin | 203 |
Most frequent character per script
Value | Count | Frequency (%) |
C | 59 | |
B | 47 | |
D | 33 | |
E | 32 | |
A | 15 | 7.4% |
F | 13 | 6.4% |
G | 4 | 2.0% |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 203 |
Most frequent character per block
Value | Count | Frequency (%) |
C | 59 | |
B | 47 | |
D | 33 | |
E | 32 | |
A | 15 | 7.4% |
F | 13 | 6.4% |
G | 4 | 2.0% |
Distinct | 3 |
---|---|
Distinct (%) | 0.3% |
Missing | 2 |
Missing (%) | 0.2% |
Memory size | 7.1 KiB |
Southampton | |
---|---|
Cherbourg | |
Queenstown |
Length
Max length | 11 |
---|---|
Median length | 11 |
Mean length | 10.53543307 |
Min length | 9 |
Characters and Unicode
Total characters | 9366 |
---|---|
Distinct characters | 17 |
Distinct categories | 2 ? |
Distinct scripts | 1 ? |
Distinct blocks | 1 ? |
Unique
Unique | 0 ? |
---|---|
Unique (%) | 0.0% |
Sample
1st row | Southampton |
---|---|
2nd row | Cherbourg |
3rd row | Southampton |
4th row | Southampton |
5th row | Southampton |
Value | Count | Frequency (%) |
Southampton | 644 | |
Cherbourg | 168 | 18.9% |
Queenstown | 77 | 8.6% |
(Missing) | 2 | 0.2% |
Value | Count | Frequency (%) |
southampton | 644 | |
cherbourg | 168 | 18.9% |
queenstown | 77 | 8.7% |
Most occurring characters
Value | Count | Frequency (%) |
o | 1533 | |
t | 1365 | |
u | 889 | |
h | 812 | |
n | 798 | |
S | 644 | |
a | 644 | |
m | 644 | |
p | 644 | |
r | 336 | 3.6% |
Other values (7) | 1057 |
Most occurring categories
Value | Count | Frequency (%) |
Lowercase Letter | 8477 | |
Uppercase Letter | 889 | 9.5% |
Most frequent character per category
Value | Count | Frequency (%) |
o | 1533 | |
t | 1365 | |
u | 889 | |
h | 812 | |
n | 798 | |
a | 644 | |
m | 644 | |
p | 644 | |
r | 336 | 4.0% |
e | 322 | 3.8% |
Other values (4) | 490 | 5.8% |
Value | Count | Frequency (%) |
S | 644 | |
C | 168 | 18.9% |
Q | 77 | 8.7% |
Most occurring scripts
Value | Count | Frequency (%) |
Latin | 9366 |
Most frequent character per script
Value | Count | Frequency (%) |
o | 1533 | |
t | 1365 | |
u | 889 | |
h | 812 | |
n | 798 | |
S | 644 | |
a | 644 | |
m | 644 | |
p | 644 | |
r | 336 | 3.6% |
Other values (7) | 1057 |
Most occurring blocks
Value | Count | Frequency (%) |
ASCII | 9366 |
Most frequent character per block
Value | Count | Frequency (%) |
o | 1533 | |
t | 1365 | |
u | 889 | |
h | 812 | |
n | 798 | |
S | 644 | |
a | 644 | |
m | 644 | |
p | 644 | |
r | 336 | 3.6% |
Other values (7) | 1057 |
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 1019.0 B |
False | |
---|---|
True |
Value | Count | Frequency (%) |
False | 549 | |
True | 342 |
alone
Boolean
Distinct | 2 |
---|---|
Distinct (%) | 0.2% |
Missing | 0 |
Missing (%) | 0.0% |
Memory size | 1019.0 B |
True | |
---|---|
False |
Value | Count | Frequency (%) |
True | 537 | |
False | 354 |
Pearson's r
The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.
Spearman's ρ
The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.
Kendall's τ
Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.
Phik (φk)
Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.Cramér's V (φc)
Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.First rows
df_index | survived | pclass | sex | age | sibsp | parch | fare | embarked | class | who | adult_male | deck | embark_town | alive | alone | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
0 | 0 | 0 | 3 | male | 22.0 | 1 | 0 | 7.2500 | S | Third | man | True | NaN | Southampton | no | False |
1 | 1 | 1 | 1 | female | 38.0 | 1 | 0 | 71.2833 | C | First | woman | False | C | Cherbourg | yes | False |
2 | 2 | 1 | 3 | female | 26.0 | 0 | 0 | 7.9250 | S | Third | woman | False | NaN | Southampton | yes | True |
3 | 3 | 1 | 1 | female | 35.0 | 1 | 0 | 53.1000 | S | First | woman | False | C | Southampton | yes | False |
4 | 4 | 0 | 3 | male | 35.0 | 0 | 0 | 8.0500 | S | Third | man | True | NaN | Southampton | no | True |
5 | 5 | 0 | 3 | male | NaN | 0 | 0 | 8.4583 | Q | Third | man | True | NaN | Queenstown | no | True |
6 | 6 | 0 | 1 | male | 54.0 | 0 | 0 | 51.8625 | S | First | man | True | E | Southampton | no | True |
7 | 7 | 0 | 3 | male | 2.0 | 3 | 1 | 21.0750 | S | Third | child | False | NaN | Southampton | no | False |
8 | 8 | 1 | 3 | female | 27.0 | 0 | 2 | 11.1333 | S | Third | woman | False | NaN | Southampton | yes | False |
9 | 9 | 1 | 2 | female | 14.0 | 1 | 0 | 30.0708 | C | Second | child | False | NaN | Cherbourg | yes | False |
Last rows
df_index | survived | pclass | sex | age | sibsp | parch | fare | embarked | class | who | adult_male | deck | embark_town | alive | alone | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
881 | 881 | 0 | 3 | male | 33.0 | 0 | 0 | 7.8958 | S | Third | man | True | NaN | Southampton | no | True |
882 | 882 | 0 | 3 | female | 22.0 | 0 | 0 | 10.5167 | S | Third | woman | False | NaN | Southampton | no | True |
883 | 883 | 0 | 2 | male | 28.0 | 0 | 0 | 10.5000 | S | Second | man | True | NaN | Southampton | no | True |
884 | 884 | 0 | 3 | male | 25.0 | 0 | 0 | 7.0500 | S | Third | man | True | NaN | Southampton | no | True |
885 | 885 | 0 | 3 | female | 39.0 | 0 | 5 | 29.1250 | Q | Third | woman | False | NaN | Queenstown | no | False |
886 | 886 | 0 | 2 | male | 27.0 | 0 | 0 | 13.0000 | S | Second | man | True | NaN | Southampton | no | True |
887 | 887 | 1 | 1 | female | 19.0 | 0 | 0 | 30.0000 | S | First | woman | False | B | Southampton | yes | True |
888 | 888 | 0 | 3 | female | NaN | 1 | 2 | 23.4500 | S | Third | woman | False | NaN | Southampton | no | False |
889 | 889 | 1 | 1 | male | 26.0 | 0 | 0 | 30.0000 | C | First | man | True | C | Cherbourg | yes | True |
890 | 890 | 0 | 3 | male | 32.0 | 0 | 0 | 7.7500 | Q | Third | man | True | NaN | Queenstown | no | True |