Skip to content

Commit 2c8fdf9

Browse files
mhjensenmhjensen
committed
started to add material on gradient boosting
1 parent c725232 commit 2c8fdf9

48 files changed

Lines changed: 993 additions & 346 deletions

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎doc/pub/DecisionTrees/html/._DecisionTrees-bs000.html‎

Lines changed: 13 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -85,8 +85,7 @@
8585
('Final regressor code', 2, None, '___sec28'),
8686
('Pros and cons of trees, pros', 2, None, '___sec29'),
8787
('Disadvantages', 2, None, '___sec30'),
88-
('From a Single Tree to Many Trees, that is meet the Jungle of '
89-
'Methods',
88+
('From a Single Tree to Many Trees, Meet the Jungle of Methods',
9089
2,
9190
None,
9291
'___sec31'),
@@ -101,8 +100,14 @@
101100
('Now Bagging', 2, None, '___sec37'),
102101
('Random forests', 2, None, '___sec38'),
103102
('Random Forest Algorithm', 2, None, '___sec39'),
104-
('A simple scikit-learn example', 2, None, '___sec40'),
105-
('Then random forests', 2, None, '___sec41'),
103+
('Random Forests Compared with other Methods on the Cancer Data',
104+
2,
105+
None,
106+
'___sec40'),
107+
('Compare Bagging on Trees with Random Forests',
108+
2,
109+
None,
110+
'___sec41'),
106111
('Feature Importance', 2, None, '___sec42'),
107112
("Boosting, a Bird'e Eye", 2, None, '___sec43'),
108113
('Adaptive boosting: AdaBoost, Basic Algorithm',
@@ -187,7 +192,7 @@
187192
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs029.html#___sec28" style="font-size: 80%;">Final regressor code</a></li>
188193
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs030.html#___sec29" style="font-size: 80%;">Pros and cons of trees, pros</a></li>
189194
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs031.html#___sec30" style="font-size: 80%;">Disadvantages</a></li>
190-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, that is meet the Jungle of Methods</a></li>
195+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, Meet the Jungle of Methods</a></li>
191196
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs033.html#___sec32" style="font-size: 80%;">Bagging</a></li>
192197
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs034.html#___sec33" style="font-size: 80%;">More bagging</a></li>
193198
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs035.html#___sec34" style="font-size: 80%;">Simple Voting Example, head or tail</a></li>
@@ -196,8 +201,8 @@
196201
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs038.html#___sec37" style="font-size: 80%;">Now Bagging</a></li>
197202
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs039.html#___sec38" style="font-size: 80%;">Random forests</a></li>
198203
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs040.html#___sec39" style="font-size: 80%;">Random Forest Algorithm</a></li>
199-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">A simple scikit-learn example</a></li>
200-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Then random forests</a></li>
204+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">Random Forests Compared with other Methods on the Cancer Data</a></li>
205+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Compare Bagging on Trees with Random Forests</a></li>
201206
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs043.html#___sec42" style="font-size: 80%;">Feature Importance</a></li>
202207
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs044.html#___sec43" style="font-size: 80%;">Boosting, a Bird'e Eye</a></li>
203208
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs045.html#___sec44" style="font-size: 80%;">Adaptive boosting: AdaBoost, Basic Algorithm</a></li>
@@ -242,7 +247,7 @@
242247
<center>[2] <b>Department of Physics and Astronomy and National Superconducting Cyclotron Laboratory, Michigan State University</b></center>
243248
<br>
244249
<p>
245-
<center><h4>Nov 4, 2019</h4></center> <!-- date -->
250+
<center><h4>Nov 5, 2019</h4></center> <!-- date -->
246251
<br>
247252
<p>
248253

‎doc/pub/DecisionTrees/html/._DecisionTrees-bs001.html‎

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -85,8 +85,7 @@
8585
('Final regressor code', 2, None, '___sec28'),
8686
('Pros and cons of trees, pros', 2, None, '___sec29'),
8787
('Disadvantages', 2, None, '___sec30'),
88-
('From a Single Tree to Many Trees, that is meet the Jungle of '
89-
'Methods',
88+
('From a Single Tree to Many Trees, Meet the Jungle of Methods',
9089
2,
9190
None,
9291
'___sec31'),
@@ -101,8 +100,14 @@
101100
('Now Bagging', 2, None, '___sec37'),
102101
('Random forests', 2, None, '___sec38'),
103102
('Random Forest Algorithm', 2, None, '___sec39'),
104-
('A simple scikit-learn example', 2, None, '___sec40'),
105-
('Then random forests', 2, None, '___sec41'),
103+
('Random Forests Compared with other Methods on the Cancer Data',
104+
2,
105+
None,
106+
'___sec40'),
107+
('Compare Bagging on Trees with Random Forests',
108+
2,
109+
None,
110+
'___sec41'),
106111
('Feature Importance', 2, None, '___sec42'),
107112
("Boosting, a Bird'e Eye", 2, None, '___sec43'),
108113
('Adaptive boosting: AdaBoost, Basic Algorithm',
@@ -187,7 +192,7 @@
187192
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs029.html#___sec28" style="font-size: 80%;">Final regressor code</a></li>
188193
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs030.html#___sec29" style="font-size: 80%;">Pros and cons of trees, pros</a></li>
189194
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs031.html#___sec30" style="font-size: 80%;">Disadvantages</a></li>
190-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, that is meet the Jungle of Methods</a></li>
195+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, Meet the Jungle of Methods</a></li>
191196
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs033.html#___sec32" style="font-size: 80%;">Bagging</a></li>
192197
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs034.html#___sec33" style="font-size: 80%;">More bagging</a></li>
193198
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs035.html#___sec34" style="font-size: 80%;">Simple Voting Example, head or tail</a></li>
@@ -196,8 +201,8 @@
196201
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs038.html#___sec37" style="font-size: 80%;">Now Bagging</a></li>
197202
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs039.html#___sec38" style="font-size: 80%;">Random forests</a></li>
198203
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs040.html#___sec39" style="font-size: 80%;">Random Forest Algorithm</a></li>
199-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">A simple scikit-learn example</a></li>
200-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Then random forests</a></li>
204+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">Random Forests Compared with other Methods on the Cancer Data</a></li>
205+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Compare Bagging on Trees with Random Forests</a></li>
201206
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs043.html#___sec42" style="font-size: 80%;">Feature Importance</a></li>
202207
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs044.html#___sec43" style="font-size: 80%;">Boosting, a Bird'e Eye</a></li>
203208
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs045.html#___sec44" style="font-size: 80%;">Adaptive boosting: AdaBoost, Basic Algorithm</a></li>

‎doc/pub/DecisionTrees/html/._DecisionTrees-bs002.html‎

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -85,8 +85,7 @@
8585
('Final regressor code', 2, None, '___sec28'),
8686
('Pros and cons of trees, pros', 2, None, '___sec29'),
8787
('Disadvantages', 2, None, '___sec30'),
88-
('From a Single Tree to Many Trees, that is meet the Jungle of '
89-
'Methods',
88+
('From a Single Tree to Many Trees, Meet the Jungle of Methods',
9089
2,
9190
None,
9291
'___sec31'),
@@ -101,8 +100,14 @@
101100
('Now Bagging', 2, None, '___sec37'),
102101
('Random forests', 2, None, '___sec38'),
103102
('Random Forest Algorithm', 2, None, '___sec39'),
104-
('A simple scikit-learn example', 2, None, '___sec40'),
105-
('Then random forests', 2, None, '___sec41'),
103+
('Random Forests Compared with other Methods on the Cancer Data',
104+
2,
105+
None,
106+
'___sec40'),
107+
('Compare Bagging on Trees with Random Forests',
108+
2,
109+
None,
110+
'___sec41'),
106111
('Feature Importance', 2, None, '___sec42'),
107112
("Boosting, a Bird'e Eye", 2, None, '___sec43'),
108113
('Adaptive boosting: AdaBoost, Basic Algorithm',
@@ -187,7 +192,7 @@
187192
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs029.html#___sec28" style="font-size: 80%;">Final regressor code</a></li>
188193
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs030.html#___sec29" style="font-size: 80%;">Pros and cons of trees, pros</a></li>
189194
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs031.html#___sec30" style="font-size: 80%;">Disadvantages</a></li>
190-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, that is meet the Jungle of Methods</a></li>
195+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, Meet the Jungle of Methods</a></li>
191196
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs033.html#___sec32" style="font-size: 80%;">Bagging</a></li>
192197
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs034.html#___sec33" style="font-size: 80%;">More bagging</a></li>
193198
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs035.html#___sec34" style="font-size: 80%;">Simple Voting Example, head or tail</a></li>
@@ -196,8 +201,8 @@
196201
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs038.html#___sec37" style="font-size: 80%;">Now Bagging</a></li>
197202
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs039.html#___sec38" style="font-size: 80%;">Random forests</a></li>
198203
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs040.html#___sec39" style="font-size: 80%;">Random Forest Algorithm</a></li>
199-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">A simple scikit-learn example</a></li>
200-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Then random forests</a></li>
204+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">Random Forests Compared with other Methods on the Cancer Data</a></li>
205+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Compare Bagging on Trees with Random Forests</a></li>
201206
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs043.html#___sec42" style="font-size: 80%;">Feature Importance</a></li>
202207
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs044.html#___sec43" style="font-size: 80%;">Boosting, a Bird'e Eye</a></li>
203208
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs045.html#___sec44" style="font-size: 80%;">Adaptive boosting: AdaBoost, Basic Algorithm</a></li>

‎doc/pub/DecisionTrees/html/._DecisionTrees-bs003.html‎

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -85,8 +85,7 @@
8585
('Final regressor code', 2, None, '___sec28'),
8686
('Pros and cons of trees, pros', 2, None, '___sec29'),
8787
('Disadvantages', 2, None, '___sec30'),
88-
('From a Single Tree to Many Trees, that is meet the Jungle of '
89-
'Methods',
88+
('From a Single Tree to Many Trees, Meet the Jungle of Methods',
9089
2,
9190
None,
9291
'___sec31'),
@@ -101,8 +100,14 @@
101100
('Now Bagging', 2, None, '___sec37'),
102101
('Random forests', 2, None, '___sec38'),
103102
('Random Forest Algorithm', 2, None, '___sec39'),
104-
('A simple scikit-learn example', 2, None, '___sec40'),
105-
('Then random forests', 2, None, '___sec41'),
103+
('Random Forests Compared with other Methods on the Cancer Data',
104+
2,
105+
None,
106+
'___sec40'),
107+
('Compare Bagging on Trees with Random Forests',
108+
2,
109+
None,
110+
'___sec41'),
106111
('Feature Importance', 2, None, '___sec42'),
107112
("Boosting, a Bird'e Eye", 2, None, '___sec43'),
108113
('Adaptive boosting: AdaBoost, Basic Algorithm',
@@ -187,7 +192,7 @@
187192
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs029.html#___sec28" style="font-size: 80%;">Final regressor code</a></li>
188193
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs030.html#___sec29" style="font-size: 80%;">Pros and cons of trees, pros</a></li>
189194
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs031.html#___sec30" style="font-size: 80%;">Disadvantages</a></li>
190-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, that is meet the Jungle of Methods</a></li>
195+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, Meet the Jungle of Methods</a></li>
191196
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs033.html#___sec32" style="font-size: 80%;">Bagging</a></li>
192197
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs034.html#___sec33" style="font-size: 80%;">More bagging</a></li>
193198
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs035.html#___sec34" style="font-size: 80%;">Simple Voting Example, head or tail</a></li>
@@ -196,8 +201,8 @@
196201
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs038.html#___sec37" style="font-size: 80%;">Now Bagging</a></li>
197202
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs039.html#___sec38" style="font-size: 80%;">Random forests</a></li>
198203
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs040.html#___sec39" style="font-size: 80%;">Random Forest Algorithm</a></li>
199-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">A simple scikit-learn example</a></li>
200-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Then random forests</a></li>
204+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">Random Forests Compared with other Methods on the Cancer Data</a></li>
205+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Compare Bagging on Trees with Random Forests</a></li>
201206
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs043.html#___sec42" style="font-size: 80%;">Feature Importance</a></li>
202207
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs044.html#___sec43" style="font-size: 80%;">Boosting, a Bird'e Eye</a></li>
203208
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs045.html#___sec44" style="font-size: 80%;">Adaptive boosting: AdaBoost, Basic Algorithm</a></li>

‎doc/pub/DecisionTrees/html/._DecisionTrees-bs004.html‎

Lines changed: 12 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -85,8 +85,7 @@
8585
('Final regressor code', 2, None, '___sec28'),
8686
('Pros and cons of trees, pros', 2, None, '___sec29'),
8787
('Disadvantages', 2, None, '___sec30'),
88-
('From a Single Tree to Many Trees, that is meet the Jungle of '
89-
'Methods',
88+
('From a Single Tree to Many Trees, Meet the Jungle of Methods',
9089
2,
9190
None,
9291
'___sec31'),
@@ -101,8 +100,14 @@
101100
('Now Bagging', 2, None, '___sec37'),
102101
('Random forests', 2, None, '___sec38'),
103102
('Random Forest Algorithm', 2, None, '___sec39'),
104-
('A simple scikit-learn example', 2, None, '___sec40'),
105-
('Then random forests', 2, None, '___sec41'),
103+
('Random Forests Compared with other Methods on the Cancer Data',
104+
2,
105+
None,
106+
'___sec40'),
107+
('Compare Bagging on Trees with Random Forests',
108+
2,
109+
None,
110+
'___sec41'),
106111
('Feature Importance', 2, None, '___sec42'),
107112
("Boosting, a Bird'e Eye", 2, None, '___sec43'),
108113
('Adaptive boosting: AdaBoost, Basic Algorithm',
@@ -187,7 +192,7 @@
187192
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs029.html#___sec28" style="font-size: 80%;">Final regressor code</a></li>
188193
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs030.html#___sec29" style="font-size: 80%;">Pros and cons of trees, pros</a></li>
189194
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs031.html#___sec30" style="font-size: 80%;">Disadvantages</a></li>
190-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, that is meet the Jungle of Methods</a></li>
195+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs032.html#___sec31" style="font-size: 80%;">From a Single Tree to Many Trees, Meet the Jungle of Methods</a></li>
191196
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs033.html#___sec32" style="font-size: 80%;">Bagging</a></li>
192197
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs034.html#___sec33" style="font-size: 80%;">More bagging</a></li>
193198
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs035.html#___sec34" style="font-size: 80%;">Simple Voting Example, head or tail</a></li>
@@ -196,8 +201,8 @@
196201
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs038.html#___sec37" style="font-size: 80%;">Now Bagging</a></li>
197202
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs039.html#___sec38" style="font-size: 80%;">Random forests</a></li>
198203
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs040.html#___sec39" style="font-size: 80%;">Random Forest Algorithm</a></li>
199-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">A simple scikit-learn example</a></li>
200-
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Then random forests</a></li>
204+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs041.html#___sec40" style="font-size: 80%;">Random Forests Compared with other Methods on the Cancer Data</a></li>
205+
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs042.html#___sec41" style="font-size: 80%;">Compare Bagging on Trees with Random Forests</a></li>
201206
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs043.html#___sec42" style="font-size: 80%;">Feature Importance</a></li>
202207
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs044.html#___sec43" style="font-size: 80%;">Boosting, a Bird'e Eye</a></li>
203208
<!-- navigation toc: --> <li><a href="._DecisionTrees-bs045.html#___sec44" style="font-size: 80%;">Adaptive boosting: AdaBoost, Basic Algorithm</a></li>

0 commit comments

Comments
 (0)