Class: Rumale::Tree::ExtraTreeRegressor

Inherits:
DecisionTreeRegressor show all
Defined in:
rumale-tree/lib/rumale/tree/extra_tree_regressor.rb

Overview

ExtraTreeRegressor is a class that implements extra randomized tree for regression.

Reference

  • Geurts, P., Ernst, D., and Wehenkel, L., “Extremely randomized trees,” Machine Learning, vol. 63 (1), pp. 3–42, 2006.

Examples:

require 'rumale/tree/extra_tree_regressor'

estimator =
  Rumale::Tree::ExtraTreeRegressor.new(
    max_depth: 3, max_leaf_nodes: 10, min_samples_leaf: 5, random_seed: 1)
estimator.fit(training_samples, traininig_values)
results = estimator.predict(testing_samples)

Instance Attribute Summary collapse

Attributes inherited from Base::Estimator

#params

Instance Method Summary collapse

Methods inherited from DecisionTreeRegressor

#fit, #predict

Methods included from Base::Regressor

#fit, #predict, #score

Methods inherited from BaseDecisionTree

#apply

Constructor Details

#initialize(criterion: 'mse', max_depth: nil, max_leaf_nodes: nil, min_samples_leaf: 1, max_features: nil, random_seed: nil) ⇒ ExtraTreeRegressor

Create a new regressor with extra randomized tree algorithm.

Parameters:

  • criterion (String) (defaults to: 'mse') —

    The function to evaluate spliting point. Supported criteria are ‘mae’ and ‘mse’.

  • max_depth (Integer) (defaults to: nil) —

    The maximum depth of the tree. If nil is given, extra tree grows without concern for depth.

  • max_leaf_nodes (Integer) (defaults to: nil) —

    The maximum number of leaves on extra tree. If nil is given, number of leaves is not limited.

  • min_samples_leaf (Integer) (defaults to: 1) —

    The minimum number of samples at a leaf node.

  • max_features (Integer) (defaults to: nil) —

    The number of features to consider when searching optimal split point. If nil is given, split process considers all features.

  • random_seed (Integer) (defaults to: nil) —

    The seed value using to initialize the random generator. It is used to randomly determine the order of features when deciding spliting point.



49
50
51
52
 
# File 'rumale-tree/lib/rumale/tree/extra_tree_regressor.rb', line 49

def initialize(criterion: 'mse', max_depth: nil, max_leaf_nodes: nil, min_samples_leaf: 1, max_features: nil,
               random_seed: nil)
  super
end

Instance Attribute Details

#feature_importances ⇒ Numo::DFloat (readonly)

Return the importance for each feature.

Returns:

  • (Numo::DFloat) —

    (size: n_features)



23
24
25
 
# File 'rumale-tree/lib/rumale/tree/extra_tree_regressor.rb', line 23

def feature_importances
  @feature_importances
end

#leaf_values ⇒ Numo::DFloat (readonly)

Return the values assigned each leaf.

Returns:

  • (Numo::DFloat) —

    (shape: [n_leafs, n_outputs])



35
36
37
 
# File 'rumale-tree/lib/rumale/tree/extra_tree_regressor.rb', line 35

def leaf_values
  @leaf_values
end

#rng ⇒ Random (readonly)

Return the random generator for random selection of feature index.

Returns:

  • (Random) 


31
32
33
 
# File 'rumale-tree/lib/rumale/tree/extra_tree_regressor.rb', line 31

def rng
  @rng
end

#tree ⇒ Node (readonly)

Return the learned tree.

Returns:



27
28
29
 
# File 'rumale-tree/lib/rumale/tree/extra_tree_regressor.rb', line 27

def tree
  @tree
end