Class: LLaMACpp::Timings

Inherits:
Object
  • Object
show all
Defined in:
ext/llama_cpp/dummy.rb

Overview

Class for timings

Instance Method Summary collapse

Instance Method Details

#n_eval ⇒ Integer

Returns the number of evaluations.

Returns:

  • (Integer) 


1194
 
# File 'ext/llama_cpp/dummy.rb', line 1194

def n_eval; end

#n_p_eval ⇒ Integer

Returns the number of prompt evaluations.

Returns:

  • (Integer) 


1190
 
# File 'ext/llama_cpp/dummy.rb', line 1190

def n_p_eval; end

#n_sample ⇒ Integer

Returns the number of samples.

Returns:

  • (Integer) 


1186
 
# File 'ext/llama_cpp/dummy.rb', line 1186

def n_sample; end

#t_end_ms ⇒ Float

Returns the time to end.

Returns:

  • (Float) 


1166
 
# File 'ext/llama_cpp/dummy.rb', line 1166

def t_end_ms; end

#t_eval_ms ⇒ Float

Returns the time to evaluate.

Returns:

  • (Float) 


1182
 
# File 'ext/llama_cpp/dummy.rb', line 1182

def t_eval_ms; end

#t_load_ms ⇒ Float

Returns the time to load model.

Returns:

  • (Float) 


1170
 
# File 'ext/llama_cpp/dummy.rb', line 1170

def t_load_ms; end

#t_p_eval_ms ⇒ Float

Returns the time to evaluate prompt.

Returns:

  • (Float) 


1178
 
# File 'ext/llama_cpp/dummy.rb', line 1178

def t_p_eval_ms; end

#t_sample_ms ⇒ Float

Returns the sampling time.

Returns:

  • (Float) 


1174
 
# File 'ext/llama_cpp/dummy.rb', line 1174

def t_sample_ms; end

#t_start_ms ⇒ Float

Returns the time to start.

Returns:

  • (Float) 


1162
 
# File 'ext/llama_cpp/dummy.rb', line 1162

def t_start_ms; end