Class: LLaMACpp::Batch

Inherits:
Object
  • Object
show all
Defined in:
ext/llama_cpp/dummy.rb

Overview

Class for batch

Class Method Summary collapse

Instance Method Summary collapse

Constructor Details

#initialize(max_n_token:, n_embd:, max_n_seq:) ⇒ Batch

Create batch.

Parameters:

  • max_n_token (Integer) —

    The maximum number of tokens.

  • n_embd (Array<Float>) —

    The number of embedding.

  • max_n_seq (Integer) —

    The maximum number of sequence ids.



739
 
# File 'ext/llama_cpp/dummy.rb', line 739

def initialize(max_n_token:, n_embd:, max_n_seq:); end

Class Method Details

.get_one(tokens:, n_tokens:, pos_zero:, seq_id:) ⇒ Object

Create one batch.

Parameters:

  • tokens (Array<Integer>) —

    The tokens.

  • n_tokens (Integer) —

    The number of tokens.

  • pos_zero (Integer) —

    The position of zero.

  • seq_id (Integer) —

    The sequence id.



732
 
# File 'ext/llama_cpp/dummy.rb', line 732

def self.get_one(tokens:, n_tokens:, pos_zero:, seq_id:); end

Instance Method Details

#all_pos_one ⇒ Integer

Returns the all_pos_1 of llama_batch.

Returns:

  • (Integer) 


766
 
# File 'ext/llama_cpp/dummy.rb', line 766

def all_pos_one; end

#all_pos_one=(all_pos_one) ⇒ Integer

Sets the all_pos_1 of llama_batch.

Parameters:

  • all_pos_one (Integer)

Returns:

  • (Integer) 


762
 
# File 'ext/llama_cpp/dummy.rb', line 762

def all_pos_one=(all_pos_one); end

#all_pos_zero ⇒ Integer

Returns the all_pos_0 of llama_batch.

Returns:

  • (Integer) 


757
 
# File 'ext/llama_cpp/dummy.rb', line 757

def all_pos_zero; end

#all_pos_zero=(all_pos_zero) ⇒ Integer

Sets the all_pos_0 of llama_batch.

Parameters:

  • all_pos_zero (Integer)

Returns:

  • (Integer) 


753
 
# File 'ext/llama_cpp/dummy.rb', line 753

def all_pos_zero=(all_pos_zero); end

#all_seq_id ⇒ Integer

Returns the all_seq_id of llama_batch.

Returns:

  • (Integer) 


775
 
# File 'ext/llama_cpp/dummy.rb', line 775

def all_seq_id; end

#all_seq_id=(all_seq_id) ⇒ Integer

Sets the all_seq_id of llama_batch.

Parameters:

  • all_seq_id (Integer)

Returns:

  • (Integer) 


771
 
# File 'ext/llama_cpp/dummy.rb', line 771

def all_seq_id=(all_seq_id); end

#get_logits(id) ⇒ Boolean

Returns the logits element.

Parameters:

  • id (Integer) —

    The id of logits array.

Returns:

  • (Boolean) 


829
 
# File 'ext/llama_cpp/dummy.rb', line 829

def get_logits(id); end

#get_n_seq_id ⇒ Integer

Returns the number of seq_id elements.

Returns:

  • (Integer) 


805
 
# File 'ext/llama_cpp/dummy.rb', line 805

def get_n_seq_id; end

#get_pos(id) ⇒ Object

Returns the pos element.

Parameters:

  • id (Integer) —

    The id of pos array.



796
 
# File 'ext/llama_cpp/dummy.rb', line 796

def get_pos(id); end

#get_seq_id(i, j) ⇒ Integer

Returns the seq_id element.

Parameters:

  • i (Integer) —

    The row id of seq_id array.

  • j (Integer) —

    The column id of seq_id array.

Returns:

  • (Integer) 


818
 
# File 'ext/llama_cpp/dummy.rb', line 818

def get_seq_id(i, j); end

#get_token(id) ⇒ Integer

Returns the token element.

Parameters:

  • id (Integer) —

    The id of token array.

Returns:

  • (Integer) 


786
 
# File 'ext/llama_cpp/dummy.rb', line 786

def get_token(id); end

#n_tokens ⇒ Integer

Returns the number of tokens.

Returns:

  • (Integer) 


748
 
# File 'ext/llama_cpp/dummy.rb', line 748

def n_tokens; end

#n_tokens=(n_tokens) ⇒ Integer

Sets the number of tokens.

Parameters:

  • n_tokens (Integer)

Returns:

  • (Integer) 


744
 
# File 'ext/llama_cpp/dummy.rb', line 744

def n_tokens=(n_tokens); end

#set_logits(id, value) ⇒ Boolean

Sets the logits element.

Parameters:

  • id (Integer) —

    The id of logits array.

  • value (Boolean) —

    The value of logits.

Returns:

  • (Boolean) 


824
 
# File 'ext/llama_cpp/dummy.rb', line 824

def set_logits(id, value); end

#set_n_seq_id(id, value) ⇒ Object

Sets the number of seq_id elements.

Parameters:

  • id (Integer) —

    The id of n_seq_id array.

  • value (Integer) —

    The value of n_seq_id.



801
 
# File 'ext/llama_cpp/dummy.rb', line 801

def set_n_seq_id(id, value); end

#set_pos(id, value) ⇒ Integer

Sets the pos element.

Parameters:

  • id (Integer) —

    The id of pos array.

  • value (Integer) —

    The value of pos.

Returns:

  • (Integer) 


792
 
# File 'ext/llama_cpp/dummy.rb', line 792

def set_pos(id, value); end

#set_seq_id(i, j, value) ⇒ Integer

Sets the seq_id element.

Parameters:

  • i (Integer) —

    The row id of seq_id array.

  • j (Integer) —

    The column id of seq_id array.

  • value (Integer) —

    The value of seq_id.

Returns:

  • (Integer) 


812
 
# File 'ext/llama_cpp/dummy.rb', line 812

def set_seq_id(i, j, value); end

#set_token(id, value) ⇒ Integer

Sets the token element.

Parameters:

  • id (Integer) —

    The id of token array.

  • value (Integer) —

    The value of token.

Returns:

  • (Integer) 


781
 
# File 'ext/llama_cpp/dummy.rb', line 781

def set_token(id, value); end