class BBS::AI::Chat

A persona talking through a client, with a short memory per caller.

Constants

PLAIN_TEXT: The default reply filter: what a plain-text terminal cannot show, Markdown marks and emoji.

Public Class Methods

new (persona:, client:, history: 6, key: :ai_history, filter: PLAIN_TEXT, options: {})

Source

# File lib/bbs/ai.rb, line 314
def initialize(persona:, client:, history: 6, key: :ai_history, filter: PLAIN_TEXT, options: {})
  @persona = persona
  @client  = client
  @history = history
  @key     = key
  @filter  = filter
  @options = persona.options.merge(options)
end

Creates a chat for persona (a Persona) answering through client (a Client).

history: how many past messages (user and assistant) to send along
key: where in the caller’s context Hash the history is kept
filter: a Regexp of characters removed from the reply, nil to keep everything
options: request fields that override the persona’s options

Public Instance Methods

reply (text, ctx = {}, facts: nil, fallback: nil, &on_text)

Source

# File lib/bbs/ai.rb, line 340
def reply(text, ctx = {}, facts: nil, fallback: nil, &on_text)
  text = text.to_s.dup.force_encoding(Encoding::UTF_8).scrub('').strip
  if (canned = @persona.deflect(text))
    return canned.tap { |line| on_text&.call(line) }
  end

  reply = (think(text, ctx, facts, &on_text) if @client.enabled?)
  return reply if reply

  (fallback || @persona.fallback(text)).tap { |line| on_text&.call(line) }
end

Returns the reply to the caller’s text. A deflect rule of the persona answers first; otherwise the model is asked (when the client is enabled) with the persona’s messages, the caller’s history from ctx and text; when that gives nothing, the fallback answers. With a block, the reply is also yielded piece by piece as it arrives, so the terminal can type it out live; a canned reply is yielded whole.

A model reply is added to the history in ctx (a Hash; anything else keeps no history), which is cut to the last history messages. A model error is reported on stderr, and a reply cut short by it is kept as it is.

facts: added to the system prompt for this request only (not kept in the history), see Persona#messages
fallback: the reply when the model is missing or fails, instead of the persona’s canned one, such as the looked-up facts as they are