Asking about Events

Since v1.3 LLM Vision can remember analyzed events and store them so you can ask about them later.

Setting up LLM Vision Events

To use this you need to set up 'Event Calendar' which you can add from the LLM Vision integration page. Then choose for how many days events should be remembered. 0 will keep events forever.

The easiest way to use the 'remember' feature is to use the official blueprint. You can also set remember to true in any of LLM Vision's actions. You can see your events in the calendar dashboard.

Asking about events

To ask about events you need to install an integration that can control entities in Home Assistant. Extended OpenAI Conversation is recommended as it is the easiest to setup and use. Now add this 'spec' to the configuration:

LLM Vision spec

- spec:
    name: get_security_events
    description: Use this function to get list of security events captured by cameras around the house.
    parameters:
      type: object
      properties:
        start_date_time:
          type: string
          description: The start datetime in '%Y-%m-%dT%H:%M:%S%z' format for the time window of the request
        end_date_time:
          type: string
          description: The end datetime in '%Y-%m-%dT%H:%M:%S%z' format for the time window of the request
      required:
      - start_date_time
      - end_date_time
  function:
    type: script
    sequence:
    - service: calendar.get_events
      data:
        start_date_time: "{{start_date_time}}"
        end_date_time: "{{end_date_time}}"
      target:
        entity_id: "calendar.llm_vision_events"
      response_variable: _function_result