Asking about Events

Since v1.3 LLM Vision can remember analyzed events and store them so you can ask about them later.

Asking Assist about remembered events

You will need to set up LLM Vision Events first: Setting up Events

The easiest way to use the 'remember' feature is to use the official blueprint. You can also set remember to true in any of LLM Vision's actions. You can see your events in the calendar dashboard.

Asking about events

To ask about events you need to install an integration that can control entities in Home Assistant. Extended OpenAI Conversation is recommended as it is the easiest to setup and use. Now add this 'spec' to the configuration:

LLM Vision spec

- spec:
    name: get_security_events
    description: Use this function to get list of security events captured by cameras around the house.
    parameters:
      type: object
      properties:
        start_date_time:
          type: string
          description: The start datetime in '%Y-%m-%dT%H:%M:%S%z' format for the time window of the request
        end_date_time:
          type: string
          description: The end datetime in '%Y-%m-%dT%H:%M:%S%z' format for the time window of the request
      required:
      - start_date_time
      - end_date_time
  function:
    type: script
    sequence:
    - service: calendar.get_events
      data:
        start_date_time: "{{start_date_time}}"
        end_date_time: "{{end_date_time}}"
      target:
        entity_id: "calendar.llm_vision_events"
      response_variable: _function_result