USE OF LLM AND VISION MODELS WITH A DIGITAL ASSISTANT

    公开(公告)号:US20250104429A1

    公开(公告)日:2025-03-27

    申请号:US18892098

    申请日:2024-09-20

    Applicant: Apple Inc.

    Abstract: Systems and processes for operating an intelligent automated assistant are provided. An example process includes receiving a first image from an input device of an electronic device; determining a first semantic description of an environment included in the first image; receiving a second image from the input device; determining a second semantic description of an environment included in the second image; determining a scene description based on the first semantic description and the second semantic description; and determining, based on the scene description, a task to be performed by a digital assistant.

Patent Agency Ranking