公开(公告)号：US20250054302A1

公开(公告)日：2025-02-13

申请号：US18809228

申请日：2024-08-19

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: G06V20/40 ,  A61B34/30 ,  G06F18/214 ,  G06F18/24 ,  G06N3/04 ,  G06N3/08 ,  G06T3/4046 ,  G06T3/60 ,  G06T7/11 ,  G06T7/70 ,  G06V10/40

Abstract: Disclosed are various user-presence/absence detection techniques based on deep learning. These user-presence/absence detection techniques can include building/training a deep-learning model including a user-presence/absence classifier based on training images of a user-seating area of a surgeon console under various clinically-relevant conditions. The trained user-presence/absence classifier can then be used during teleoperation/surgical procedures to monitor/track users in the user-seating area of the surgeon console, and continuously classify captured real-time video images of the user-seating area into either a user-presence classification or a user-absence classification. In some embodiments, the disclosed techniques can be used to detect a user-switching event at the surgeon console when a second user is detected to have entered the user-seating area after a first user is detected to have exited the user-seating area. If the second user is identified as a new user, the disclosed techniques can trigger a recalibration procedure to recalibrate surgeon-console settings for the new user.

公开(公告)号：US11488382B2

公开(公告)日：2022-11-01

申请号：US17017540

申请日：2020-09-10

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: G06V20/00 ,  G06V20/40 ,  A61B34/30 ,  G06T7/11 ,  G06T7/70 ,  G06V10/40 ,  G06K9/62 ,  G06N3/04 ,  G06N3/08 ,  G06T3/40 ,  G06T3/60

Abstract: Various user-presence/absence recognition techniques based on deep learning are provided. More specifically, these user-presence/absence recognition techniques include building/training a CNN-based image recognition model including a user-presence/absence classifier based on training images collected from the user-seating area of a surgeon console under various clinically-relevant conditions/cases. The trained user-presence/absence classifier can then be used during teleoperation/surgical procedures to monitor/track users in the user-seating area of the surgeon console, and continuously classify the real-time video images of the user-seating area as either a user-presence state or a user-absence state. In some embodiments, the user-presence/absence classifier can be used to detect a user-switching event at the surgeon console when a second user is detected to have entered the user-seating area after a first user is detected to have exited the user-seating area. If the second user is identified as a new user, the disclosed techniques can trigger a recalibration procedure for the new user.

公开(公告)号：US20230210579A1

公开(公告)日：2023-07-06

申请号：US17566116

申请日：2021-12-30

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi ,  Varun Kejriwal Goel ,  Danyal Fer ,  Jocelyn Barker ,  Amer Ghanem ,  Richard W. Timm

IPC: A61B18/12 ,  A61B18/14 ,  A61B34/30 ,  G16H20/40 ,  G06N20/00

CPC classification number: A61B18/1233 ,  A61B18/1482 ,  A61B18/1445 ,  A61B34/30 ,  G16H20/40 ,  G06N20/00 ,  A61B2018/00982

Abstract: Embodiments described herein provide various techniques and systems for building machine-learning surgical tool presence/absence detection models for processing surgical videos and predicting whether a surgical tool is present or absent in each video frame of a surgical video. In one aspect, a process for ensuring patient safety during a laparoscopic or robotic surgery involving an energy tool is disclosed. The process can begin receiving a real-time control signal indicating an operating state of an energy tool during the surgery. Next, the process receives real-time endoscope video images of the surgery. The process simultaneously applies a machine-learning surgical tool presence/absence detection model to the real-time endoscope video images to generate real-time decisions on a location of the energy tool in the real-time endoscope video images. The process then checks the real-time control signal against the real-time decisions to identify an unsafe event and takes a proper action when an unsafe event is identified.

公开(公告)号：US20230036019A1

公开(公告)日：2023-02-02

申请号：US17960680

申请日：2022-10-05

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: G06V20/40 ,  A61B34/30 ,  G06T7/11 ,  G06T7/70 ,  G06V10/40 ,  G06K9/62 ,  G06N3/04 ,  G06N3/08 ,  G06T3/40 ,  G06T3/60

Abstract: Disclosed are various user-presence/absence detection techniques based on deep learning. These user-presence/absence detection techniques can include building/training a deep-learning model including a user-presence/absence classifier based on training images of a user-seating area of a surgeon console under various clinically-relevant conditions. The trained user-presence/absence classifier can then be used during teleoperation/surgical procedures to monitor/track users in the user-seating area of the surgeon console, and continuously classify captured real-time video images of the user-seating area into either a user-presence classification or a user-absence classification. In some embodiments, the disclosed techniques can be used to detect a user-switching event at the surgeon console when a second user is detected to have entered the user-seating area after a first user is detected to have exited the user-seating area. If the second user is identified as a new user, the disclosed techniques can trigger a recalibration procedure to recalibrate surgeon-console settings for the new user.

公开(公告)号：US20220087763A1

公开(公告)日：2022-03-24

申请号：US17030182

申请日：2020-09-23

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: A61B34/00 ,  A61B34/35 ,  G16H40/67 ,  G06N3/04 ,  G06N3/08

Abstract: Disclosed are various user input device (UID) disengagement-detection techniques based on real-time time-series data processing and deep learning. More specifically, various disclosed UID disengagement-detection techniques include training a long short-term memory (LSTM) network-based classifier based on the acquired time-series data of UID motions including both surgical motions and docking motions. The trained deep-learning classifier can then be used during teleoperation sessions to monitor the movements of UIDs, and continuously classify the real-time UID motions as either teleoperation motions or docking motions. The disclosed disengagement-detection techniques can immediately disengage the UIDs from the surgical tools as soon as the monitored UID motions are classified as docking motions by the trained classifier, thereby preventing unintended surgical tool motions. The disclosed disengagement-detection techniques allow the UIDs and the surgical tools to become disengaged naturally by simply having the user putting the UIDs back to their docking positions without having to take any additional actions.

公开(公告)号：US20230127035A1

公开(公告)日：2023-04-27

申请号：US17977425

申请日：2022-10-31

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: A61B34/00 ,  A61B34/35

Abstract: A method for disengagement detection of a surgical instrument of a surgical robotic system, the method comprising: determining whether a user's head is unstable prior to disengagement of a teleoperation mode; determining whether a pressure release has occurred relative to at least one of a first user input device or a second user input device for controlling a surgical instrument of the surgical robotic system during the teleoperation mode; and in response to determining the user's head is unstable or determining the pressure release has occurred, determining whether a distance change between the first user input device and the second user input device indicates the user is performing an unintended action prior to disengagement of the teleoperation mode.

公开(公告)号：US20220076020A1

公开(公告)日：2022-03-10

申请号：US17017540

申请日：2020-09-10

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: G06K9/00 ,  G06T7/11 ,  G06T3/40 ,  G06T3/60 ,  G06K9/62 ,  G06T7/70 ,  G06K9/46 ,  G06N3/04 ,  G06N3/08 ,  A61B34/30

Abstract: Disclosed are various user-presence/absence recognition techniques based on deep learning. More specifically, various user-presence/absence recognition techniques include building/training a CNN-based image recognition model including a user-presence/absence classifier based on training images collected from the user-seating area of a surgeon console under various clinically-relevant conditions/cases. The trained user-presence/absence classifier can then be used during teleoperation/surgical procedures to monitor/track users in the user-seating area of the surgeon console, and continuously classify the real-time video images of the user-seating area as either a user-presence state or a user-absence state. In some embodiments, the disclosed techniques can be used to detect a user-switching event at the surgeon console when a second user is detected to have entered the user-seating area after a first user is detected to have exited the user-seating area. If the second user is identified as a new user, the disclosed techniques can trigger a recalibration procedure for the new user.

公开(公告)号：US20210282878A1

公开(公告)日：2021-09-16

申请号：US16815748

申请日：2020-03-11

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: A61B34/00 ,  A61B34/35

Abstract: A method for disengagement detection of a surgical instrument of a surgical robotic system, the method comprising: determining whether a user's head is unstable prior to disengagement of a teleoperation mode; determining whether a pressure release has occurred relative to at least one of a first user input device or a second user input device for controlling a surgical instrument of the surgical robotic system during the teleoperation mode; and in response to determining the user's head is unstable or determining the pressure release has occurred, determining whether a distance change between the first user input device and the second user input device indicates the user is performing an unintended action prior to disengagement of the teleoperation mode.

公开(公告)号：US12300024B2

公开(公告)日：2025-05-13

申请号：US17565219

申请日：2021-12-29

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: G06V40/16 ,  G06F21/62 ,  G06N20/20

Abstract: Disclosed are various face-detection and human de-identification systems and techniques based on deep learning. In one aspect, a process for de-identifying people captured in an operating room (OR) video is disclosed. This process can begin by receiving a sequence of video frames from an OR video. Next, the process applies a first machine-learning face detector based on a first deep-learning model to each video frame in the sequence of video frames to generate a first set of detected faces. The process further applies a second machine-learning face detector to the sequence of video frames to generate a second set of detected faces, wherein the second machine-learning face detector is constructed based on a second deep-learning model different from the first deep-learning model. The process subsequently de-identifies the received sequence of video frames by blurring out both the first set of detected faces and the second set of detected faces.

公开(公告)号：US12144575B2

公开(公告)日：2024-11-19

申请号：US17977425

申请日：2022-10-31

Applicant: Verb Surgical Inc.

Inventor： Meysam Torabi

IPC: A61B34/00 ,  A61B34/35 ,  A61B17/00

Abstract: A method for disengagement detection of a surgical instrument of a surgical robotic system, the method comprising: determining whether a user's head is unstable prior to disengagement of a teleoperation mode; determining whether a pressure release has occurred relative to at least one of a first user input device or a second user input device for controlling a surgical instrument of the surgical robotic system during the teleoperation mode; and in response to determining the user's head is unstable or determining the pressure release has occurred, determining whether a distance change between the first user input device and the second user input device indicates the user is performing an unintended action prior to disengagement of the teleoperation mode.