公开(公告)号：US20240095983A1

公开(公告)日：2024-03-21

申请号：US18039898

申请日：2021-12-01

Applicant: AMGEN INC.

Inventor： Al Patrick Goodwin ,  Joseph Peter Bernacki ,  Graham F. Milne ,  Thomas Clark Pearson ,  Aman Mahendra Jain ,  Jordan Ray Fine ,  Kenneth E. Hampshire ,  Aik Jun Tan ,  Osvaldo Perez Varela ,  Nishant Mukesh Gadhvi

IPC: G06T11/60 ,  G01N21/90 ,  G06T3/60 ,  G06T5/40 ,  G06V10/44

CPC classification number: G06T11/60 ,  G01N21/90 ,  G06T3/60 ,  G06T5/40 ,  G06V10/44

Abstract: Various techniques facilitate the development of an image library that can be used to train and/or validate an automated visual inspection (AVI) model, such an AVI neural network for image classification. In one aspect, an arithmetic transposition algorithm is used to generate synthetic images from original images by transposing features (e.g., defects) onto the original images, with pixel-level realism. In other aspects, digital inpainting techniques are used to generate realistic synthetic images from original images. Deep learning-based inpainting techniques may be used to add, remove, and/or modify defects or other depicted features. In still other aspects, quality control techniques are used to assess the suitability of image libraries for training and/or validation of AVI models, and/or to assess whether individual images are suitable for inclusion in such libraries.

公开(公告)号：US10962756B2

公开(公告)日：2021-03-30

申请号：US16709565

申请日：2019-12-10

Applicant: AMGEN INC.

Inventor： Dmitry Fradkin ,  Graham F. Milne ,  Thomas Clark Pearson

IPC: G02B21/26 ,  G06T7/00 ,  G02B21/08 ,  G06T7/254 ,  G06K9/62 ,  G02B21/36 ,  G02B21/06

Abstract: A system is described to facilitate the characterization of particles within a fluid contained in a vessel using an illumination system that directs source light through each vessel. One or more optical elements may be implemented to refract the source light and to illuminate the entire volume of the vessel. As the refracted source light passes through the vessel and interacts with particles suspended in the fluid, scattered light is produced and directed to an imager, while the refracted source light is diverted away from the imager to prevent the source light from drowning out the scattered light. The system can therefore advantageously utilize an imager with a large depth of field to accurately image the entire volume of fluid at the same time, facilitating the determination of the number and size of particles suspended in the fluid.

公开(公告)号：US20200249248A1

公开(公告)日：2020-08-06

申请号：US16741808

申请日：2020-01-14

Applicant: AMGEN INC.

Inventor： Brandon Zachary Sarich ,  Michael R. Berke ,  Chuck Z. Li ,  Thomas Clark Pearson

IPC: G01N35/00 ,  G01N35/10

Abstract: Methods and systems of performing an assay. A system for performing an assay includes an enclosure defining a temperature-controlled space. An imaging system, an actuator and a dispenser are disposed within the space. The actuator receives a well plate having wells. The actuator is to move the well plate relative to the imaging system to enable the imaging system to obtain image data of one of the wells. The dispenser includes a pump, an outlet and a reservoir holder to receive a reservoir containing a compound. The pump is to be fluidly coupled to the reservoir and an outlet. The pump is to pump the compound from the reservoir through the outlet into one of the wells. The system also includes a controller. The controller is to cause the dispenser to dispense the compound into the first one of the wells while the imaging system obtains the image data.

公开(公告)号：US09881367B1

公开(公告)日：2018-01-30

申请号：US15672494

申请日：2017-08-09

Applicant: AMGEN INC.

Inventor： Graham F. Milne ,  Thomas Clark Pearson ,  Erwin Freund

IPC: G06K9/00 ,  G06T7/00 ,  G06T7/11 ,  G06T7/13 ,  G06T7/33 ,  G06K9/62 ,  G06T7/50 ,  A61M5/315

CPC classification number: G06T7/001 ,  A61M5/315 ,  A61M2209/02 ,  G06K9/6202 ,  G06T7/11 ,  G06T7/13 ,  G06T7/337 ,  G06T7/50 ,  G06T2207/10028

Abstract: An automated visual inspection (AVI) system is described to measure the depth of plungers positioned within vessels. The AVI system implements various types of image processing as well as other techniques to identify, for a vessel, a reference point and the uppermost edge of the plunger. Because different inconsistencies and/or artifacts may be introduced within the vessel image, different processing techniques may be executed on the region containing the reference point versus the plunger region. In doing so, the AVI system provides a robust means to accurately measure plunger depth that is highly resilient to the aforementioned artifacts and consistently measures plunger depth for a wide variety and types of vessels.

公开(公告)号：US20250139756A1

公开(公告)日：2025-05-01

申请号：US18692360

申请日：2022-09-28

Applicant: AMGEN INC.

Inventor： Jordan Ray Fine ,  Thomas Clark Pearson ,  Graham F. Milne

IPC: G06T7/00 ,  A61M5/178 ,  G01F11/02 ,  G01F23/292 ,  G06T7/50 ,  H04N23/73 ,  H04N23/74

Abstract: Automatic prefilled syringe inspection systems, apparatus and methods are provided. The automatic syringe inspection systems, apparatus and methods may determine a plunger depth within a syringe that has been pre-filled with a medication. The plunger depth may be based on digital image data that is representative of a silhouette of at least a portion of a tubular vessel and at least a portion of a plunger within the tubular vessel.

公开(公告)号：US20240127540A1

公开(公告)日：2024-04-18

申请号：US18397218

申请日：2023-12-27

Applicant: AMGEN INC.

Inventor： Graham F. Milne ,  Dmitry Fradkin ,  Thomas Clark Pearson

IPC: G06T17/20 ,  G01N15/0227 ,  G01N15/06 ,  G06T7/20 ,  G06T15/06 ,  G06V10/762 ,  H04N5/06

CPC classification number: G06T17/20 ,  G01N15/0227 ,  G01N15/06 ,  G06T7/20 ,  G06T15/06 ,  G06V10/763 ,  H04N5/06 ,  G01N15/075 ,  G06T2200/08 ,  G06T2207/30242

Abstract: A method of aligning images for 3D imaging of a sample includes, for each of multiple cameras located around a vessel, activating a respective light source that provides backlighting for the vessel, and capturing a respective 2D calibration image of the vessel. The method also includes, for each 2D calibration image, measuring a respective vertical position, horizontal position, and rotation of the image, in part by detecting edges of the vessel as depicted in the image. The method also includes generating calibration data based on the measured vertical positions, horizontal positions, and rotations for the respective 2D calibration images, capturing, by each camera, a respective set of 2D images of the sample in the vessel, and digitally resampling, using the calibration data, at least one of the respective sets of 2D images to correct for vertical offset, horizontal offset, and rotational offset of the set(s) of 2D images.

公开(公告)号：US11874233B2

公开(公告)日：2024-01-16

申请号：US18089109

申请日：2022-12-27

Applicant: AMGEN INC.

Inventor： Thomas Clark Pearson ,  Graham F. Milne ,  Dmitry Fradkin ,  Erwin Freund

IPC: G01N21/90 ,  G06T7/00 ,  H04N23/74 ,  H04N23/84 ,  H04N23/90

CPC classification number: G01N21/9027 ,  G06T7/0004 ,  H04N23/74 ,  H04N23/84 ,  H04N23/90 ,  G01N2201/06113 ,  G06T2207/10024 ,  G06T2207/10152

Abstract: In a method for imaging a container holding a sample, the container is illuminated with a laser sheet of a first color, and one or more images of the container are capturing by a first imager configured to filter out colors other than the first color. Simultaneously with illuminating the container with the laser sheet of the first color, the container is illuminated with light of a second color different than the first color, wherein the light of the second color illuminates at least a majority of an entire volume of the container. One or more additional imagers of the container are captured by a second imager configured to filter out colors other than the second color. The one or more images and the one or more additional images are analyzed to detect particles within, and/or on an exterior surface of, the container.

公开(公告)号：US20220057336A1

公开(公告)日：2022-02-24

申请号：US17414544

申请日：2019-12-16

Applicant: AMGEN INC.

Inventor： Thomas Clark Pearson ,  Graham F. Milne ,  Dmitry Fradkin ,  Erwin Freund

IPC: G01N21/90 ,  G06T7/00 ,  H04N5/235 ,  H04N5/247 ,  H04N9/04

Abstract: In a method for imaging a container holding a sample, the container is illuminated with a laser sheet that impinges upon the container in a first direction corresponding to a first axis. A plane of the laser sheet is defined by the first axis and a second axis orthogonal to the first axis. The method also includes capturing, by a camera having an imaging axis that is substantially orthogonal to at least the first axis, an image of the container. The method further includes analyzing, by one or more processors, the image of the container to detect particles within, and/or on an exterior surface of, the container.

公开(公告)号：US20190011688A1

公开(公告)日：2019-01-10

申请号：US16113489

申请日：2018-08-27

Applicant: AMGEN INC.

Inventor： Dmitry Fradkin ,  Graham F. Milne ,  Thomas Clark Pearson

IPC: G02B21/26 ,  G02B21/08 ,  G02B21/36 ,  G06K9/62 ,  G06T7/254 ,  G06T7/00

Abstract: A system is described to facilitate the characterization of particles within a fluid contained in a vessel using an illumination system that directs source light through each vessel. One or more optical elements may be implemented to refract the source light and to illuminate the entire volume of the vessel. As the refracted source light passes through the vessel and interacts with particles suspended in the fluid, scattered light is produced and directed to an imager, while the refracted source light is diverted away from the imager to prevent the source light from drowning out the scattered light. The system can therefore advantageously utilize an imager with a large depth of field to accurately image the entire volume of fluid at the same time, facilitating the determination of the number and size of particles suspended in the fluid.

公开(公告)号：US12214383B2

公开(公告)日：2025-02-04

申请号：US18235419

申请日：2023-08-18

Applicant: AMGEN INC.

Inventor： Dmitry Fradkin ,  Thomas Clark Pearson ,  Neelima Chavali ,  Erwin Freund

IPC: G06N20/00 ,  B07C5/342 ,  G01N21/90 ,  G01N35/00 ,  G06T7/00

Abstract: A robotic inspection platform comprises a robotic arm, an imager, and a controller. The controller causes the robotic arm to retrieve, using its end effector, a container, and to manipulate the container such that the container is sequentially placed in a plurality of orientations while in view of the imager. The controller also causes the imager to capture images, with each of the images being captured while the container is in a respective one of the orientations. The controller also determines one or more attributes of the container, and/or a sample within the container, by analyzing the images using a pattern recognition model and, based on the attribute(s), determines whether the container and/or sample satisfies one or more criteria. If the container and/or sample fails to satisfy the criteria, the controller causes the robotic arm to place the container in an area (e.g., bin) reserved for rejected containers and/or samples.