公开(公告)号：US20150189216A1

公开(公告)日：2015-07-02

申请号：US14657431

申请日：2015-03-13

Applicant: SONY CORPORATION

Inventor： Masaki FUKUCHI ,  Kouichi MATSUDA ,  Yasuhiro SUTO ,  Kenichiro OI ,  Jingjing GUO

IPC: H04N5/44 ,  G06K9/32

CPC classification number: G06F3/005 ,  G06K9/3241 ,  G08C2201/20 ,  H04N5/4403 ,  H04N21/4108 ,  H04N21/42204 ,  H04N21/42209 ,  H04N21/4222 ,  H04N21/42222 ,  H04N21/4223 ,  H04N21/43615 ,  H04N21/44008 ,  H04N2005/4408 ,  H04N2005/4428 ,  H04N2005/4435

Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.

Abstract translation: 提供了一种图像处理装置，包括：数据存储单元，其存储用于识别用户可操作的对象的对象标识数据和指示每个对象的外观特征的特征数据; 环境地图存储单元，其存储表示存在于实际空间中并且基于通过使用成像装置对实际空间进行成像而获得的输入图像生成的一个或多个对象的位置的环境地图，以及存储在数据存储单元中的特征数据 ; 以及选择单元，其基于所述对象识别数据选择被识别为可操作的对象，所述对象包括在存储在所述环境地图存储单元中的环境地图中的对象中，作为由用户可能的操作对象的候选对象 。

公开(公告)号：US20140003667A1

公开(公告)日：2014-01-02

申请号：US14014785

申请日：2013-08-30

Applicant: SONY CORPORATION

Inventor： Masaki FUKUCHI ,  Kouichi MATSUDA ,  Yasuhiro SUTO ,  Kenichiro OI ,  Jingjing GUO

IPC: G06K9/32

CPC classification number: G06F3/005 ,  G06K9/3241 ,  G08C2201/20 ,  H04N5/4403 ,  H04N21/4108 ,  H04N21/42204 ,  H04N21/42209 ,  H04N21/4222 ,  H04N21/42222 ,  H04N21/4223 ,  H04N21/43615 ,  H04N21/44008 ,  H04N2005/4408 ,  H04N2005/4428 ,  H04N2005/4435

Abstract: There is provided an image processing device including: a data storage unit that stores object identification data for identifying an object operable by a user and feature data indicating a feature of appearance of each object; an environment map storage unit that stores an environment map representing a position of one or more objects existing in a real space and generated based on an input image obtained by imaging the real space using an imaging device and the feature data stored in the data storage unit; and a selecting unit that selects at least one object recognized as being operable based on the object identification data, out of the objects included in the environment map stored in the environment map storage unit, as a candidate object being a possible operation target by a user.

公开(公告)号：US20160371301A1

公开(公告)日：2016-12-22

申请号：US15253188

申请日：2016-08-31

Applicant: SONY CORPORATION

Inventor： Kenichiro OI ,  Quan Wang ,  Kouichi MATSUDA ,  Takayuki YOSHIGAHARA

IPC: G06F17/30 ,  H04W4/02 ,  G06T15/20 ,  G06T7/60 ,  G06T11/20 ,  G06T7/00

CPC classification number: G06F17/30241 ,  G06F17/3028 ,  G06F17/30377 ,  G06K9/18 ,  G06T1/20 ,  G06T3/20 ,  G06T7/20 ,  G06T7/60 ,  G06T7/70 ,  G06T11/20 ,  G06T15/20 ,  G06T2200/04 ,  G06T2219/024 ,  G09G5/006 ,  G09G2370/02 ,  H04W4/02 ,  H04W4/025

Abstract: There is provided an information processing device including: a global map acquiring unit that acquires at least a part of a global map representing positions of objects in a real space where a plurality of users are in activity; a local map generating unit that generates a local map representing positions of nearby objects detectable by a device of one user among the plurality of users; and an updating unit that updates the global map based on position data of objects included in the local map

公开(公告)号：US20150241986A1

公开(公告)日：2015-08-27

申请号：US14708680

申请日：2015-05-11

Applicant: SONY CORPORATION

Inventor： Kouichi MATSUDA

IPC: G06F3/01 ,  G06F3/00 ,  G02B27/01

CPC classification number: G06F3/017 ,  G02B27/01 ,  G02B27/017 ,  G02B27/0172 ,  G02B2027/0174 ,  G06F3/005 ,  G06F3/012 ,  G06F3/013 ,  G06F3/0304 ,  G06F3/048 ,  G06K9/00355 ,  G06K9/00671 ,  H04N1/00381

Abstract: Disclosed herein is an information processor including, a storage section configured to store data representing the appearance features of a target device and data of an operation image used for operation of the target device, an acquisition section configured to acquire an image captured by a camera, a recognition section configured to recognize an object included in the image based on the feature quantity data stored in the storage section, and a display control section configured to display the operation image based on the data of the operation image stored in the storage section if the object included in the image is recognized by the recognition section as the target device.

Abstract translation: 本文公开了一种信息处理器，包括：存储部，被配置为存储表示目标设备的外观特征的数据和用于目标设备的操作的操作图像的数据;获取部，被配置为获取由相机拍摄的图像， 识别部，被配置为基于存储在存储部中的特征量数据识别包含在图像中的对象;以及显示控制部，被配置为基于存储在存储部中的操作图像的数据来显示操作图像，如果 包含在图像中的对象被识别部识别为目标装置。

公开(公告)号：US20150049116A1

公开(公告)日：2015-02-19

申请号：US14527148

申请日：2014-10-29

Applicant: SONY CORPORATION

Inventor： Yasuhiro SUTO ,  Masaki FUKUCHI ,  Kenichiro OI ,  Jingjing GUO ,  Kouichi MATSUDA

IPC: G06T19/00

CPC classification number: G06T19/006 ,  G02B27/0172 ,  G02B2027/014 ,  G06T11/60 ,  G06T19/003 ,  G09G5/00

Abstract: There is provided an image processing device including: a data storage unit storing feature data indicating a feature of appearance of one or more physical objects; an environment map building unit for building an environment map based on an input image obtained by imaging a real space and the feature data, the environment map representing a position of a physical object present in the real space: a control unit for acquiring procedure data for a set of procedures of operation to be performed in the real space, the procedure data defining a correspondence between a direction for each procedure and position information designating a position at which the direction is Cu be displayed; and a superimposing unit for generating an output image by superimposing the direction for each procedure at a position in the input image determined based on the environment map and the position information, using the procedure data.

Abstract translation: 提供了一种图像处理装置，包括：数据存储单元，存储指示一个或多个物理对象的外观特征的特征数据; 环境地图构建单元，用于基于通过对实际空间进行成像获得的输入图像和特征数据构建环境地图，所述环境地图表示存在于所述实际空间中的物理对象的位置;控制单元，用于获取 一组要在实际空间中执行的操作程序，定义每个过程的方向与指定方向为Cu的位置的位置信息之间的对应关系的过程数据被显示; 以及叠加单元，用于通过使用过程数据在基于环境地图确定的输入图像中的位置和位置信息上叠加用于每个过程的方向来生成输出图像。

公开(公告)号：US20140267028A1

公开(公告)日：2014-09-18

申请号：US14293391

申请日：2014-06-02

Applicant: SONY CORPORATION

Inventor： Kouichi MATSUDA

IPC: G02B27/01

CPC classification number: G02B27/017 ,  G02B2027/0178 ,  G06F3/011 ,  G06F3/017 ,  G06F3/04815

Abstract: There is provided an image processing apparatus including: an input image acquisition unit for obtaining an input image generated by taking an image of a real space; an image recognition unit for recognizing, when a first user-input representing a start of manipulation is detected, a manipulator used for manipulating a virtual object, wherein the manipulator appears in the input image; a calculation unit for calculating, according to a result of the recognition of the manipulator provided by the image recognition unit, a position on a screen of a display device at which the virtual object is to be displayed; a display control unit for displaying the virtual object at the position of the screen of the display device calculated by the calculation unit; and a communication unit for transmitting, when the first user-input is detected, a first notification signal for notifying the start of manipulation to another apparatus displaying the same virtual object.

Abstract translation: 提供了一种图像处理装置，包括：输入图像获取单元，用于获得通过拍摄真实空间的图像而产生的输入图像; 图像识别单元，用于当检测到表示操作开始的第一用户输入时，识别用于操纵虚拟对象的操纵器，其中所述操纵器出现在所述输入图像中; 计算单元，根据由所述图像识别单元提供的所述机械手的识别结果，计算要显示所述虚拟对象的显示设备的屏幕上的位置; 显示控制单元，用于在由计算单元计算的显示设备的屏幕的位置处显示虚拟对象; 以及通信单元，用于当检测到第一用户输入时，发送用于向显示相同虚拟对象的另一装置通知开始操作的第一通知信号。