公开(公告)号：US20230100111A1

公开(公告)日：2023-03-30

申请号：US18062819

申请日：2022-12-07

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Junhwan JANG ,  Woochool PARK ,  Jinwook YANG ,  Minsu CHOI ,  Junsuk LEE ,  Bonjae KOO

IPC: G06T19/00 ,  G06T19/20 ,  G06T7/70 ,  G06V10/44 ,  G06V10/74 ,  G06V20/40

Abstract: A content server and method supporting low-latency content streaming are proposed. The content server may include a communication unit and a controller. The communication unit may perform communication with a user terminal. The controller may calculate coordinates for a current user's location and camera pose and create a three-dimensional (3D) space by using terminal data including an image received from the user terminal upon detecting access of the user terminal. Also, the controller may position an object in the created 3D space, render a video reproduced from a user's viewpoint as a two-dimensional (2D) video, generate server data by segmenting the rendered 2D video, and transmit the generated server data to the user terminal.

公开(公告)号：US20240107098A1

公开(公告)日：2024-03-28

申请号：US18529607

申请日：2023-12-05

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Junhwan JANG ,  Woochool PARK ,  Minsu CHOI ,  Junsuk LEE ,  Bonjae KOO

IPC: H04N21/266 ,  G06T15/00 ,  G06T19/00 ,  H04N21/234 ,  H04N21/258 ,  H04N21/442 ,  H04N21/81

CPC classification number: H04N21/266 ,  G06T15/00 ,  G06T19/006 ,  H04N21/234 ,  H04N21/25841 ,  H04N21/44209 ,  H04N21/8146

Abstract: Proposed are a mediation server operation method for an XR streaming service and XR streaming system supporting same, the mediation server operation method comprising the steps of: if a mediation server receives an XR content playback request from a connected user device, searching for an idle split rendering server; allocating the found idle split rendering server to the user device; receiving image data and sensor data from the user device; generating a rotation matrix on the basis of the received image data and sensor data; and transmitting the rotation matrix to the allocated split rendering server.

公开(公告)号：US20190166391A1

公开(公告)日：2019-05-30

申请号：US16204972

申请日：2018-11-29

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Woochool PARK ,  Junhwan JANG ,  Youngwha KIM ,  Jinwook YANG ,  Sangpil YOON ,  Hyunwook KIM ,  Eunkyung CHO ,  Minsu CHOI ,  Junsuk LEE ,  Jaeyoung YANG

IPC: H04N21/2343

Abstract: The present disclosure provides a system for providing an image-segmentation based streaming service. The system includes a communication circuit configured to establish a communication channel with a streaming server, a storage configured to store data provided by the streaming server, a display configured to output an image, a processor functionally connected to the communication circuit, the storage, and the display. The processor can detect a region-of-interest (ROI) of an output image associated with a media presentation description (MPD) provided by the streaming server and transmit the ROI information to the streaming server. The processor can also receive image segments of a first resolution corresponding to the ROI information and a full image of a second resolution from the streaming server. The processor can also synthesize the image segments of the first resolution and the full image of the second resolution to output a synthesized reconstruction image through the display.

公开(公告)号：US20230084960A1

公开(公告)日：2023-03-16

申请号：US18056144

申请日：2022-11-16

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Junhwan JANG ,  Woochool PARK ,  Jinwook YANG ,  Minsu CHOI ,  Junsuk LEE ,  Bonjae KOO

IPC: G06T19/00

Abstract: An edge server for providing a virtual reality (VR) image is proposed. The server may include a rendering synchronization unit synchronizing a visual field and a margin with a virtual reality device. The server may also include a rendering unit generating a rendered image by rendering a visual field area corresponding to the visual field and a margin area corresponding to the margin based on a rotation center in an entire virtual reality image. The server may further include an encoding unit generating a reduced margin area by dividing a resolution of the margin area by a scaling factor, and encoding the visual field area and the reduced margin area to generate a split virtual reality image including the encoded visual field area and the encoded reduced margin area. The server may further include a streaming transmission unit transmitting the split virtual reality image to the virtual reality device.

公开(公告)号：US20190158804A1

公开(公告)日：2019-05-23

申请号：US16198562

申请日：2018-11-21

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Woochool PARK ,  Junhwan JANG ,  Younghwa KIM ,  Jinwook YANG ,  Sangpil YOON ,  Hyunwook KIM ,  Eunkyung CHO ,  Minsu CHOI ,  Junsuk LEE ,  Jaeyoung YANG

IPC: H04N13/133 ,  H04N5/247 ,  H04N5/232 ,  G06T3/40

Abstract: The described technology provides a system and method of generating a 360-degree panoramic virtual reality (VR) image by using a plurality of photograph images. A plurality of image capturing devices capture and transmit the plurality of photograph images, respectively. An image conversion device receives the plurality of photograph images from the plurality of image capturing devices, calibrates each of the plurality of photograph images using characteristic information of respective one of the plurality of image capturing devices, and stitches calibrated photograph images to generate the 360-degree panoramic VR image. According to embodiments, the user can check a situation of a monitoring area while changing the viewpoint of the 360-degree panoramic VR image or enjoy the generated VR contents at a high degree of immersion.

公开(公告)号：US20210236929A1

公开(公告)日：2021-08-05

申请号：US17235528

申请日：2021-04-20

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Junhwan JANG ,  Woochool PARK ,  Jinwook YANG ,  Sangpil YOON ,  Minsu CHOI ,  Junsuk LEE ,  Suho SONG ,  Bonjae KOO

IPC: A63F13/5252 ,  H04N5/232

Abstract: This application relates to an apparatus and method for acquiring an in-game 360 virtual reality (VR) image by using a plurality of virtual cameras. In one aspect, the image acquisition apparatus includes a virtual camera group taking in-game images by using the plurality of virtual cameras. The image acquisition apparatus may also include a renderer generating textures for the taken images, generating a panoramic image by performing an equirectangular projection (ERP) mapping of the generated textures, and encoding the generated panoramic image. The image acquisition apparatus may further include an image generator generating a 360 VR image by combining audio information with the encoded panoramic image.

公开(公告)号：US20200154092A1

公开(公告)日：2020-05-14

申请号：US16714202

申请日：2019-12-13

Applicant: KOREA ELECTRONICS TECHNOLOGY INSTITUTE

Inventor： Junhwan JANG ,  Woochool PARK ,  Youngwha KIM ,  Jinwook YANG ,  Sangpil YOON ,  Hyunwook KIM ,  Eunkyung CHO ,  Minsu CHOI ,  Junsuk LEE ,  Jaeyoung YANG

IPC: H04N13/117 ,  H04N13/156 ,  H04N13/194 ,  H04N13/161 ,  H04L29/06

Abstract: An electronic device and a method for a tiled video multi-channel playback are disclosed. The electronic device includes a device communication unit and a device controller. The device communication unit establishes a communication channel with a streaming server. The device controller can detect a region of interest (ROI) of an image related to a media presentation description (MPD) tile provided by the streaming server, transmit ROI information to the streaming server and receive tiles of a tiled video having a first resolution and corresponding to the ROI information, a full video having a second resolution lower than the first resolution, and a plurality of 2D videos from the streaming server. The device controller can also generate a 360-degree VR video by synthesizing the video tiles and the full video, and control a simultaneous playback of the generated 360-degree VR video and the plurality of 2D videos.