ENVIRONMENT-MODELING BASED CAMERA ADAPTATION FOR PASSTHROUGH EXTENDED REALITY SYSTEMS

    公开(公告)号:US20250111589A1

    公开(公告)日:2025-04-03

    申请号:US18826434

    申请日:2024-09-06

    Applicant: Apple Inc.

    Abstract: Various implementations provide passthrough video based on adjusting camera parameters based on environment modeling. An environment characteristic may be determined based on modeling the physical environment based on sensor data captured via one or more sensors. For example, this may involve determining environment light source optical characteristics, environment surfaces optical characteristics, a 3D mapping of the environment, user behavior, a prediction of optical characteristics of light coming in the camera, and the like. The method may involve, based on the environment characteristic, determining a camera parameter for an image captured via the image sensor. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine the camera parameter based on user information, e.g., user preferences, user activity, etc. The method may involve providing passthrough video of the physical environment based on the determined camera parameter.

Patent Agency Ranking