博客
关于我
论文 :pix-loc
阅读量:776 次
发布时间:2019-03-24

本文共 3276 字,大约阅读时间需要 10 分钟。

Back to the Feature: Learning Robust Camera Localization from Pixels to Pose

Camera pose estimation in known scenes can be improved by focusing on learning robust and invariant visual features while leaving geometric estimation to principled algorithms.

Our approach leverages direct alignment of multiscale deep features, framing camera localization as a metric learning problem while also enhancing sparse feature matching accuracy.

Inspired by direct image alignment [22, 26, 27, 63, 90, 91] and learned image representations for outlier rejection [42], we advocate that end-to-end visual localization algorithms should prioritize representation learning.

By not requiring pose regression itself, the network can extract suitable features, ensuring accurate and scene-agnostic performance.

PixLoc achieves localization by aligning query and reference images based on the known 3D structure of the scene.

Motivation: In absolute pose and scene coordinate regression from a single image, a deep neural network learns to:

i) Recognize the approximate location in a scene,

ii) Recognize robust visual features tailored to this scene, and

iii) Regress accurate geometric quantities like pose or coordinates.

Given CNNs' ability to learn generalizable features, i) and ii) do not need to be scene-specific, and i) is already addressed by image retrieval.

On the other hand, iii) can be effectively handled by classical geometry using feature matching [19, 20, 28] or image alignment [4, 26, 27, 51] combined with 3D representation.

Therefore, focusing on learning robust and generalizable features is key, enabling scene-agnostic and tightly-constrained pose estimation by geometry.

The challenge lies in defining effective features for localization. We solve this by making geometric estimation differentiable and only supervising the final pose estimate.

Section 3.1: Localization as Image Alignment

Image Representation: Sparse alignment is performed over learned feature representations, utilizing CNNs' ability to extract hierarchical features at multiple levels.

The features are L2-normalized along channels to enhance robustness and generalization across datasets.

This representation, inspired by past works on handcrafted and learned features for camera tracking [22, 52, 63, 85, 90, 93], is robust to significant illumination and viewpoint changes, providing meaningful gradients for successful alignments despite initial pose inaccuracies.

Direct Alignment: The geometric optimization aims to find the pose (R, t), aligning query and reference images based on scene structure.

Visual Priors: Combining pointwise uncertainties of query and reference images into per-residual weights allows the network to learn uncertainty, such as in domain shift scenarios, similar to aleatoric uncertainty [36].

This weighting captures multiple scenarios, enhancing pose accuracy across different conditions.

Experiments: The refinement improves performance on RobotCar Night, which faces motion blur and challenges in sparse keypoint detection, while showing no improvement on RobotCar Day or being detrimental on Aachen at 0.25m, potentially due to limited ground truth accuracy or camera intrinsics.

The difficulty of RobotCar Oxford dataset may also contribute to these results.

转载地址:http://jiokk.baihongyu.com/

你可能感兴趣的文章
memcache、redis原理对比
查看>>
memset初始化高维数组为-1/0
查看>>
Metasploit CGI网关接口渗透测试实战
查看>>
Metasploit Web服务器渗透测试实战
查看>>
Moment.js常见用法总结
查看>>
MongoDB出现Error parsing command line: unrecognised option ‘--fork‘ 的解决方法
查看>>
mxGraph改变图形大小重置overlay位置
查看>>
MongoDB学习笔记(8)--索引及优化索引
查看>>
MQTT工作笔记0009---订阅主题和订阅确认
查看>>
ms sql server 2008 sp2更新异常
查看>>
MS UC 2013-0-Prepare Tool
查看>>
msbuild发布web应用程序
查看>>
MSB与LSB
查看>>
MSCRM调用外部JS文件
查看>>
MSCRM调用外部JS文件
查看>>
MSEdgeDriver (Chromium) 不适用于版本 >= 79.0.313 (Canary)
查看>>
MsEdgeTTS开源项目使用教程
查看>>
msf
查看>>
MSSQL数据库查询优化(一)
查看>>
MSSQL日期格式转换函数(使用CONVERT)
查看>>