Composable Julia packages for robust multiple-view geometry: geometric types, file formats, feature detection, robust estimation and RANSAC, calibration (camera and lens models, hand–eye), fiducial markers (BlobBoards), evaluation protocols, and a PoseLib wrapper, factored so each layer is usable on its own.
This repository is a Julia workspace. Each directory below is a separately registered package with its own version, tests and documentation.
| Package | Role | Docs |
|---|---|---|
| VisualGeometryToolkitCore | Geometric types, frames, camera and lens models, minimal solvers, scale-space kernels, the robust-estimation contracts | docs |
| VisualGeometryToolkitIO | Versioned file formats: cameras, rigs, observations, targets, correspondences | docs |
| VisualGeometryToolkitFeatures | Feature detection (ASIFT/DoG with keypoint covariance) and matching | docs |
| VisualGeometryToolkitEstimation | The RANSAC loop, problem implementations, IRLS, hand–eye calibration | docs |
| VisualGeometryToolkitEval | Evaluation protocol, benchmark pools, tuning, reproducible paper projects | docs |
| PoseLib | Julia wrapper of the PoseLib minimal solvers (prebuilt binaries from PoseLib_jll) |
docs |
Public packages that build on these and live in their own repositories:
| Package | Role | Repository |
|---|---|---|
| RANSACScoringDoneRight | Scale-free marginal RANSAC scoring | VisualGeometryToolkit/RANSACScoringDoneRight.jl |
| LocalOptimizationDoneRight | Local optimization for RANSAC | VisualGeometryToolkit/LocalOptimizationDoneRight.jl |
| BlobBoards | Fiducial blob-board targets: design, detection and tracking | VisualGeometryToolkit/BlobBoards.jl |
| PanoramaStitching | Rotation-only panoramas: feature matching on unit bearings, robust rotation averaging and a rotation bundle | VisualGeometryToolkit/PanoramaStitching.jl |
All documentation is aggregated at https://visualgeometrytoolkit.github.io.
graph TD
VGC["VisualGeometryToolkitCore"]
VGF["VisualGeometryToolkitFeatures"]
VGIO["VisualGeometryToolkitIO"]
RVG["VisualGeometryToolkitEstimation"]
PL["PoseLib"]
VGE["VisualGeometryToolkitEval"]
subgraph separate["separate repositories"]
RSDR["RANSACScoringDoneRight"]
LODR["LocalOptimizationDoneRight"]
BB["BlobBoards"]
PS["PanoramaStitching"]
end
VGC --> VGF
VGC --> VGIO
VGC --> RVG
VGC --> PL
VGC --> RSDR
VGIO --> VGE
RVG --> VGE
RVG --> LODR
PL -.-> LODR
VGF --> BB
VGIO --> BB
RSDR --> BB
LODR --> BB
VGF --> PS
RVG --> PS
Each package builds on the ones above it (direct dependencies; edges implied through another package are omitted). Dashed: optional (package extension).
VisualGeometryToolkitCore, VisualGeometryToolkitIO, VisualGeometryToolkitFeatures and VisualGeometryToolkitEstimation are in the General registry:
using Pkg
Pkg.add("VisualGeometryToolkitEstimation") # pulls VisualGeometryToolkitCoreVisualGeometryToolkitEval and PoseLib are in CauRegistry until their General registrations merge. For them, add both registries once per depot (General first: Pkg adds it on its own only to an empty depot):
Pkg.Registry.add("General")
Pkg.Registry.add(url = "https://github.com/prittjam/CauRegistry.jl")
Pkg.add("VisualGeometryToolkitEval")Manifests record each package by UUID, version and tree hash, never by registry, so an environment resolves the same from either registry.
The Schur complement of the LM driver. The stack's Levenberg–Marquardt driver is NLLSsolver; release 5.3.1 contains our pull requests #61–#65 (allocation-free copies, OptimizeCache, the trial-point reuse, a NaN trial rejected, a non-finite start stopped). One remains open, #60, the Schur-complement linear system for eliminable variables: without it, everything is correct but the bundles that eliminate variables (the relative-pose bundle, PanoramaStitching's rotation bundle) solve the full system and run slower. To use it now, pin our fork once in your environment:
using Pkg
Pkg.add(PackageSpec(url = "https://github.com/prittjam/NLLSsolver.jl", rev = "stack"))stack is the latest upstream release plus #60. Verify with using NLLSsolver; isdefined(NLLSsolver, :MultiVariateLSschur) → true. When an upstream release contains #60, Pkg.free("NLLSsolver") returns the environment to the registry and this note is removed.
git clone https://github.com/VisualGeometryToolkit/VisualGeometryToolkit.jl
cd VisualGeometryToolkit.jl
git config core.hooksPath .githooks
julia --project=. -e 'using Pkg; Pkg.instantiate()'
julia --project=VisualGeometryToolkitCore -e 'using Pkg; Pkg.test()'Inside the workspace every stack package resolves to its directory here, so a change to VisualGeometryToolkitCore is seen by the packages that depend on it. See CLAUDE.md for the conventions and RELEASING.md for registration.
Cite the toolkit; CITATION.cff is the source of this entry (GitHub's "Cite this repository" button exports it):
@software{pritts2026vgtk,
author = {Pritts, James and Sauer, Hendrik},
title = {{VisualGeometryToolkit.jl}: Julia Packages for Multiple-View Geometry},
url = {https://github.com/VisualGeometryToolkit/VisualGeometryToolkit.jl},
doi = {10.5281/zenodo.23548372},
year = {2026}
}Cite also the papers behind the methods you use, listed on the portal.
MIT, James Pritts; PoseLib, MIT, Kiel University (each package directory carries its own copy). See AUTHORS.md.
Maintainer: James Pritts.