See the City Before It Happens

Every street has a story.
Some haven't happened yet.

Explore New York City through the eyes of a cyclist. Discover hidden risks, investigate near misses, and explore possible futures.

Explore NYC Rides
RealNYC GoPro footageYOLO11detections0–100Risk Score, not a crash probability

How it works

Three steps. No instructions needed.

01 · CHOOSE A RIDE

Pick any real NYC clip

Every ride is a 5-second GoPro segment indexed by the VAST pipeline with YOLO detections and a Cosmos caption.

02 · PICK A FEATURE

See, reveal, remember, ask

Project alternative futures, expose blind spots, search similar moments, or ask GHOST for evidence.

03 · EXPLORE

Click any object

Each tracked road user carries a live Risk Score from 0 to 100. Click it to understand why.

NYC Risk Atlas

The city, scored.

Every analyzed segment of three GoPro routes, placed where it happened in the ride. Find the hottest minute of the day, then jump straight into it.

Open the Atlas

Peak Risk Score per segment along the ride · live from analysis

Under the hood

Everything GHOST shows traces back to a component of the VAST video stack.

SOURCE

GoPro chunks on S3

78 thirty-second chunks, split into 465 five-second segments, camera nyc_bike_gopro-1.

DETECT

YOLO11 sidecars

460k boxes at 30 fps. GHOST reads them; it never adds or edits a detection.

UNDERSTAND

Cosmos captions + embeddings

Per-segment reasoning text and vectors power Street Memory and the Investigator.

SCORE

GHOST risk engine

ByteTrack-style tracking, focus-of-expansion ego motion, transparent 0–100 heuristic.

EXPLAIN

W&B inference

Llama 3.3 70B restates computed evidence in plain language. Deterministic fallback, always labeled.

Observed

  • YOLO boxes, labels, confidences
  • Track continuity inside a clip
  • Captions and search hits from the index

Projected

  • Constant-velocity image paths
  • Ego corridor from the focus of expansion
  • Continue / brake / evade futures

Uncertain, and shown as such

  • Amber uncertainty bands
  • "Visibility limited" wedges, never hidden objects
  • Scores are not crash probabilities

Challenge GHOST

Choose a situation. See what the AI discovers.

About

GHOST NYC is a bicycle safety intelligence layer built on the VAST video stack.

  • Footage: first-person NYC bike GoPro clips, camera nyc_bike_gopro-1.
  • Detections: YOLO11 sidecars from the pipeline. GHOST never adds boxes.
  • Tracking: ByteTrack-style association inside each clip.
  • Risk Score: a transparent 0–100 heuristic from path overlap, apparent proximity, closing motion, and timing.
  • Language: W&B serverless inference restates computed evidence. It cannot add observations.

What the numbers mean

Observations are YOLO boxes and tracks. Predictions are image-space projections of those tracks. Uncertainty is shown as amber. No value is a distance in meters or a measured crash probability.

0–2425–4950–7475–100

Choose a Ride

Every journey reveals something different.

NYC Risk Atlas

The city, scored.

Each bar is one real 5-second segment, placed where it happened in the ride and colored by its peak Risk Score. Click a bar to open that moment.

Top moments

Highest peak Risk Scores across all analyzed rides. Thumbnails are the actual frame at the peak.

Who shares the lane

Share of analyzed segments where each class was tracked.

Candidate events by interaction

Local Risk Score peaks ≥ 50, grouped by what the pipeline saw in the segment.

How sure is the corridor?

Segments with an estimated ego corridor (enough tracked motion) versus an approximate one.

Demo Theater

Sit back. GHOST presents itself.

A narrated, cinematic walkthrough of every feature on real footage, driven live inside the app. Press play, hit record.

Space pause · → next chapter · ← previous · H hide controls · Esc exit

Clean recording mode hides the controls while idle and enters fullscreen. Voices are your browser's built-in speech voices; the script below is ready for any external AI voice.

Chapters

Play from any chapter. Every chapter runs the real feature on real footage, nothing is pre-rendered.

Full narration script
← Back to Rides
Ride workspaceGHOST NYC
Loading ride
0.00 s
Peak Risk ScoreCandidate interactionObject presentPlayhead
← Back to Rides
COMPARE RIDES

Two independent clips. Sync aligns playback position only; it does not mean the clips happened at the same time.