boston-lot: metadata review loop - #227
Conversation
|
boston-lot
|
📋 Metadata inventory —
|
boston-lot-2021-09-01-CRREL-RSGIS.copc.laz |
|
|---|---|
| Points | 1,746,342,476 |
| File size | 18.5 GiB |
| Format | LAS 1.4, point format 6, COPC |
| CRS | NAD83 / UTM zone 18N |
| Linear units | metre |
| XY extent | 5633 × 6273 |
| Z range | -2159.6 – 742.7 |
| Acquiring system | empty |
| Generating software | empty |
| File creation date | unset |
| GPS time range | none (0–0) |
| Extra dimensions | 5 |
| VLRs | 4 |
Dimensions and VLRs — boston-lot-2021-09-01-CRREL-RSGIS.copc.laz
Extra dimensions (beyond the standard LAS point format)
| Name | Type | Description |
|---|---|---|
HeightAboveGround |
double | — |
Synthetic |
uint8 | — |
Overlap |
uint8 | — |
Withheld |
uint8 | — |
KeyPoint |
uint8 | — |
Variable Length Records
| # | user_id | record_id | Bytes | What it is |
|---|---|---|---|---|
| 0 | copc |
1 | 160 | COPC info |
| 1 | laszip encoded |
22204 | 46 | LASzip compression |
| 2 | LASF_Projection |
2112 | 615 | OGC WKT projection |
| 3 | LASF_Spec |
4 | 960 | Extra Bytes (extra dimensions) — HeightAboveGround (double), Synthetic (uint8), Overlap (uint8), Withheld (uint8), KeyPoint (uint8) |
What the file does not tell us
These are the metadata a reviewer would otherwise assume came from the data. They did not — so if the manifest states them, they came from somewhere else.
- LAS
system_idis empty — the file names no acquiring system - LAS
generating_softwareis empty — the file names no creating application - no file creation date (
creation_yearis unset, which PDAL reports as1) — any acquisition date in the manifest comes from a filename or a human, not from the data - GPS time range is 0–0 — the points carry no usable timestamps, so the data cannot date itself
- no
pdal_metadataVLR — the file carries no record of the pipeline that produced it (PDAL only writes this when asked withpdal_metadata=true) - declared Z range spans 2902 m (-2159.6 to 742.7) — larger than almost any real survey, so the header bounds are probably set by outlier points rather than terrain; anything derived from them (elevation ranges, hero-image colour ramps) will be skewed until they are filtered
Manifest fields still needing an answer
licenseisUNKNOWN— a real SPDX identifier orproprietaryis needed before publication. The model may quote what a source says about licensing, but a human decides it.descriptionis still a placeholder (TODO: write a one-line summary for Boston Lot)- no
pointcloud_org.acknowledgement - no
sci:citationorsci:doi— nothing for a user to cite
Reply with @pointcloud-org, please explain … to ask about any of this, or point the bot at an external metadata document and it will read it as part of answering.
|
@pointcloud-org, please explain what we actually know about this dataset's provenance, and whether the 2021-09-01 date is supported by anything |
|
🤖 Request received from @hobu (
Working on it… |
|
I couldn't tell which command you meant. Supported commands:
Dataset ids are directory names under |
|
🤖 explain — asked by @hobu What the file actually establishesEverything below is from the LAS header/VLRs, which are ground truth:
What the file does not establish — which is nearly all the provenance
So there is no in-file evidence of who flew it, with what, when, for whom, or under what license. The 2021-09-01 dateNot supported by anything you have given me. Its only appearance is inside the filename The I also cannot compare any of this against the manifest — One substantive data concern, independent of provenanceDeclared Z spans -2159.6 to 742.7 m, a 2902 m range. For a ~5.6 × 6.3 km footprint that is not terrain; the header bounds are almost certainly set by a handful of outlier points. Anything a user or the site derives from those bounds — elevation range in the collection extent, hero-image colour ramp — will be wrong until the outliers are filtered. To close this out you would need
claude-opus-5 · 2205 in / 1323 out tokens |
Exercising the new metadata inventory +
explainverb against Boston Lot.The manifest still has
license: UNKNOWNand aTODOdescription on purpose — that is what we are trying to resolve with LLM-assisted enrichment.