gemma: cmd/octreediff/main.go annotate

annotate cmd/octreediff/main.go @ 2572:7686c7c23506

Morphological differences: Moved some code into octree package.

author	Sascha L. Teichmann <sascha.teichmann@intevation.de>
date	Mon, 11 Mar 2019 14:00:49 +0100
parents	1ec4c5633eb6
children	2833ff156cb2

rev	line source
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1 // This is Free Software under GNU Affero General Public License v >= 3.0
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	2 // without warranty, see README.md and license for details.
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	3 //
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	4 // SPDX-License-Identifier: AGPL-3.0-or-later
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	5 // License-Filename: LICENSES/AGPL-3.0.txt
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	6 //
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	7 // Copyright (C) 2018 by via donau
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	8 // – Österreichische Wasserstraßen-Gesellschaft mbH
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	9 // Software engineering by Intevation GmbH
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10 //
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	11 // Author(s):
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	12 // * Sascha L. Teichmann <sascha.teichmann@intevation.de>
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	13
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14 package main
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16 import (
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 "context"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18 "database/sql"
2468 27cc04bbda46 Bail out if the EPSG codes of the datasets don't match. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2467 diff changeset	19 "errors"
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	20 "flag"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	21 "fmt"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	22 "log"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	23 "runtime"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	24 "sync"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	25 "time"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	26
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	27 "gemma.intevation.de/gemma/pkg/common"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	28 "gemma.intevation.de/gemma/pkg/octree"
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	29 )
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	30
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	31 var (
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	32 bottleneck = flag.String("bottleneck", "", "name of the bottleneck")
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	33 first = flag.String("first", "", "date of the first sounding result")
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	34 second = flag.String("second", "", "date of the second sounding result")
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	35 )
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	36
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	37 const contourTolerance = 0.1
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	38
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	39 const (
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	40 loadOctreeSQL = `
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	41 SELECT sr.octree_index
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 FROM waterway.sounding_results sr JOIN waterway.bottlenecks bn
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43 ON sr.bottleneck_id = bn.id
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44 WHERE bn.bottleneck_id = $1 AND sr.date_info = $2::date
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45 AND sr.octree_index IS NOT NULL`
2473 19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	46
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	47 insertContourSQL = `
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	48 INSERT INTO diff_contour_lines (
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	49 height,
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	50 lines
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	51 )
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	52 SELECT
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	53 $4,
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	54 ST_Transform(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	55 ST_Multi(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	56 ST_CollectionExtract(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	57 ST_SimplifyPreserveTopology(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	58 ST_Multi(ST_Collectionextract(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	59 ST_MakeValid(ST_GeomFromWKB($1, $2::integer)), 2)),
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	60 $3
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	61 ),
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	62 2
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	63 )
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	64 ),
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	65 4326
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	66 )
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	67 `
2488 cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	68 clippingPolygonSQL = `
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	69 WITH joined AS (
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	70 SELECT
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	71 sr.area AS area,
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	72 sr.date_info AS date_info
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	73 FROM waterway.sounding_results sr JOIN
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	74 waterway.bottlenecks bn ON sr.bottleneck_id = bn.id
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	75 WHERE bn.bottleneck_id = $1
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	76 )
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	77 SELECT ST_AsBinary(
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	78 ST_intersection(
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	79 (SELECT ST_Transform(area::geometry, $2::int) FROM joined WHERE date_info = $3::date),
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	80 (SELECT ST_Transform(area::geometry, $2::int) FROM joined WHERE date_info = $4::date)
2504 e0a7571ac13a Eliminate bad triangles. Not really the right solution. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2496 diff changeset	81 )
e0a7571ac13a Eliminate bad triangles. Not really the right solution. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2496 diff changeset	82 ) AS area
2488 cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	83 `
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	84 insertContourSQLClipped = `
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	85 WITH joined AS (
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	86 SELECT
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	87 sr.area AS area,
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	88 sr.date_info AS date_info
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	89 FROM waterway.sounding_results sr JOIN
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	90 waterway.bottlenecks bn ON sr.bottleneck_id = bn.id
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	91 WHERE bn.bottleneck_id = $1
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	92 ),
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	93 inter AS (
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	94 SELECT
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	95 ST_Buffer(
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	96 ST_intersection(
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	97 (SELECT ST_Transform(area::geometry, $2::int) FROM joined WHERE date_info = $3::date),
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	98 (SELECT ST_Transform(area::geometry, $2::int) FROM joined WHERE date_info = $4::date)
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	99 ),
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	100 0.001) AS area
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	101 )
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	102 INSERT INTO diff_contour_lines (
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	103 height,
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	104 lines
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	105 )
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	106 SELECT
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	107 $5,
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	108 ST_Transform(
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	109 ST_Multi(
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	110 ST_intersection(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	111 ST_CollectionExtract(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	112 ST_SimplifyPreserveTopology(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	113 ST_Multi(ST_Collectionextract(
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	114 ST_MakeValid(ST_GeomFromWKB($6, $2::integer)), 2)),
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	115 $7
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	116 ),
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	117 2
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	118 ),
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	119 area
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	120 )
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	121 ),
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	122 4326
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	123 )
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	124 FROM inter`
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	125 )
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	126
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	127 func check(err error) {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	128 if err != nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	129 log.Fatalf("error: %v\n", err)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	130 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	131 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	132
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	133 func process(bottleneck string, firstDate, secondDate time.Time) error {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	134 start := time.Now()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	135 defer func() { log.Printf("processing took %v\n", time.Since(start)) }()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	136
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	137 ctx := context.Background()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	138
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	139 return run(func(db *sql.DB) error {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	140
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	141 conn, err := db.Conn(ctx)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	142 if err != nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	143 return err
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	144 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	145 defer conn.Close()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	146
2480 242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	147 tx, err := conn.BeginTx(ctx, nil)
242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	148 if err != nil {
242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	149 return err
242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	150 }
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	151 defer tx.Rollback()
2480 242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	152
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	153 type load struct {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	154 date time.Time
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	155 data []byte
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	156 err *error
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	157 dst **octree.Tree
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	158 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	159
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	160 out := make(chan *load)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	161 wg := new(sync.WaitGroup)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	162
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	163 n := runtime.NumCPU()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	164 if n > 2 {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	165 n = 2
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	166 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	167
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	168 for i := 0; i < n; i++ {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	169 wg.Add(1)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	170 go func() {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	171 defer wg.Done()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	172 for l := range out {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	173 if *l.err == nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	174 l.dst, l.err = octree.Deserialize(l.data)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	175 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	176 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	177 }()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	178 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	179
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	180 var firstErr, secondErr error
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	181 var first, second *octree.Tree
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	182
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	183 for _, l := range []*load{
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	184 {date: firstDate, dst: &first, err: &firstErr},
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	185 {date: secondDate, dst: &second, err: &secondErr},
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	186 } {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	187 var data []byte
2480 242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	188 if err := tx.QueryRowContext(
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	189 ctx,
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	190 loadOctreeSQL,
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	191 bottleneck,
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	192 l.date,
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	193 ).Scan(&data); err != nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	194 *l.err = err
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	195 } else {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	196 l.data = data
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	197 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	198 out <- l
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	199 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	200 close(out)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	201
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	202 wg.Wait()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	203
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	204 if firstErr != nil \|\| secondErr != nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	205 if firstErr != nil && secondErr != nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	206 return fmt.Errorf("%v, %v", firstErr, secondErr)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	207 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	208 if firstErr != nil {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	209 return firstErr
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	210 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	211 return secondErr
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	212 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	213
2468 27cc04bbda46 Bail out if the EPSG codes of the datasets don't match. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2467 diff changeset	214 if first.EPSG != second.EPSG {
27cc04bbda46 Bail out if the EPSG codes of the datasets don't match. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2467 diff changeset	215 return errors.New("EPSG codes mismatch. Needs transformation slow pass.")
27cc04bbda46 Bail out if the EPSG codes of the datasets don't match. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2467 diff changeset	216 }
27cc04bbda46 Bail out if the EPSG codes of the datasets don't match. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2467 diff changeset	217
2470 5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	218 now := time.Now()
5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	219 log.Printf("loading took %v\n", now.Sub(start))
5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	220 last := now
5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	221
2572 7686c7c23506 Morphological differences: Moved some code into octree package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2516 diff changeset	222 result := first.Diff(second)
2469 1312953defab Do difference calculation multi-core. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2468 diff changeset	223
2470 5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	224 now = time.Now()
5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	225 log.Printf("setting in took %v\n", now.Sub(last))
5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	226 last = now
5bd3236f2b1f Integrate deduplication with setting in. Even if there is more contention in total it seems to be cheaper. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2469 diff changeset	227 log.Printf("num points: %d\n", len(result))
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	228
2488 cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	229 var clip []byte
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	230
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	231 if err := tx.QueryRowContext(
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	232 ctx, clippingPolygonSQL,
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	233 bottleneck,
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	234 first.EPSG,
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	235 firstDate, secondDate,
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	236 ).Scan(&clip); err != nil {
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	237 return err
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	238 }
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	239
2496 12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	240 var clippingPolygon octree.Polygon
12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	241 if err := clippingPolygon.FromWKB(clip); err != nil {
12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	242 return err
12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	243 }
12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	244 clippingPolygon.Indexify()
12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	245
2488 cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	246 now = time.Now()
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	247 log.Printf("loading clipping polygon took %v\n", now.Sub(last))
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	248 last = now
cb55d7eaaa36 Started with the idea to clip an octree by an bounding polygon. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2484 diff changeset	249
2572 7686c7c23506 Morphological differences: Moved some code into octree package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2516 diff changeset	250 tri, err := result.Triangulate()
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	251 if err != nil {
2473 19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	252 return err
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	253 }
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	254
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	255 now = time.Now()
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	256 log.Printf("triangulation took %v\n", now.Sub(last))
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	257 last = now
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	258
2513 1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	259 var str octree.STRTree
1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	260
2516 1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	261 tin := tri.Tin()
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	262
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	263 str.Build(tin)
2513 1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	264
1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	265 now = time.Now()
1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	266 log.Printf("building STR tree took %v\n", now.Sub(last))
1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	267 last = now
1534df518201 Called STT tree building. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2504 diff changeset	268
2516 1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	269 removed := str.Clip(&clippingPolygon)
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	270 now = time.Now()
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	271 log.Printf("clipping STR tree took %v\n", now.Sub(last))
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	272 last = now
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	273
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	274 log.Printf("Number of triangles to clip: %d\n", len(removed))
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	275
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	276 builder := octree.NewBuilder(tin)
1ec4c5633eb6 Clip STR tree and not Octree. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2513 diff changeset	277 builder.Build(removed)
2473 19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	278
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	279 now = time.Now()
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	280 log.Printf("building octree took %v\n", now.Sub(last))
19beb7d17337 Triangulate and build octree index. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2472 diff changeset	281 last = now
2476 efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	282
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	283 tree := builder.Tree()
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	284
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	285 log.Printf("min/max: %f %f\n", tree.Min.Z, tree.Max.Z)
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	286
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	287 var heights []float64
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	288
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	289 switch {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	290 case tree.Min.Z >= 0: // All values positive.
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	291 for v := 0.0; v <= tree.Max.Z; v += 0.1 {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	292 if v >= tree.Min.Z {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	293 heights = append(heights, v)
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	294 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	295 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	296 case tree.Max.Z <= 0: // All values negative.
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	297 for v := 0.0; v >= tree.Min.Z; v -= 0.1 {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	298 if v <= tree.Max.Z {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	299 heights = append(heights, v)
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	300 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	301 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	302 default: // Positive and negative.
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	303 for v := 0.1; v <= tree.Max.Z; v += 0.1 {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	304 heights = append(heights, v)
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	305 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	306 for i, j := 0, len(heights)-1; i < j; i, j = i+1, j-1 {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	307 heights[i], heights[j] = heights[j], heights[i]
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	308 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	309 for v := 0.0; v >= tree.Min.Z; v -= 0.1 {
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	310 heights = append(heights, v)
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	311 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	312 }
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	313
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	314 log.Printf("num heights: %d\n", len(heights))
4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	315
2476 efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	316 var dataSize int
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	317
2496 12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	318 stmt, err := tx.PrepareContext(ctx, insertContourSQL)
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	319 if err != nil {
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	320 return err
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	321 }
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	322 defer stmt.Close()
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	323
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	324 log.Println("do contours")
2476 efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	325 octree.DoContours(tree, heights, func(res *octree.ContourResult) {
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	326 if err == nil && len(res.Lines) > 0 {
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	327 log.Printf("%.2f: lines: %d\n", res.Height, len(res.Lines))
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	328 wkb := res.Lines.AsWKB2D()
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	329 dataSize += len(wkb)
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	330 _, err = stmt.ExecContext(
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	331 ctx,
2496 12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	332 wkb,
2484 4fa92d468164 Use fogleman's triangulation. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2483 diff changeset	333 first.EPSG,
2496 12ed6feefea5 Use octree clipping. Not working, yet! Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2488 diff changeset	334 contourTolerance,
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	335 res.Height,
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	336 )
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	337 }
2476 efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	338 })
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	339
2479 c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	340 if err != nil {
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	341 return err
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	342 }
c85b16db8a02 Calculate better triangulation and store it into database. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2476 diff changeset	343
2476 efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	344 now = time.Now()
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	345 log.Printf("Number of iso lines: %d\n", len(heights))
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	346 log.Printf("Total WKB size: %.2fMB\n", float64(dataSize)/(1024*1024))
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	347 log.Printf("generating iso lines took %v\n", now.Sub(last))
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	348 last = now
efe332e985b9 Calculate the iso lines of the difference. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2473 diff changeset	349
2480 242104c338ff Wrap writing of iso-lines of differences into a transaction. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2479 diff changeset	350 return tx.Commit()
2465 86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	351 })
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	352 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	353
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	354 func main() {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	355
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	356 flag.Parse()
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	357
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	358 firstDate, err := time.Parse(common.DateFormat, *first)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	359 check(err)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	360 secondDate, err := time.Parse(common.DateFormat, *second)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	361 check(err)
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	362
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	363 if *bottleneck == "" {
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	364 log.Fatalln("Missing bottleneck name")
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	365 }
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	366
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	367 check(process(*bottleneck, firstDate, secondDate))
86c7a023400e Started experimental octree diff branch. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	368 }

Mercurial > gemma

annotate cmd/octreediff/main.go @ 2572:7686c7c23506