gemma: pkg/imports/wx.go annotate

annotate pkg/imports/wx.go @ 2549:9bf6b767a56a

client: refactored and improved splitscreen for diagrams To make different diagrams possible, the splitscreen view needed to be decoupled from the cross profiles. Also the style has changed to make it more consistent with the rest of the app. The standard box header is now used and there are collapse and expand animations.

author	Markus Kottlaender <markus@intevation.de>
date	Fri, 08 Mar 2019 08:50:47 +0100
parents	7c83b5277c1c
children	02505fcff63c

rev	line source
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	1 // This is Free Software under GNU Affero General Public License v >= 3.0
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	2 // without warranty, see README.md and license for details.
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	3 //
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	4 // SPDX-License-Identifier: AGPL-3.0-or-later
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	5 // License-Filename: LICENSES/AGPL-3.0.txt
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	6 //
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	7 // Copyright (C) 2018 by via donau
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	8 // – Österreichische Wasserstraßen-Gesellschaft mbH
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	9 // Software engineering by Intevation GmbH
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	10 //
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	11 // Author(s):
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	12 // * Sascha L. Teichmann <sascha.teichmann@intevation.de>
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	13
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	14 package imports
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	15
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	16 import (
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	17 "context"
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	18 "database/sql"
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	19 "encoding/json"
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	20 "errors"
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	21 "fmt"
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	22 "io"
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	23 "time"
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	24
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	25 "gemma.intevation.de/gemma/pkg/wfs"
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	26 )
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	27
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	28 // WaterwayAxis is an import job to import
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	29 // the waterway axes in form of line string geometries
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	30 // and attribute data from a WFS service.
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	31 type WaterwayAxis struct {
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	32 // URL the GetCapabilities URL of the WFS service.
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	33 URL string `json:"url"`
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	34 // FeatureType selects the feature type of the WFS service.
1677 53304db85888 Waterway axis import: Added route for manual import. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1675 diff changeset	35 FeatureType string `json:"feature-type"`
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	36 // SortBy works around misconfigured services to
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	37 // establish a sort order to get the features.
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	38 SortBy string `json:"sort-by"`
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	39 }
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	40
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1683 diff changeset	41 // WXJobKind is the import queue type identifier.
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	42 const WXJobKind JobKind = "wx"
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	43
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	44 type wxJobCreator struct{}
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	45
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	46 func init() {
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	47 RegisterJobCreator(WXJobKind, wxJobCreator{})
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	48 }
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	49
1754 807569b08513 Import queue: Auto acceptance is now a property of the import kind itself and is not configurable any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1706 diff changeset	50 func (wxJobCreator) Description() string { return "waterway axis" }
807569b08513 Import queue: Auto acceptance is now a property of the import kind itself and is not configurable any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1706 diff changeset	51
807569b08513 Import queue: Auto acceptance is now a property of the import kind itself and is not configurable any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1706 diff changeset	52 func (wxJobCreator) AutoAccept() bool { return true }
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	53
2187 7c83b5277c1c Import queue: Removed boilerplate code to deserialize jobs from JSON by making it part of the import queue. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2168 diff changeset	54 func (wxJobCreator) Create() Job { return new(WaterwayAxis) }
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	55
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	56 func (wxJobCreator) Depends() []string {
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	57 return []string{
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	58 "waterway_axis",
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	59 }
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	60 }
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	61
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	62 // StageDone is a NOP for waterway axis imports.
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	63 func (wxJobCreator) StageDone(context.Context, *sql.Tx, int64) error {
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	64 return nil
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	65 }
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	66
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	67 // CleanUp for waterway axis imports is a NOP.
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	68 func (*WaterwayAxis) CleanUp() error { return nil }
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	69
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	70 type waterwayAxisProperties struct {
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	71 ObjNam string `json:"hydro_objnam"`
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	72 NObjNnm *string `json:"hydro_nobjnm"`
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	73 }
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	74
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	75 const (
1795 1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	76 deleteWaterwayAxisSQL = `
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	77 WITH resp AS (
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	78 SELECT best_utm(area::geometry) AS t,
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	79 ST_Transform(area::geometry, best_utm(area::geometry)) AS a
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	80 FROM users.responsibility_areas
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	81 WHERE country = users.current_user_country()
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	82 )
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	83 DELETE FROM waterway.waterway_axis
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	84 WHERE ST_Covers(
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	85 (SELECT a FROM resp),
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	86 ST_Transform(wtwaxs::geometry, (SELECT t FROM resp)))
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	87 `
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	88
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	89 insertWaterwayAxisSQL = `
1795 1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	90 WITH resp AS (
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	91 SELECT best_utm(area::geometry) AS t,
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	92 ST_Transform(area::geometry, best_utm(area::geometry)) AS a
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	93 FROM users.responsibility_areas
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	94 WHERE country = users.current_user_country()
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	95 )
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	96 INSERT INTO waterway.waterway_axis (wtwaxs, objnam, nobjnam)
1796 904c7e853adc Waterway area import: Clip features against responsibility area. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1795 diff changeset	97 SELECT ST_Transform(clipped.geom, 4326)::geography, $3, $4 FROM (
1795 1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	98 SELECT (ST_Dump(
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	99 ST_Intersection(
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	100 (SELECT a FROM resp),
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	101 ST_Transform(
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	102 ST_GeomFromWKB($1, $2::integer),
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	103 (SELECT t FROM resp)
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	104 )
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	105 )
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	106 )).geom AS geom
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	107 ) AS clipped
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	108 WHERE clipped.geom IS NOT NULL
1333f96f18d0 Waterway axis: Clip features against responsibility area of importing user. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1785 diff changeset	109 `
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	110 )
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	111
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	112 // Do executes the actual waterway axis import.
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	113 func (wx *WaterwayAxis) Do(
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	114 ctx context.Context,
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	115 importID int64,
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	116 conn *sql.Conn,
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	117 feedback Feedback,
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	118 ) (interface{}, error) {
8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	119
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	120 start := time.Now()
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	121
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	122 feedback.Info("Import waterway axis")
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	123
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	124 feedback.Info("Loading capabilities from %s", wx.URL)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	125 caps, err := wfs.GetCapabilities(wx.URL)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	126 if err != nil {
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	127 feedback.Error("Loading capabilities failed: %v", err)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	128 return nil, err
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	129 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	130
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	131 ft := caps.FindFeatureType(wx.FeatureType)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	132 if ft == nil {
1682 3c99d599503a Waterway axis import: small simplifications. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1681 diff changeset	133 return nil, fmt.Errorf("Unknown feature type '%s'", wx.FeatureType)
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	134 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	135
1706 fb05027d93b6 Waterway axis: Be more verbose during import about feature type and sorting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	136 feedback.Info("Found feature type '%s", wx.FeatureType)
fb05027d93b6 Waterway axis: Be more verbose during import about feature type and sorting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	137
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	138 epsg, err := wfs.CRSToEPSG(ft.DefaultCRS)
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	139 if err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	140 feedback.Error("Unsupported CRS name '%s'", ft.DefaultCRS)
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	141 return nil, err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	142 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	143
1706 fb05027d93b6 Waterway axis: Be more verbose during import about feature type and sorting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	144 if wx.SortBy != "" {
fb05027d93b6 Waterway axis: Be more verbose during import about feature type and sorting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	145 feedback.Info("Features will be sorted by '%s'", wx.SortBy)
fb05027d93b6 Waterway axis: Be more verbose during import about feature type and sorting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	146 }
fb05027d93b6 Waterway axis: Be more verbose during import about feature type and sorting. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	147
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	148 urls, err := wfs.GetFeaturesGET(
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	149 caps, wx.FeatureType, "application/json", wx.SortBy)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	150 if err != nil {
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	151 feedback.Error("Cannot create GetFeature URLs. %v", err)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	152 return nil, err
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	153 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	154
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	155 tx, err := conn.BeginTx(ctx, nil)
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	156 if err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	157 return nil, err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	158 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	159 defer tx.Rollback()
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	160
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	161 insertStmt, err := tx.PrepareContext(ctx, insertWaterwayAxisSQL)
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	162 if err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	163 return nil, err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	164 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	165 defer insertStmt.Close()
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	166
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	167 // Delete the old features.
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	168 if _, err := tx.ExecContext(ctx, deleteWaterwayAxisSQL); err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	169 return nil, err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	170 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	171
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	172 var (
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	173 unsupported = stringCounter{}
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	174 missingProperties int
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	175 badProperties int
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	176 features int
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	177 )
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	178
2106 2b72f5e005aa WFS imports: Write get GetFeature URLs into import log. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1828 diff changeset	179 if err := wfs.DownloadURLs(urls, func(url string, r io.Reader) error {
2b72f5e005aa WFS imports: Write get GetFeature URLs into import log. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1828 diff changeset	180 feedback.Info("Get features from: '%s'", url)
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	181 rfc, err := wfs.ParseRawFeatureCollection(r)
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	182 if err != nil {
1764 bb4348ac52ab Waterway axis import: Be more verbose when parsing the GetFeature document fails. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1754 diff changeset	183 return fmt.Errorf("parsing GetFeature document failed: %v", err)
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	184 }
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	185 if rfc.CRS != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	186 crsName := rfc.CRS.Properties.Name
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	187 if epsg, err = wfs.CRSToEPSG(crsName); err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	188 feedback.Error("Unsupported CRS: %d", crsName)
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	189 return err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	190 }
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	191 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	192
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	193 // No features -> ignore.
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	194 if rfc.Features == nil {
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	195 return nil
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	196 }
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	197
1683 509e8728e846 Fixed pre-calculated size of 2D WKB line strings. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1682 diff changeset	198 feedback.Info("Using EPSG: %d", epsg)
509e8728e846 Fixed pre-calculated size of 2D WKB line strings. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1682 diff changeset	199
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	200 for _, feature := range rfc.Features {
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	201 if feature.Properties == nil \|\| feature.Geometry.Coordinates == nil {
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	202 missingProperties++
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	203 continue
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	204 }
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	205
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	206 var props waterwayAxisProperties
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	207
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	208 if err := json.Unmarshal(*feature.Properties, &props); err != nil {
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	209 badProperties++
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	210 continue
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	211 }
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	212
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	213 var nobjnam sql.NullString
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	214 if props.NObjNnm != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	215 nobjnam = sql.NullString{String: *props.NObjNnm, Valid: true}
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	216 }
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	217
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	218 switch feature.Geometry.Type {
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	219 case "LineString":
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	220 var l lineSlice
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	221 if err := json.Unmarshal(*feature.Geometry.Coordinates, &l); err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	222 return err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	223 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	224 if _, err := insertStmt.ExecContext(
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	225 ctx,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	226 l.asWKB(),
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	227 epsg,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	228 props.ObjNam,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	229 nobjnam,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	230 ); err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	231 return err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	232 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	233 features++
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	234 case "MultiLineString":
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	235 var ls []lineSlice
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	236 if err := json.Unmarshal(*feature.Geometry.Coordinates, &ls); err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	237 return err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	238 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	239 for _, l := range ls {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	240 if _, err := insertStmt.ExecContext(
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	241 ctx,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	242 l.asWKB(),
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	243 epsg,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	244 props.ObjNam,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	245 nobjnam,
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	246 ); err != nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	247 return err
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	248 }
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	249 features++
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	250 }
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	251 default:
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	252 unsupported[feature.Geometry.Type]++
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	253 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	254 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	255 return nil
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	256 }); err != nil {
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	257 return nil, err
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	258 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	259
1680 de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	260 if badProperties > 0 {
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	261 feedback.Warn("Bad properties: %d", badProperties)
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	262 }
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	263
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	264 if missingProperties > 0 {
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	265 feedback.Warn("Missing properties: %d", missingProperties)
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	266 }
de8089944b19 Waterway axis import: Started extracting properties from the features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1679 diff changeset	267
1785 614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	268 if len(unsupported) != 0 {
614c6c766691 Waterway area import: Implemented. Sascha L. Teichmann <teichmann@intevation.de> parents: 1764 diff changeset	269 feedback.Warn("Unsupported types found: %s", unsupported)
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	270 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	271
1828 1ecfcf46e4da Waterway area/axis: Be more informative if features are bad. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1796 diff changeset	272 if features == 0 {
1ecfcf46e4da Waterway area/axis: Be more informative if features are bad. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1796 diff changeset	273 err := errors.New("No features found")
1ecfcf46e4da Waterway area/axis: Be more informative if features are bad. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1796 diff changeset	274 feedback.Error("%v", err)
1ecfcf46e4da Waterway area/axis: Be more informative if features are bad. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1796 diff changeset	275 return nil, err
1ecfcf46e4da Waterway area/axis: Be more informative if features are bad. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1796 diff changeset	276 }
1ecfcf46e4da Waterway area/axis: Be more informative if features are bad. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1796 diff changeset	277
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	278 if err = tx.Commit(); err == nil {
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	279 feedback.Info("Storing %d features took %s",
4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	280 features, time.Since(start))
1679 2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	281 }
2dc7768be0e4 Waterway axis import: More on reading data from WFS. TODO: Parse to concrete features. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1677 diff changeset	282
1681 4d6ce621379e Waterway axis import: Completed, but the final commit unexpectedly resulted in rollback. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1680 diff changeset	283 return nil, err
1675 8fec3887c7e5 Waterway axis import: Added stub. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: diff changeset	284 }

Mercurial > gemma

annotate pkg/imports/wx.go @ 2549:9bf6b767a56a