gemma: pkg/imports/fa.go annotate

annotate pkg/imports/fa.go @ 2091:3f32b18bbd4c

Waterway profile import: Store temp geoms in WGS84, do buffering with four decimal places and fetch the lines closest to the dmv points.

author	Sascha L. Teichmann <sascha.teichmann@intevation.de>
date	Fri, 01 Feb 2019 16:32:52 +0100
parents	aeff01c6edec
children	b868cb653c4d

rev	line source
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	1 // This is Free Software under GNU Affero General Public License v >= 3.0
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	2 // without warranty, see README.md and license for details.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	3 //
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	4 // SPDX-License-Identifier: AGPL-3.0-or-later
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	5 // License-Filename: LICENSES/AGPL-3.0.txt
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	6 //
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	7 // Copyright (C) 2018 by via donau
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	8 // – Österreichische Wasserstraßen-Gesellschaft mbH
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	9 // Software engineering by Intevation GmbH
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	10 //
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	11 // Author(s):
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	12 // * Raimund Renkert <raimund.renkert@intevation.de>
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	13
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	14 package imports
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	15
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	16 import (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	17 "context"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	18 "database/sql"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	19 "errors"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	20 "time"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	21
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	22 "github.com/jackc/pgx/pgtype"
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	23
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	24 "gemma.intevation.de/gemma/pkg/common"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	25 "gemma.intevation.de/gemma/pkg/soap/ifaf"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	26 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	27
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	28 // FairwayAvailability imports fairway availability data
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	29 // from an IFAF SOAP service.
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	30 type FairwayAvailability struct {
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	31 // URL is the URL of the SOAP service.
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	32 URL string `json:"url"`
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	33 // Insecure indicates if HTTPS traffic
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	34 // should validate certificates or not.
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	35 Insecure bool `json:"insecure"`
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	36 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	37
2019 aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	38 type uniqueFairwayAvailability struct {
aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	39 BottleneckId string
aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	40 Surdat time.Time
aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	41 }
aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	42
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	43 // FAJobKind is import queue type identifier.
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	44 const FAJobKind JobKind = "fa"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	45
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	46 const (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	47 listBottlenecksSQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	48 SELECT
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	49 bottleneck_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	50 responsible_country
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	51 FROM waterway.bottlenecks
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	52 WHERE responsible_country = users.current_user_country()
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	53 AND staging_done = true
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	54 `
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	55 latestMeasureDateSQL = `
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	56 SELECT
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	57 measure_date
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	58 FROM waterway.effective_fairway_availability
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	59 ORDER BY measure_date DESC LIMIT 1
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	60 `
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	61 listFairwayAvailabilitySQL = `
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	62 SELECT
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	63 fa.id,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	64 bn.bottleneck_id,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	65 fa.surdat
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	66 FROM waterway.fairway_availability fa
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	67 JOIN waterway.bottlenecks bn ON bn.id = fa.bottleneck_id
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	68 `
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	69 insertFASQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	70 INSERT INTO waterway.fairway_availability (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	71 position_code,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	72 bottleneck_id,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	73 surdat,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	74 critical,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	75 date_info,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	76 source_organization
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	77 ) VALUES (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	78 $1,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	79 (SELECT id FROM waterway.bottlenecks WHERE bottleneck_id = $2),
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	80 $3,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	81 $4,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	82 $5,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	83 $6
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	84 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	85 RETURNING id`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	86
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	87 insertBnPdfsSQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	88 INSERT INTO waterway.bottleneck_pdfs (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	89 fairway_availability_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	90 profile_pdf_filename,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	91 profile_pdf_url,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	92 pdf_generation_date,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	93 source_organization
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	94 ) VALUES (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	95 $1,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	96 $2,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	97 $3,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	98 $4,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	99 $5
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	100 ) ON CONFLICT ON CONSTRAINT bottleneck_pdfs_pkey DO NOTHING`
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	101 insertEFASQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	102 INSERT INTO waterway.effective_fairway_availability (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	103 fairway_availability_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	104 measure_date,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	105 level_of_service,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	106 available_depth_value,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	107 available_width_value,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	108 water_level_value,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	109 measure_type,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	110 source_organization,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	111 forecast_generation_time,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	112 value_lifetime
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	113 ) VALUES (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	114 $1,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	115 $2,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	116 (SELECT
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	117 level_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	118 FROM levels_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	119 WHERE name = $3),
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	120 $4,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	121 $5,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	122 $6,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	123 $7,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	124 $8,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	125 $9,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	126 $10
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	127 ) ON CONFLICT ON CONSTRAINT effective_fairway_availability_pkey DO NOTHING`
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	128 insertFAVSQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	129 INSERT INTO waterway.fa_reference_values (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	130 fairway_availability_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	131 level_of_service,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	132 fairway_depth,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	133 fairway_width,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	134 fairway_radius,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	135 shallowest_spot
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	136 ) VALUES (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	137 $1,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	138 (SELECT
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	139 level_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	140 FROM levels_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	141 WHERE name = $2),
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	142 $3,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	143 $4,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	144 $5,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	145 ST_MakePoint($6, $7)::geography
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	146 )ON CONFLICT ON CONSTRAINT fa_reference_values_pkey DO NOTHING`
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	147 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	148
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	149 type faJobCreator struct{}
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	150
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	151 func init() {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	152 RegisterJobCreator(FAJobKind, faJobCreator{})
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	153 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	154
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	155 func (faJobCreator) Description() string {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	156 return "fairway availability"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	157 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	158
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	159 func (faJobCreator) Create(_ JobKind, data string) (Job, error) {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	160 fa := new(FairwayAvailability)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	161 if err := common.FromJSONString(data, fa); err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	162 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	163 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	164 return fa, nil
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	165 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	166
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	167 func (faJobCreator) Depends() []string {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	168 return []string{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	169 "bottlenecks",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	170 "fairway_availability",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	171 "bottleneck_pdfs",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	172 "effective_fairway_availability",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	173 "fa_reference_values",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	174 "levels_of_service",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	175 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	176 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	177
1754 807569b08513 Import queue: Auto acceptance is now a property of the import kind itself and is not configurable any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	178 func (faJobCreator) AutoAccept() bool { return true }
807569b08513 Import queue: Auto acceptance is now a property of the import kind itself and is not configurable any more. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1696 diff changeset	179
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	180 // StageDone moves the imported fairway availablities out of the staging area.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	181 // Currently doing nothing.
1676 4407ecaa2192 Imports: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1663 diff changeset	182 func (faJobCreator) StageDone(context.Context, *sql.Tx, int64) error {
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	183 return nil
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	184 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	185
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	186 // CleanUp of a fairway availablities import is a NOP.
1676 4407ecaa2192 Imports: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1663 diff changeset	187 func (*FairwayAvailability) CleanUp() error { return nil }
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	188
2016 25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	189 type bottleneckCountry struct {
25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	190 ID string
25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	191 ResponsibleCountry string
25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	192 }
25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	193
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	194 // Do executes the actual fairway availability import.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	195 func (fa *FairwayAvailability) Do(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	196 ctx context.Context,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	197 importID int64,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	198 conn *sql.Conn,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	199 feedback Feedback,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	200 ) (interface{}, error) {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	201
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	202 // Get available bottlenecks from database for use as filter in SOAP request
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	203 var rows *sql.Rows
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	204
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	205 rows, err := conn.QueryContext(ctx, listBottlenecksSQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	206 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	207 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	208 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	209 defer rows.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	210
2016 25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	211 bottlenecks := []bottleneckCountry{}
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	212
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	213 for rows.Next() {
2016 25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	214 var bn bottleneckCountry
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	215 if err = rows.Scan(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	216 &bn.ID,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	217 &bn.ResponsibleCountry,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	218 ); err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	219 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	220 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	221 bottlenecks = append(bottlenecks, bn)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	222 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	223 if err = rows.Err(); err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	224 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	225 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	226
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	227 var faRows *sql.Rows
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	228 faRows, err = conn.QueryContext(ctx, listFairwayAvailabilitySQL)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	229 if err != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	230 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	231 }
2019 aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	232 fairwayAvailabilities := map[uniqueFairwayAvailability]int64{}
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	233 for faRows.Next() {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	234 var id int64
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	235 var bnId string
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	236 var sd time.Time
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	237 if err = faRows.Scan(
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	238 &id,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	239 &bnId,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	240 &sd,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	241 ); err != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	242 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	243 }
2019 aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	244 key := uniqueFairwayAvailability{
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	245 BottleneckId: bnId,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	246 Surdat: sd,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	247 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	248 fairwayAvailabilities[key] = id
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	249 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	250 if err = faRows.Err(); err != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	251 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	252 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	253
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	254 var latestDate pgtype.Timestamp
1756 295c82c5bc3e Fairway availability import: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1755 diff changeset	255 err = conn.QueryRowContext(ctx, latestMeasureDateSQL).Scan(&latestDate)
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	256 switch {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	257 case err == sql.ErrNoRows:
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	258 latestDate = pgtype.Timestamp{
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	259 // Fill Database with data of the last 5 days. Change this to a more useful value.
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	260 Time: time.Now().AddDate(0, 0, -5),
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	261 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	262 case err != nil:
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	263 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	264 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	265
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	266 faids, err := fa.doForFAs(ctx, bottlenecks, fairwayAvailabilities, latestDate, conn, feedback)
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	267 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	268 feedback.Error("Error processing data: %s", err)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	269 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	270 if len(faids) == 0 {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	271 feedback.Info("No new fairway availablity data found")
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	272 return nil, nil
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	273 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	274 feedback.Info("Processed %d fairway availabilities", len(faids))
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	275 // TODO: needs to be filled more useful.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	276 summary := struct {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	277 FairwayAvailabilities []string `json:"fairwayAvailabilities"`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	278 }{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	279 FairwayAvailabilities: faids,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	280 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	281 return &summary, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	282 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	283
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	284 func (fa *FairwayAvailability) doForFAs(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	285 ctx context.Context,
2016 25967829cf00 Started to simplify the import models. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1756 diff changeset	286 bottlenecks []bottleneckCountry,
2019 aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	287 fairwayAvailabilities map[uniqueFairwayAvailability]int64,
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	288 latestDate pgtype.Timestamp,
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	289 conn *sql.Conn,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	290 feedback Feedback,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	291 ) ([]string, error) {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	292 start := time.Now()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	293
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	294 client := ifaf.NewFairwayAvailabilityService(fa.URL, fa.Insecure, nil)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	295
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	296 var bnIds []string
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	297 for _, bn := range bottlenecks {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	298 bnIds = append(bnIds, bn.ID)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	299 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	300 var period ifaf.RequestedPeriod
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	301 period.Date_start = latestDate.Time
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	302 period.Date_end = time.Now()
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	303
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	304 ids := ifaf.ArrayOfString{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	305 String: bnIds,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	306 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	307
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	308 req := &ifaf.Get_bottleneck_fa{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	309 Bottleneck_id: &ids,
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	310 Period: &period,
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	311 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	312 resp, err := client.Get_bottleneck_fa(req)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	313 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	314 feedback.Error("%v", err)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	315 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	316 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	317
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	318 if resp.Get_bottleneck_faResult == nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	319 err := errors.New("no fairway availabilities found")
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	320 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	321 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	322
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	323 result := resp.Get_bottleneck_faResult
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	324
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	325 tx, err := conn.BeginTx(ctx, nil)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	326 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	327 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	328 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	329 defer tx.Rollback()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	330
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	331 insertFAStmt, err := tx.PrepareContext(ctx, insertFASQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	332 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	333 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	334 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	335 defer insertFAStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	336 insertBnPdfsStmt, err := tx.PrepareContext(ctx, insertBnPdfsSQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	337 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	338 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	339 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	340 defer insertBnPdfsStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	341 insertEFAStmt, err := tx.PrepareContext(ctx, insertEFASQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	342 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	343 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	344 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	345 defer insertEFAStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	346 insertFAVStmt, err := tx.PrepareContext(ctx, insertFAVSQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	347 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	348 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	349 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	350 defer insertFAVStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	351
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	352 var faIDs []string
4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	353 var faID int64
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	354 feedback.Info("Found %d fairway availabilities", len(result.FairwayAvailability))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	355 for _, faRes := range result.FairwayAvailability {
2019 aeff01c6edec Moved fairwayavailability to a local model. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 2016 diff changeset	356 uniqueFa := uniqueFairwayAvailability{
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	357 BottleneckId: faRes.Bottleneck_id,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	358 Surdat: faRes.SURDAT,
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	359 }
1756 295c82c5bc3e Fairway availability import: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1755 diff changeset	360 var found bool
295c82c5bc3e Fairway availability import: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1755 diff changeset	361 if faID, found = fairwayAvailabilities[uniqueFa]; !found {
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	362 err = insertFAStmt.QueryRowContext(
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	363 ctx,
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	364 faRes.POSITION,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	365 faRes.Bottleneck_id,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	366 faRes.SURDAT,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	367 faRes.Critical,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	368 faRes.Date_Info,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	369 faRes.Source,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	370 ).Scan(&faID)
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	371 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	372 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	373 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	374 fairwayAvailabilities[uniqueFa] = faID
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	375 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	376 feedback.Info("Processing for Bottleneck %s", faRes.Bottleneck_id)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	377 faIDs = append(faIDs, faRes.Bottleneck_id)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	378 if faRes.Bottleneck_PDFs != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	379 bnPdfCount := 0
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	380 for _, bnPdfs := range faRes.Bottleneck_PDFs.PdfInfo {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	381 res, err := insertBnPdfsStmt.ExecContext(
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	382 ctx,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	383 faID,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	384 bnPdfs.ProfilePdfFilename,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	385 bnPdfs.ProfilePdfURL,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	386 bnPdfs.PDF_Generation_Date,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	387 bnPdfs.Source,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	388 )
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	389 if err != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	390 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	391 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	392 affected, err := res.RowsAffected()
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	393 if err == nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	394 bnPdfCount += int(affected)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	395 } else {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	396 bnPdfCount++
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	397 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	398 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	399 feedback.Info("Add %d Pdfs", bnPdfCount)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	400 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	401 if faRes.Effective_fairway_availability != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	402 efaCount := 0
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	403 for _, efa := range faRes.Effective_fairway_availability.EffectiveFairwayAvailability {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	404 los := efa.Level_of_Service
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	405 fgt := efa.Forecast_generation_time
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	406 if efa.Forecast_generation_time.Status == pgtype.Undefined {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	407 fgt = pgtype.Timestamp{
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	408 Status: pgtype.Null,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	409 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	410 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	411 res, err := insertEFAStmt.ExecContext(
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	412 ctx,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	413 faID,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	414 efa.Measure_date,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	415 string(*los),
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	416 efa.Available_depth_value,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	417 efa.Available_width_value,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	418 efa.Water_level_value,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	419 efa.Measure_type,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	420 efa.Source,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	421 fgt.Get(),
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	422 efa.Value_lifetime,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	423 )
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	424 if err != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	425 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	426 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	427 affected, err := res.RowsAffected()
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	428 if err == nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	429 efaCount += int(affected)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	430 } else {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	431 efaCount++
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	432 }
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	433 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	434 feedback.Info("Add %d Effective Fairway Availability", efaCount)
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	435 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	436
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	437 if faRes.Reference_values != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	438 rvCount := 0
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	439 for _, fav := range faRes.Reference_values.ReferenceValue {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	440 res, err := insertFAVStmt.ExecContext(
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	441 ctx,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	442 faID,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	443 fav.Level_of_Service,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	444 fav.Fairway_depth,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	445 fav.Fairway_width,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	446 fav.Fairway_radius,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	447 fav.Shallowest_spot_Lat,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	448 fav.Shallowest_spot_Lon,
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	449 )
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	450 if err != nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	451 return nil, err
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	452 }
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	453 affected, err := res.RowsAffected()
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	454 if err == nil {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	455 rvCount += int(affected)
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	456 } else {
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	457 rvCount++
d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	458 }
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	459 }
1755 d3fe20a13339 Import: Filter fairway availabilities by period and resolve insert confilcts. Raimund Renkert <raimund.renkert@intevation.de> parents: 1754 diff changeset	460 feedback.Info("Add %d Reference Values", rvCount)
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	461 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	462 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	463 feedback.Info("Storing fairway availabilities took %s", time.Since(start))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	464 if err = tx.Commit(); err == nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	465 feedback.Info("Import of fairway availabilities was successful")
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	466 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	467
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	468 return faIDs, nil
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	469 }

Mercurial > gemma

annotate pkg/imports/fa.go @ 2091:3f32b18bbd4c