gemma: pkg/imports/fa.go annotate

annotate pkg/imports/fa.go @ 1696:ad5e1cddaa09

Imports: Resolved the remaining golint issues with this package.

author	Sascha L. Teichmann <sascha.teichmann@intevation.de>
date	Fri, 04 Jan 2019 13:41:07 +0100
parents	4a2fad8f57de
children	807569b08513

rev	line source
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	1 // This is Free Software under GNU Affero General Public License v >= 3.0
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	2 // without warranty, see README.md and license for details.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	3 //
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	4 // SPDX-License-Identifier: AGPL-3.0-or-later
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	5 // License-Filename: LICENSES/AGPL-3.0.txt
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	6 //
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	7 // Copyright (C) 2018 by via donau
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	8 // – Österreichische Wasserstraßen-Gesellschaft mbH
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	9 // Software engineering by Intevation GmbH
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	10 //
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	11 // Author(s):
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	12 // * Raimund Renkert <raimund.renkert@intevation.de>
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	13
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	14 package imports
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	15
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	16 import (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	17 "context"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	18 "database/sql"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	19 "errors"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	20 "time"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	21
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	22 "github.com/jackc/pgx/pgtype"
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	23
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	24 "gemma.intevation.de/gemma/pkg/common"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	25 "gemma.intevation.de/gemma/pkg/models"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	26 "gemma.intevation.de/gemma/pkg/soap/ifaf"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	27 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	28
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	29 // FairwayAvailability imports fairway availability data
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	30 // from an IFAF SOAP service.
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	31 type FairwayAvailability struct {
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	32 // URL is the URL of the SOAP service.
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	33 URL string `json:"url"`
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	34 // Insecure indicates if HTTPS traffic
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	35 // should validate certificates or not.
ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	36 Insecure bool `json:"insecure"`
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	37 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	38
1696 ad5e1cddaa09 Imports: Resolved the remaining golint issues with this package. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1694 diff changeset	39 // FAJobKind is import queue type identifier.
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	40 const FAJobKind JobKind = "fa"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	41
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	42 const (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	43 listBottlenecksSQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	44 SELECT
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	45 bottleneck_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	46 responsible_country
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	47 FROM waterway.bottlenecks
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	48 WHERE responsible_country = users.current_user_country()
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	49 AND staging_done = true
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	50 `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	51 insertFASQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	52 INSERT INTO waterway.fairway_availability (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	53 position_code,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	54 bottleneck_id,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	55 surdat,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	56 critical,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	57 date_info,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	58 source_organization
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	59 ) VALUES (
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	60 $1,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	61 (SELECT id FROM waterway.bottlenecks WHERE bottleneck_id = $2),
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	62 $3,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	63 $4,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	64 $5,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	65 $6
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	66 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	67 RETURNING id`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	68
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	69 insertBnPdfsSQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	70 INSERT INTO waterway.bottleneck_pdfs (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	71 fairway_availability_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	72 profile_pdf_filename,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	73 profile_pdf_url,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	74 pdf_generation_date,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	75 source_organization
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	76 ) VALUES (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	77 $1,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	78 $2,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	79 $3,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	80 $4,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	81 $5
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	82 )`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	83 insertEFASQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	84 INSERT INTO waterway.effective_fairway_availability (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	85 fairway_availability_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	86 measure_date,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	87 level_of_service,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	88 available_depth_value,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	89 available_width_value,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	90 water_level_value,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	91 measure_type,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	92 source_organization,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	93 forecast_generation_time,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	94 value_lifetime
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	95 ) VALUES (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	96 $1,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	97 $2,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	98 (SELECT
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	99 level_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	100 FROM levels_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	101 WHERE name = $3),
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	102 $4,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	103 $5,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	104 $6,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	105 $7,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	106 $8,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	107 $9,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	108 $10
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	109 )`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	110 insertFAVSQL = `
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	111 INSERT INTO waterway.fa_reference_values (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	112 fairway_availability_id,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	113 level_of_service,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	114 fairway_depth,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	115 fairway_width,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	116 fairway_radius,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	117 shallowest_spot
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	118 ) VALUES (
1663 10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	119 $1,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	120 (SELECT
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	121 level_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	122 FROM levels_of_service
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	123 WHERE name = $2),
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	124 $3,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	125 $4,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	126 $5,
10e3dd3b9363 Fairway availability import: Don't use tabs in SQL statements. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1662 diff changeset	127 ST_MakePoint($6, $7)::geography
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	128 )`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	129 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	130
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	131 type faJobCreator struct{}
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	132
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	133 func init() {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	134 RegisterJobCreator(FAJobKind, faJobCreator{})
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	135 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	136
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	137 func (faJobCreator) Description() string {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	138 return "fairway availability"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	139 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	140
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	141 func (faJobCreator) Create(_ JobKind, data string) (Job, error) {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	142 fa := new(FairwayAvailability)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	143 if err := common.FromJSONString(data, fa); err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	144 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	145 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	146 return fa, nil
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	147 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	148
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	149 func (faJobCreator) Depends() []string {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	150 return []string{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	151 "bottlenecks",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	152 "fairway_availability",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	153 "bottleneck_pdfs",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	154 "effective_fairway_availability",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	155 "fa_reference_values",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	156 "levels_of_service",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	157 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	158 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	159
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	160 // StageDone moves the imported fairway availablities out of the staging area.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	161 // Currently doing nothing.
1676 4407ecaa2192 Imports: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1663 diff changeset	162 func (faJobCreator) StageDone(context.Context, *sql.Tx, int64) error {
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	163 return nil
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	164 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	165
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	166 // CleanUp of a fairway availablities import is a NOP.
1676 4407ecaa2192 Imports: Cosmetics. Sascha L. Teichmann <sascha.teichmann@intevation.de> parents: 1663 diff changeset	167 func (*FairwayAvailability) CleanUp() error { return nil }
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	168
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	169 // Do executes the actual fairway availability import.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	170 func (fa *FairwayAvailability) Do(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	171 ctx context.Context,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	172 importID int64,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	173 conn *sql.Conn,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	174 feedback Feedback,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	175 ) (interface{}, error) {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	176
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	177 // Get available bottlenecks from database for use as filter in SOAP request
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	178 var rows *sql.Rows
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	179
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	180 rows, err := conn.QueryContext(ctx, listBottlenecksSQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	181 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	182 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	183 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	184 defer rows.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	185
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	186 bottlenecks := []models.Bottleneck{}
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	187
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	188 for rows.Next() {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	189 var bn models.Bottleneck
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	190 if err = rows.Scan(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	191 &bn.ID,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	192 &bn.ResponsibleCountry,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	193 ); err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	194 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	195 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	196 bottlenecks = append(bottlenecks, bn)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	197 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	198
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	199 if err = rows.Err(); err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	200 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	201 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	202
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	203 faids, err := fa.doForFAs(ctx, bottlenecks, conn, feedback)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	204 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	205 feedback.Error("Error processing data: %s", err)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	206 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	207 if len(faids) == 0 {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	208 feedback.Info("No new fairway availablity data found")
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	209 return nil, nil
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	210 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	211 feedback.Info("Processed %d of %d bottlenecks", len(faids), len(bottlenecks))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	212 // TODO: needs to be filled more useful.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	213 summary := struct {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	214 FairwayAvailabilities []string `json:"fairwayAvailabilities"`
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	215 }{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	216 FairwayAvailabilities: faids,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	217 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	218 return &summary, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	219 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	220
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	221 func (fa *FairwayAvailability) doForFAs(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	222 ctx context.Context,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	223 bottlenecks []models.Bottleneck,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	224 conn *sql.Conn,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	225 feedback Feedback,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	226 ) ([]string, error) {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	227 start := time.Now()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	228
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	229 client := ifaf.NewFairwayAvailabilityService(fa.URL, fa.Insecure, nil)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	230
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	231 var bnIds []string
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	232 for _, bn := range bottlenecks {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	233 bnIds = append(bnIds, bn.ID)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	234 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	235
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	236 ids := ifaf.ArrayOfString{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	237 String: bnIds,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	238 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	239
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	240 // TODO: Filter by period. Period should start after latest measurement date.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	241 req := &ifaf.Get_bottleneck_fa{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	242 Bottleneck_id: &ids,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	243 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	244 resp, err := client.Get_bottleneck_fa(req)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	245 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	246 feedback.Error("%v", err)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	247 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	248 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	249
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	250 if resp.Get_bottleneck_faResult == nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	251 err := errors.New("no fairway availabilities found")
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	252 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	253 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	254
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	255 result := resp.Get_bottleneck_faResult
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	256
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	257 tx, err := conn.BeginTx(ctx, nil)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	258 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	259 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	260 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	261 defer tx.Rollback()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	262
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	263 insertFAStmt, err := tx.PrepareContext(ctx, insertFASQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	264 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	265 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	266 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	267 defer insertFAStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	268 insertBnPdfsStmt, err := tx.PrepareContext(ctx, insertBnPdfsSQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	269 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	270 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	271 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	272 defer insertBnPdfsStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	273 insertEFAStmt, err := tx.PrepareContext(ctx, insertEFASQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	274 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	275 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	276 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	277 defer insertEFAStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	278 insertFAVStmt, err := tx.PrepareContext(ctx, insertFAVSQL)
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	279 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	280 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	281 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	282 defer insertFAVStmt.Close()
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	283
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	284 var faIDs []string
4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	285 var faID int64
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	286 feedback.Info("Found %d fairway availabilities", len(result.FairwayAvailability))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	287 for _, faRes := range result.FairwayAvailability {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	288 // TODO: high frequent requests lead to "duplicate key value violates unique constraint "fairway_availability_bottleneck_id_surdat_key"
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	289 // in the database. This has to be resolved.
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	290 // All data subsets can also ocure as duplicates!
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	291 err = insertFAStmt.QueryRowContext(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	292 ctx,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	293 faRes.POSITION,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	294 faRes.Bottleneck_id,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	295 faRes.SURDAT,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	296 faRes.Critical,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	297 faRes.Date_Info,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	298 faRes.Source,
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	299 ).Scan(&faID)
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	300 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	301 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	302 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	303 feedback.Info("Processing for Bottleneck %s", faRes.Bottleneck_id)
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	304 faIDs = append(faIDs, faRes.Bottleneck_id)
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	305 for _, bnPdfs := range faRes.Bottleneck_PDFs.PdfInfo {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	306 _, err = insertBnPdfsStmt.ExecContext(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	307 ctx,
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	308 faID,
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	309 bnPdfs.ProfilePdfFilename,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	310 bnPdfs.ProfilePdfURL,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	311 bnPdfs.PDF_Generation_Date,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	312 bnPdfs.Source,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	313 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	314 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	315 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	316 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	317 feedback.Info("Add %d Pdfs", len(faRes.Bottleneck_PDFs.PdfInfo))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	318 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	319 for _, efa := range faRes.Effective_fairway_availability.EffectiveFairwayAvailability {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	320 los := efa.Level_of_Service
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	321 fgt := efa.Forecast_generation_time
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	322 if efa.Forecast_generation_time.Status == pgtype.Undefined {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	323 fgt = pgtype.Timestamp{
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	324 Status: pgtype.Null,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	325 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	326 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	327 _, err = insertEFAStmt.ExecContext(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	328 ctx,
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	329 faID,
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	330 efa.Measure_date,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	331 string(*los),
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	332 efa.Available_depth_value,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	333 efa.Available_width_value,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	334 efa.Water_level_value,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	335 efa.Measure_type,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	336 efa.Source,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	337 fgt,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	338 efa.Value_lifetime,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	339 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	340 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	341 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	342 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	343 feedback.Info("Add %d Effective Fairway Availability", len(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	344 faRes.Effective_fairway_availability.EffectiveFairwayAvailability))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	345 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	346 for _, fav := range faRes.Reference_values.ReferenceValue {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	347 _, err = insertFAVStmt.ExecContext(
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	348 ctx,
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	349 faID,
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	350 fav.Level_of_Service,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	351 fav.Fairway_depth,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	352 fav.Fairway_width,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	353 fav.Fairway_radius,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	354 fav.Shallowest_spot_Lat,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	355 fav.Shallowest_spot_Lon,
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	356 )
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	357 if err != nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	358 return nil, err
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	359 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	360 feedback.Info("Add %d Reference Values",
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	361 len(faRes.Reference_values.ReferenceValue))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	362 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	363 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	364 feedback.Info("Storing fairway availabilities took %s", time.Since(start))
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	365 if err = tx.Commit(); err == nil {
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	366 feedback.Info("Import of fairway availabilities was successful")
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	367 }
d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	368
1694 4a2fad8f57de Imports: Resolved golint issues unrelated to exported symbols commenting. Sascha L. Teichmann <teichmann@intevation.de> parents: 1676 diff changeset	369 return faIDs, nil
1662 d8ca44615bfc Implemented first version of fairway availability import. Raimund Renkert <raimund.renkert@intevation.de> parents: diff changeset	370 }

Mercurial > gemma

annotate pkg/imports/fa.go @ 1696:ad5e1cddaa09