kallithea: scripts/generate-ini.py annotate

annotate scripts/generate-ini.py @ 6889:73934760f601

ini: use proper Mako for generating shipped ini files Get rid of some regexp hacking ... but we still need some hacking to substitute plain template variables that haven't been marked up.

author	Mads Kiilerich <mads@kiilerich.com>
date	Thu, 14 Sep 2017 02:08:06 +0200
parents	d7222b590156
children	7292c5976752

rev	line source
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	1 #!/usr/bin/env python2
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	2 """
6555 213085032127 gearbox: make a make-config sub-command available again Mads Kiilerich <madski@unity3d.com> parents: 6377 diff changeset	3 Based on kallithea/lib/paster_commands/template.ini.mako, generate
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	4 development.ini
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	5 kallithea/tests/test.ini
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	6 """
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	7
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	8 import re
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	9
6884 e3cce237d77c ini: extract .ini handling from scripts/generate-ini.py to kallithea/lib/inifile.py Mads Kiilerich <mads@kiilerich.com> parents: 6883 diff changeset	10 from kallithea.lib import inifile
e3cce237d77c ini: extract .ini handling from scripts/generate-ini.py to kallithea/lib/inifile.py Mads Kiilerich <mads@kiilerich.com> parents: 6883 diff changeset	11
6555 213085032127 gearbox: make a make-config sub-command available again Mads Kiilerich <madski@unity3d.com> parents: 6377 diff changeset	12 makofile = 'kallithea/lib/paster_commands/template.ini.mako'
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	13
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	14 # the mako variables used in all other ini files and templates
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	15 mako_variable_values = {
6889 73934760f601 ini: use proper Mako for generating shipped ini files Mads Kiilerich <mads@kiilerich.com> parents: 6887 diff changeset	16 'database_engine': 'sqlite',
73934760f601 ini: use proper Mako for generating shipped ini files Mads Kiilerich <mads@kiilerich.com> parents: 6887 diff changeset	17 'http_server': 'waitress',
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	18 'host': '127.0.0.1',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	19 'port': '5000',
6889 73934760f601 ini: use proper Mako for generating shipped ini files Mads Kiilerich <mads@kiilerich.com> parents: 6887 diff changeset	20 'uuid': lambda: '${app_instance_uuid}',
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	21 }
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	22
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	23 # files to be generated from the mako template
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	24 ini_files = [
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	25 ('kallithea/tests/test.ini',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	26 '''
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	27 Kallithea - config for tests:
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	28 sqlalchemy and kallithea_test.sqlite
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	29 custom logging
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	30 ''',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	31 {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	32 '[server:main]': {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	33 'port': '4999',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	34 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	35 '[app:main]': {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	36 'app_instance_uuid': 'test',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	37 'show_revision_number': 'true',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	38 'beaker.cache.sql_cache_short.expire': '1',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	39 'beaker.session.secret': '{74e0cd75-b339-478b-b129-07dd221def1f}',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	40 },
6145 b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	41 '[handler_console]': {
b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	42 'formatter': 'color_formatter',
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	43 },
6145 b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	44 # The 'handler_console_sql' block is very similar to the one in
b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	45 # development.ini, but without the explicit 'level=DEBUG' setting:
b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	46 # it causes duplicate sqlalchemy debug logs, one through
b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	47 # handler_console_sql and another through another path.
b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	48 '[handler_console_sql]': {
b1fc5a98952c test.ini: align some logging-related settings with development.ini Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6038 diff changeset	49 'formatter': 'color_formatter_sql',
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	50 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	51 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	52 ),
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	53 ('development.ini',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	54 '''
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	55 Kallithea - Development config:
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	56 listening on *:5000
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	57 sqlite and kallithea.db
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	58 initial_repo_scan = true
6573 fc6b1b0e1096 ini: set 'debug' only in one place Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6555 diff changeset	59 debug = true
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	60 verbose and colorful logging
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	61 ''',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	62 {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	63 '[server:main]': {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	64 'host': '0.0.0.0',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	65 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	66 '[app:main]': {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	67 'initial_repo_scan': 'true',
6573 fc6b1b0e1096 ini: set 'debug' only in one place Thomas De Schampheleire <thomas.de.schampheleire@gmail.com> parents: 6555 diff changeset	68 'debug': 'true',
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	69 'app_instance_uuid': 'development-not-secret',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	70 'beaker.session.secret': 'development-not-secret',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	71 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	72 '[handler_console]': {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	73 'formatter': 'color_formatter',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	74 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	75 '[handler_console_sql]': {
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	76 'formatter': 'color_formatter_sql',
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	77 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	78 },
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	79 ),
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	80 ]
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	81
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	82
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	83 def main():
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	84 # make sure all mako lines starting with '#' (the '##' comments) are marked up as <text>
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	85 print 'reading:', makofile
6860 665dfa112f2c py3: replace "file" with "open" Lars Kruse <devel@sumpfralle.de> parents: 6857 diff changeset	86 mako_org = open(makofile).read()
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	87 mako_no_text_markup = re.sub(r'</?%text>', '', mako_org)
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	88 mako_marked_up = re.sub(r'\n(##.*)', r'\n<%text>\1</%text>', mako_no_text_markup, flags=re.MULTILINE)
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	89 if mako_marked_up != mako_org:
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	90 print 'writing:', makofile
6860 665dfa112f2c py3: replace "file" with "open" Lars Kruse <devel@sumpfralle.de> parents: 6857 diff changeset	91 open(makofile, 'w').write(mako_marked_up)
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	92
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	93 # create ini files
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	94 for fn, desc, settings in ini_files:
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	95 print 'updating:', fn
6889 73934760f601 ini: use proper Mako for generating shipped ini files Mads Kiilerich <mads@kiilerich.com> parents: 6887 diff changeset	96 ini_lines = inifile.expand(mako_marked_up, desc, mako_variable_values, settings)
6860 665dfa112f2c py3: replace "file" with "open" Lars Kruse <devel@sumpfralle.de> parents: 6857 diff changeset	97 open(fn, 'w').write(ini_lines)
5536 06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	98
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	99 if __name__ == '__main__':
06d5c043e989 ini: add scripts/generate-ini.py for generating all .ini files from template.ini.mako Mads Kiilerich <madski@unity3d.com> parents: diff changeset	100 main()

Mercurial > kallithea

annotate scripts/generate-ini.py @ 6889:73934760f601