kallithea: rhodecode/lib/utils.py annotate

annotate rhodecode/lib/utils.py @ 639:45e1fdc0082c

Version bump,freeze of dependent libs. Little test update

author	Marcin Kuzminski <marcin@python-works.com>
date	Tue, 02 Nov 2010 20:19:05 +0100
parents	9893c2fc846b
children	bee56f209c40

rev	line source
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	1 #!/usr/bin/env python
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	2 # encoding: utf-8
569 000b675e7c1d bumped version, some spelling fixes Marcin Kuzminski <marcin@python-works.com> parents: 567 diff changeset	3 # Utilities for RhodeCode
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	4 # Copyright (C) 2009-2010 Marcin Kuzminski <marcin@python-works.com>
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	5 # This program is free software; you can redistribute it and/or
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	6 # modify it under the terms of the GNU General Public License
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	7 # as published by the Free Software Foundation; version 2
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	8 # of the License or (at your opinion) any later version of the license.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	9 #
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	10 # This program is distributed in the hope that it will be useful,
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	11 # but WITHOUT ANY WARRANTY; without even the implied warranty of
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	12 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	13 # GNU General Public License for more details.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	14 #
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	15 # You should have received a copy of the GNU General Public License
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	16 # along with this program; if not, write to the Free Software
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	17 # Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston,
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	18 # MA 02110-1301, USA.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	19
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	20 """
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	21 Created on April 18, 2010
569 000b675e7c1d bumped version, some spelling fixes Marcin Kuzminski <marcin@python-works.com> parents: 567 diff changeset	22 Utilities for RhodeCode
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	23 @author: marcink
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	24 """
351 d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	25 from beaker.cache import cache_region
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	26 from mercurial import ui, config, hg
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	27 from mercurial.error import RepoError
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	28 from rhodecode.model import meta
549 f99075170eb4 more renames for rhode code !! Marcin Kuzminski <marcin@python-works.com> parents: 548 diff changeset	29 from rhodecode.model.db import Repository, User, RhodeCodeUi, RhodeCodeSettings, UserLog
351 d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	30 from vcs.backends.base import BaseChangeset
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	31 from vcs.utils.lazy import LazyProperty
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	32 import logging
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	33 import datetime
351 d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	34 import os
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	35
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	36 log = logging.getLogger(__name__)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	37
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	38
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	39 def get_repo_slug(request):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	40 return request.environ['pylons.routes_dict'].get('repo_name')
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	41
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	42 def is_mercurial(environ):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	43 """
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	44 Returns True if request's target is mercurial server - header
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	45 ``HTTP_ACCEPT`` of such request would start with ``application/mercurial``.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	46 """
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	47 http_accept = environ.get('HTTP_ACCEPT')
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	48 if http_accept and http_accept.startswith('application/mercurial'):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	49 return True
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	50 return False
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	51
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	52 def is_git(environ):
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	53 """
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	54 Returns True if request's target is git server. ``HTTP_USER_AGENT`` would
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	55 then have git client version given.
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	56
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	57 :param environ:
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	58 """
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	59 http_user_agent = environ.get('HTTP_USER_AGENT')
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	60 if http_user_agent.startswith('git'):
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	61 return True
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	62 return False
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	63
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	64 def action_logger(user, action, repo, ipaddr, sa=None):
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	65 """
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	66 Action logger for various action made by users
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	67 """
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	68
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	69 if not sa:
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	70 sa = meta.Session
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	71
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	72 try:
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	73 if hasattr(user, 'user_id'):
48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	74 user_id = user.user_id
48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	75 elif isinstance(user, basestring):
48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	76 user_id = sa.query(User).filter(User.username == user).one()
48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	77 else:
48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	78 raise Exception('You have to provide user object or username')
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	79
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	80 repo_name = repo.lstrip('/')
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	81 user_log = UserLog()
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	82 user_log.user_id = user_id
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	83 user_log.action = action
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	84 user_log.repository_name = repo_name
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	85 user_log.repository = sa.query(Repository)\
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	86 .filter(Repository.repo_name == repo_name).one()
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	87 user_log.action_date = datetime.datetime.now()
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	88 user_log.user_ip = ipaddr
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	89 sa.add(user_log)
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	90 sa.commit()
621 9893c2fc846b removed raise from log user action Marcin Kuzminski <marcin@python-works.com> parents: 604 diff changeset	91
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	92 log.info('Adding user %s, action %s on %s',
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	93 user.username, action, repo)
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	94 except Exception, e:
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	95 sa.rollback()
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	96 log.error('could not log user action:%s', str(e))
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	97
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	98 def check_repo_dir(paths):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	99 repos_path = paths[0][1].split('/')
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	100 if repos_path[-1] in ['', '*']:
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	101 repos_path = repos_path[:-1]
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	102 if repos_path[0] != '/':
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	103 repos_path[0] = '/'
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	104 if not os.path.isdir(os.path.join(*repos_path)):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	105 raise Exception('Not a valid repository in %s' % paths[0][1])
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	106
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	107 def check_repo_fast(repo_name, base_path):
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	108 if os.path.isdir(os.path.join(base_path, repo_name)):return False
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	109 return True
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	110
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	111 def check_repo(repo_name, base_path, verify=True):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	112
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	113 repo_path = os.path.join(base_path, repo_name)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	114
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	115 try:
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	116 if not check_repo_fast(repo_name, base_path):
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	117 return False
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	118 r = hg.repository(ui.ui(), repo_path)
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	119 if verify:
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	120 hg.verify(r)
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	121 #here we hnow that repo exists it was verified
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	122 log.info('%s repo is already created', repo_name)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	123 return False
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	124 except RepoError:
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	125 #it means that there is no valid repo there...
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	126 log.info('%s repo is free for creation', repo_name)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	127 return True
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	128
351 d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	129 def ask_ok(prompt, retries=4, complaint='Yes or no, please!'):
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	130 while True:
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	131 ok = raw_input(prompt)
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	132 if ok in ('y', 'ye', 'yes'): return True
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	133 if ok in ('n', 'no', 'nop', 'nope'): return False
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	134 retries = retries - 1
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	135 if retries < 0: raise IOError
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	136 print complaint
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	137
343 6484963056cd implemented cache for repeated queries in simplehg mercurial requests Marcin Kuzminski <marcin@python-works.com> parents: 341 diff changeset	138 @cache_region('super_short_term', 'cached_hg_ui')
6484963056cd implemented cache for repeated queries in simplehg mercurial requests Marcin Kuzminski <marcin@python-works.com> parents: 341 diff changeset	139 def get_hg_ui_cached():
350 664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	140 try:
664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	141 sa = meta.Session
549 f99075170eb4 more renames for rhode code !! Marcin Kuzminski <marcin@python-works.com> parents: 548 diff changeset	142 ret = sa.query(RhodeCodeUi).all()
350 664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	143 finally:
664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	144 meta.Session.remove()
664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	145 return ret
664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	146
343 6484963056cd implemented cache for repeated queries in simplehg mercurial requests Marcin Kuzminski <marcin@python-works.com> parents: 341 diff changeset	147
345 bb8f45f6d8f9 updated hg-app db manage and global settings Marcin Kuzminski <marcin@python-works.com> parents: 343 diff changeset	148 def get_hg_settings():
350 664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	149 try:
664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	150 sa = meta.Session
549 f99075170eb4 more renames for rhode code !! Marcin Kuzminski <marcin@python-works.com> parents: 548 diff changeset	151 ret = sa.query(RhodeCodeSettings).all()
350 664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	152 finally:
664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	153 meta.Session.remove()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	154
345 bb8f45f6d8f9 updated hg-app db manage and global settings Marcin Kuzminski <marcin@python-works.com> parents: 343 diff changeset	155 if not ret:
bb8f45f6d8f9 updated hg-app db manage and global settings Marcin Kuzminski <marcin@python-works.com> parents: 343 diff changeset	156 raise Exception('Could not get application settings !')
381 55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	157 settings = {}
55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	158 for each in ret:
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	159 settings['rhodecode_' + each.app_settings_name] = each.app_settings_value
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	160
381 55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	161 return settings
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	162
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	163 def get_hg_ui_settings():
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	164 try:
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	165 sa = meta.Session
549 f99075170eb4 more renames for rhode code !! Marcin Kuzminski <marcin@python-works.com> parents: 548 diff changeset	166 ret = sa.query(RhodeCodeUi).all()
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	167 finally:
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	168 meta.Session.remove()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	169
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	170 if not ret:
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	171 raise Exception('Could not get application ui settings !')
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	172 settings = {}
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	173 for each in ret:
395 e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	174 k = each.ui_key
e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	175 v = each.ui_value
e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	176 if k == '/':
e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	177 k = 'root_path'
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	178
395 e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	179 if k.find('.') != -1:
e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	180 k = k.replace('.', '_')
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	181
395 e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	182 if each.ui_section == 'hooks':
e8af467b5a60 Added hooks managment into application settings Marcin Kuzminski <marcin@python-works.com> parents: 392 diff changeset	183 v = each.ui_active
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	184
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	185 settings[each.ui_section + '_' + k] = v
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	186
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	187 return settings
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	188
3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	189 #propagated from mercurial documentation
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	190 ui_sections = ['alias', 'auth',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	191 'decode/encode', 'defaults',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	192 'diff', 'email',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	193 'extensions', 'format',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	194 'merge-patterns', 'merge-tools',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	195 'hooks', 'http_proxy',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	196 'smtp', 'patch',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	197 'paths', 'profiling',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	198 'server', 'trusted',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	199 'ui', 'web', ]
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	200
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	201 def make_ui(read_from='file', path=None, checkpaths=True):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	202 """
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	203 A function that will read python rc files or database
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	204 and make an mercurial ui object from read options
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	205
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	206 :param path: path to mercurial config file
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	207 :param checkpaths: check the path
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	208 :param read_from: read from 'file' or 'db'
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	209 """
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	210
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	211 baseui = ui.ui()
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	212
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	213 if read_from == 'file':
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	214 if not os.path.isfile(path):
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	215 log.warning('Unable to read config file %s' % path)
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	216 return False
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	217 log.debug('reading hgrc from %s', path)
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	218 cfg = config.config()
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	219 cfg.read(path)
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	220 for section in ui_sections:
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	221 for k, v in cfg.items(section):
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	222 baseui.setconfig(section, k, v)
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	223 log.debug('settings ui from file[%s]%s:%s', section, k, v)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	224 if checkpaths:check_repo_dir(cfg.items('paths'))
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	225
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	226
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	227 elif read_from == 'db':
343 6484963056cd implemented cache for repeated queries in simplehg mercurial requests Marcin Kuzminski <marcin@python-works.com> parents: 341 diff changeset	228 hg_ui = get_hg_ui_cached()
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	229 for ui_ in hg_ui:
392 b27d32cb3157 Implemented hooks system, Marcin Kuzminski <marcin@python-works.com> parents: 388 diff changeset	230 if ui_.ui_active:
b27d32cb3157 Implemented hooks system, Marcin Kuzminski <marcin@python-works.com> parents: 388 diff changeset	231 log.debug('settings ui from db[%s]%s:%s', ui_.ui_section, ui_.ui_key, ui_.ui_value)
b27d32cb3157 Implemented hooks system, Marcin Kuzminski <marcin@python-works.com> parents: 388 diff changeset	232 baseui.setconfig(ui_.ui_section, ui_.ui_key, ui_.ui_value)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	233
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	234
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	235 return baseui
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	236
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	237
548 b75b77ef649d renamed hg_app to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 547 diff changeset	238 def set_rhodecode_config(config):
345 bb8f45f6d8f9 updated hg-app db manage and global settings Marcin Kuzminski <marcin@python-works.com> parents: 343 diff changeset	239 hgsettings = get_hg_settings()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	240
381 55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	241 for k, v in hgsettings.items():
55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	242 config[k] = v
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	243
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	244 def invalidate_cache(name, *args):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	245 """Invalidates given name cache"""
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	246
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	247 from beaker.cache import region_invalidate
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	248 log.info('INVALIDATING CACHE FOR %s', name)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	249
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	250 """propagate our arguments to make sure invalidation works. First
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	251 argument has to be the name of cached func name give to cache decorator
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	252 without that the invalidation would not work"""
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	253 tmp = [name]
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	254 tmp.extend(args)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	255 args = tuple(tmp)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	256
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	257 if name == 'cached_repo_list':
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	258 from rhodecode.model.hg_model import _get_repos_cached
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	259 region_invalidate(_get_repos_cached, None, *args)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	260
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	261 if name == 'full_changelog':
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	262 from rhodecode.model.hg_model import _full_changelog_cached
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	263 region_invalidate(_full_changelog_cached, None, *args)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	264
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	265 class EmptyChangeset(BaseChangeset):
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	266 """
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	267 An dummy empty changeset.
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	268 """
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	269
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	270 revision = -1
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	271 message = ''
489 460ad816820d fixed bug when new repo had no last commiter, Marcin Kuzminski <marcin@python-works.com> parents: 473 diff changeset	272 author = ''
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	273 date = ''
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	274 @LazyProperty
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	275 def raw_id(self):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	276 """
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	277 Returns raw string identifing this changeset, useful for web
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	278 representation.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	279 """
520 eda96fb85ba7 dohh !! fixed EmptyCHangeset for new vcs Marcin Kuzminski <marcin@python-works.com> parents: 497 diff changeset	280 return '0' * 40
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	281
524 63212fea2471 a lot of fixes in templates, Marcin Kuzminski <marcin@python-works.com> parents: 520 diff changeset	282 @LazyProperty
520 eda96fb85ba7 dohh !! fixed EmptyCHangeset for new vcs Marcin Kuzminski <marcin@python-works.com> parents: 497 diff changeset	283 def short_id(self):
524 63212fea2471 a lot of fixes in templates, Marcin Kuzminski <marcin@python-works.com> parents: 520 diff changeset	284 return self.raw_id[:12]
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	285
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	286 def get_file_changeset(self, path):
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	287 return self
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	288
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	289 def get_file_content(self, path):
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	290 return u''
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	291
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	292 def get_file_size(self, path):
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	293 return 0
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	294
348 e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	295 def repo2db_mapper(initial_repo_list, remove_obsolete=False):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	296 """
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	297 maps all found repositories into db
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	298 """
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	299 from rhodecode.model.repo_model import RepoModel
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	300
350 664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	301 sa = meta.Session
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	302 user = sa.query(User).filter(User.admin == True).first()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	303
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	304 rm = RepoModel()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	305
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	306 for name, repo in initial_repo_list.items():
367 a26f48ad7a8a fixes issue #16 reimplementation of database repository, for using generic pk instead of repo naming as pk. Which caused to many problems. Marcin Kuzminski <marcin@python-works.com> parents: 358 diff changeset	307 if not sa.query(Repository).filter(Repository.repo_name == name).scalar():
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	308 log.info('repository %s not found creating default', name)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	309
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	310 form_data = {
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	311 'repo_name':name,
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	312 'description':repo.description if repo.description != 'unknown' else \
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	313 'auto description for %s' % name,
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	314 'private':False
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	315 }
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	316 rm.create(form_data, user, just_db=True)
348 e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	317
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	318
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	319 if remove_obsolete:
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	320 #remove from database those repositories that are not in the filesystem
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	321 for repo in sa.query(Repository).all():
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	322 if repo.repo_name not in initial_repo_list.keys():
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	323 sa.delete(repo)
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	324 sa.commit()
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	325
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	326
350 664a5b8c551a Added application settings, are now customizable from database Marcin Kuzminski <marcin@python-works.com> parents: 348 diff changeset	327 meta.Session.remove()
358 23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	328
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	329 from UserDict import DictMixin
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	330
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	331 class OrderedDict(dict, DictMixin):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	332
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	333 def __init__(self, args, *kwds):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	334 if len(args) > 1:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	335 raise TypeError('expected at most 1 arguments, got %d' % len(args))
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	336 try:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	337 self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	338 except AttributeError:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	339 self.clear()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	340 self.update(args, *kwds)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	341
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	342 def clear(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	343 self.__end = end = []
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	344 end += [None, end, end] # sentinel node for doubly linked list
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	345 self.__map = {} # key --> [key, prev, next]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	346 dict.clear(self)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	347
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	348 def __setitem__(self, key, value):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	349 if key not in self:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	350 end = self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	351 curr = end[1]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	352 curr[2] = end[1] = self.__map[key] = [key, curr, end]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	353 dict.__setitem__(self, key, value)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	354
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	355 def __delitem__(self, key):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	356 dict.__delitem__(self, key)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	357 key, prev, next = self.__map.pop(key)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	358 prev[2] = next
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	359 next[1] = prev
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	360
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	361 def __iter__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	362 end = self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	363 curr = end[2]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	364 while curr is not end:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	365 yield curr[0]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	366 curr = curr[2]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	367
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	368 def __reversed__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	369 end = self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	370 curr = end[1]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	371 while curr is not end:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	372 yield curr[0]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	373 curr = curr[1]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	374
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	375 def popitem(self, last=True):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	376 if not self:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	377 raise KeyError('dictionary is empty')
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	378 if last:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	379 key = reversed(self).next()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	380 else:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	381 key = iter(self).next()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	382 value = self.pop(key)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	383 return key, value
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	384
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	385 def __reduce__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	386 items = [[k, self[k]] for k in self]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	387 tmp = self.__map, self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	388 del self.__map, self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	389 inst_dict = vars(self).copy()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	390 self.__map, self.__end = tmp
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	391 if inst_dict:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	392 return (self.__class__, (items,), inst_dict)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	393 return self.__class__, (items,)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	394
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	395 def keys(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	396 return list(self)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	397
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	398 setdefault = DictMixin.setdefault
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	399 update = DictMixin.update
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	400 pop = DictMixin.pop
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	401 values = DictMixin.values
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	402 items = DictMixin.items
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	403 iterkeys = DictMixin.iterkeys
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	404 itervalues = DictMixin.itervalues
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	405 iteritems = DictMixin.iteritems
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	406
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	407 def __repr__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	408 if not self:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	409 return '%s()' % (self.__class__.__name__,)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	410 return '%s(%r)' % (self.__class__.__name__, self.items())
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	411
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	412 def copy(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	413 return self.__class__(self)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	414
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	415 @classmethod
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	416 def fromkeys(cls, iterable, value=None):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	417 d = cls()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	418 for key in iterable:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	419 d[key] = value
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	420 return d
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	421
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	422 def __eq__(self, other):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	423 if isinstance(other, OrderedDict):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	424 return len(self) == len(other) and self.items() == other.items()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	425 return dict.__eq__(self, other)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	426
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	427 def __ne__(self, other):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	428 return not self == other
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	429
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	430
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	431 #===============================================================================
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	432 # TEST FUNCTIONS
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	433 #===============================================================================
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	434 def create_test_index(repo_location, full_index):
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	435 """Makes default test index
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	436 :param repo_location:
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	437 :param full_index:
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	438 """
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	439 from rhodecode.lib.indexers.daemon import WhooshIndexingDaemon
1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	440 from rhodecode.lib.pidlock import DaemonLock, LockHeld
1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	441 from rhodecode.lib.indexers import IDX_LOCATION
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	442 import shutil
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	443
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	444 if os.path.exists(IDX_LOCATION):
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	445 shutil.rmtree(IDX_LOCATION)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	446
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	447 try:
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	448 l = DaemonLock()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	449 WhooshIndexingDaemon(repo_location=repo_location)\
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	450 .run(full_index=full_index)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	451 l.release()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	452 except LockHeld:
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	453 pass
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	454
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	455 def create_test_env(repos_test_path, config):
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	456 """Makes a fresh database and
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	457 install test repository into tmp dir
6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	458 """
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	459 from rhodecode.lib.db_manage import DbManage
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	460 import tarfile
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	461 import shutil
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	462 from os.path import dirname as dn, join as jn, abspath
639 45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	463 from rhodecode.tests import REPO_PATH, NEW_REPO_PATH
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	464
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	465 log = logging.getLogger('TestEnvCreator')
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	466 # create logger
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	467 log.setLevel(logging.DEBUG)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	468 log.propagate = True
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	469 # create console handler and set level to debug
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	470 ch = logging.StreamHandler()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	471 ch.setLevel(logging.DEBUG)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	472
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	473 # create formatter
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	474 formatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s")
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	475
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	476 # add formatter to ch
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	477 ch.setFormatter(formatter)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	478
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	479 # add ch to logger
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	480 log.addHandler(ch)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	481
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	482 #PART ONE create db
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	483 dbname = config['sqlalchemy.db1.url'].split('/')[-1]
567 80dc0a23edf7 fixed whoosh failure on new repository Marcin Kuzminski <marcin@python-works.com> parents: 552 diff changeset	484 log.debug('making test db %s', dbname)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	485
552 2642f128ad46 removed egg info, update files for distutils build Marcin Kuzminski <marcin@python-works.com> parents: 549 diff changeset	486 dbmanage = DbManage(log_sql=True, dbname=dbname, root=config['here'],
2642f128ad46 removed egg info, update files for distutils build Marcin Kuzminski <marcin@python-works.com> parents: 549 diff changeset	487 tests=True)
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	488 dbmanage.create_tables(override=True)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	489 dbmanage.config_prompt(repos_test_path)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	490 dbmanage.create_default_user()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	491 dbmanage.admin_prompt()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	492 dbmanage.create_permissions()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	493 dbmanage.populate_default_permissions()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	494
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	495 #PART TWO make test repo
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	496 log.debug('making test vcs repo')
639 45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	497 if os.path.isdir(REPO_PATH):
45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	498 log.debug('REMOVING %s', REPO_PATH)
45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	499 shutil.rmtree(REPO_PATH)
45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	500 if os.path.isdir(NEW_REPO_PATH):
45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	501 log.debug('REMOVING %s', NEW_REPO_PATH)
45e1fdc0082c Version bump,freeze of dependent libs. Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	502 shutil.rmtree(NEW_REPO_PATH)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	503
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	504 cur_dir = dn(dn(abspath(__file__)))
489 460ad816820d fixed bug when new repo had no last commiter, Marcin Kuzminski <marcin@python-works.com> parents: 473 diff changeset	505 tar = tarfile.open(jn(cur_dir, 'tests', "vcs_test.tar.gz"))
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	506 tar.extractall('/tmp')
6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	507 tar.close()

Mercurial > kallithea

annotate rhodecode/lib/utils.py @ 639:45e1fdc0082c