kallithea: rhodecode/lib/utils.py annotate

annotate rhodecode/lib/utils.py @ 783:71113f64b2d8 beta

fidex corrent variables passed to dnconfig, fixed celerylib import problem on tests

author	Marcin Kuzminski <marcin@python-works.com>
date	Sat, 27 Nov 2010 20:32:34 +0100
parents	876776983c3c
children	277427ac29a9

rev	line source
783 71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	1 # -- coding: utf-8 --
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	2 """
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	3 package.rhodecode.lib.utils
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	4 ~~~~~~~~~~~~~~
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	5
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	6 Utilities library for RhodeCode
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	7
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	8 :created_on: Apr 18, 2010
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	9 :author: marcink
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	10 :copyright: (C) 2009-2010 Marcin Kuzminski <marcin@python-works.com>
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	11 :license: GPLv3, see COPYING for more details.
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	12 """
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	13 # This program is free software; you can redistribute it and/or
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	14 # modify it under the terms of the GNU General Public License
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	15 # as published by the Free Software Foundation; version 2
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	16 # of the License or (at your opinion) any later version of the license.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	17 #
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	18 # This program is distributed in the hope that it will be useful,
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	19 # but WITHOUT ANY WARRANTY; without even the implied warranty of
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	20 # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	21 # GNU General Public License for more details.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	22 #
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	23 # You should have received a copy of the GNU General Public License
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	24 # along with this program; if not, write to the Free Software
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	25 # Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston,
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	26 # MA 02110-1301, USA.
783 71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	27
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	28 import os
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	29 import logging
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	30 import datetime
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	31 import traceback
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	32 import ConfigParser
633 fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	33
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	34 from UserDict import DictMixin
783 71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	35
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	36 from mercurial import ui, config, hg
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	37 from mercurial.error import RepoError
783 71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	38
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	39 from paste.script import command
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	40 from vcs.backends.base import BaseChangeset
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	41 from vcs.utils.lazy import LazyProperty
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	42
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	43 from rhodecode.model import meta
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	44 from rhodecode.model.caching_query import FromCache
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	45 from rhodecode.model.db import Repository, User, RhodeCodeUi, UserLog
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	46 from rhodecode.model.repo import RepoModel
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	47 from rhodecode.model.user import UserModel
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	48
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	49 log = logging.getLogger(__name__)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	50
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	51
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	52 def get_repo_slug(request):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	53 return request.environ['pylons.routes_dict'].get('repo_name')
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	54
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	55 def action_logger(user, action, repo, ipaddr='', sa=None):
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	56 """
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	57 Action logger for various actions made by users
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	58
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	59 :param user: user that made this action, can be a unique username string or
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	60 object containing user_id attribute
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	61 :param action: action to log, should be on of predefined unique actions for
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	62 easy translations
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	63 :param repo: string name of repository or object containing repo_id,
dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	64 that action was made on
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	65 :param ipaddr: optional ip address from what the action was made
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	66 :param sa: optional sqlalchemy session
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	67
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	68 """
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	69
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	70 if not sa:
629 7e536d1af60d Code refactoring,models renames Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	71 sa = meta.Session()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	72
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	73 try:
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	74 um = UserModel()
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	75 if hasattr(user, 'user_id'):
654 7f5976da192c #48 rewrite action loggers into hooks with all changesets that are inside a push Marcin Kuzminski <marcin@python-works.com> parents: 643 diff changeset	76 user_obj = user
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	77 elif isinstance(user, basestring):
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	78 user_obj = um.get_by_username(user, cache=False)
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	79 else:
48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	80 raise Exception('You have to provide user object or username')
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	81
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	82
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	83 rm = RepoModel()
dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	84 if hasattr(repo, 'repo_id'):
dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	85 repo_obj = rm.get(repo.repo_id, cache=False)
dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	86 repo_name = repo_obj.repo_name
dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	87 elif isinstance(repo, basestring):
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	88 repo_name = repo.lstrip('/')
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	89 repo_obj = rm.get_by_repo_name(repo_name, cache=False)
689 ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	90 else:
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	91 raise Exception('You have to provide repository to action logger')
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	92
ecc566f8b69f fixes #59, notifications for user registrations + some changes to mailer Marcin Kuzminski <marcin@python-works.com> parents: 688 diff changeset	93
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	94 user_log = UserLog()
654 7f5976da192c #48 rewrite action loggers into hooks with all changesets that are inside a push Marcin Kuzminski <marcin@python-works.com> parents: 643 diff changeset	95 user_log.user_id = user_obj.user_id
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	96 user_log.action = action
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	97
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	98 user_log.repository_id = repo_obj.repo_id
537 48be953851fc extended user logs to create/delete/fork repositories for auditing Marcin Kuzminski <marcin@python-works.com> parents: 536 diff changeset	99 user_log.repository_name = repo_name
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	100
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	101 user_log.action_date = datetime.datetime.now()
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	102 user_log.user_ip = ipaddr
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	103 sa.add(user_log)
39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	104 sa.commit()
621 9893c2fc846b removed raise from log user action Marcin Kuzminski <marcin@python-works.com> parents: 604 diff changeset	105
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	106 log.info('Adding user %s, action %s on %s', user_obj, action, repo)
654 7f5976da192c #48 rewrite action loggers into hooks with all changesets that are inside a push Marcin Kuzminski <marcin@python-works.com> parents: 643 diff changeset	107 except:
7f5976da192c #48 rewrite action loggers into hooks with all changesets that are inside a push Marcin Kuzminski <marcin@python-works.com> parents: 643 diff changeset	108 log.error(traceback.format_exc())
536 39203995f2c4 made action logger more global, to be used in other places to log other actions. Marcin Kuzminski <marcin@python-works.com> parents: 524 diff changeset	109 sa.rollback()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	110
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	111 def get_repos(path, recursive=False, initial=False):
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	112 """
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	113 Scans given path for repos and return (name,(type,path)) tuple
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	114 :param prefix:
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	115 :param path:
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	116 :param recursive:
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	117 :param initial:
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	118 """
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	119 from vcs.utils.helpers import get_scm
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	120 from vcs.exceptions import VCSError
633 fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	121
fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	122 try:
fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	123 scm = get_scm(path)
fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	124 except:
fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	125 pass
fcf599cd3404 Move changes for git implementation Marcin Kuzminski <marcin@python-works.com> parents: 631 diff changeset	126 else:
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	127 raise Exception('The given path %s should not be a repository got %s',
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	128 path, scm)
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	129
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	130 for dirpath in os.listdir(path):
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	131 try:
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	132 yield dirpath, get_scm(os.path.join(path, dirpath))
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	133 except VCSError:
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	134 pass
05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	135
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	136 def check_repo_fast(repo_name, base_path):
761 56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	137 """
56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	138 Check given path for existance of directory
56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	139 :param repo_name:
56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	140 :param base_path:
56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	141
56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	142 :return False: if this directory is present
56c2850a5b5f ldap auth rewrite, moved split authfunc into two functions, Marcin Kuzminski <marcin@python-works.com> parents: 756 diff changeset	143 """
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	144 if os.path.isdir(os.path.join(base_path, repo_name)):return False
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	145 return True
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	146
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	147 def check_repo(repo_name, base_path, verify=True):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	148
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	149 repo_path = os.path.join(base_path, repo_name)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	150
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	151 try:
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	152 if not check_repo_fast(repo_name, base_path):
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	153 return False
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	154 r = hg.repository(ui.ui(), repo_path)
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	155 if verify:
752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	156 hg.verify(r)
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	157 #here we hnow that repo exists it was verified
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	158 log.info('%s repo is already created', repo_name)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	159 return False
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	160 except RepoError:
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	161 #it means that there is no valid repo there...
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	162 log.info('%s repo is free for creation', repo_name)
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	163 return True
301 752675cdd167 made routes verification method based only on paths, since it's much faster and enough Marcin Kuzminski <marcin@python-works.com> parents: 297 diff changeset	164
351 d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	165 def ask_ok(prompt, retries=4, complaint='Yes or no, please!'):
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	166 while True:
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	167 ok = raw_input(prompt)
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	168 if ok in ('y', 'ye', 'yes'): return True
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	169 if ok in ('n', 'no', 'nop', 'nope'): return False
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	170 retries = retries - 1
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	171 if retries < 0: raise IOError
d09381593b12 updated db manage script, and remove broken test Marcin Kuzminski <marcin@python-works.com> parents: 350 diff changeset	172 print complaint
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	173
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	174 #propagated from mercurial documentation
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	175 ui_sections = ['alias', 'auth',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	176 'decode/encode', 'defaults',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	177 'diff', 'email',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	178 'extensions', 'format',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	179 'merge-patterns', 'merge-tools',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	180 'hooks', 'http_proxy',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	181 'smtp', 'patch',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	182 'paths', 'profiling',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	183 'server', 'trusted',
a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	184 'ui', 'web', ]
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	185
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	186 def make_ui(read_from='file', path=None, checkpaths=True):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	187 """
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	188 A function that will read python rc files or database
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	189 and make an mercurial ui object from read options
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	190
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	191 :param path: path to mercurial config file
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	192 :param checkpaths: check the path
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	193 :param read_from: read from 'file' or 'db'
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	194 """
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	195
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	196 baseui = ui.ui()
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	197
724 a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	198 #clean the baseui object
a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	199 baseui._ocfg = config.config()
a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	200 baseui._ucfg = config.config()
a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	201 baseui._tcfg = config.config()
a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	202
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	203 if read_from == 'file':
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	204 if not os.path.isfile(path):
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	205 log.warning('Unable to read config file %s' % path)
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	206 return False
388 3bcf9529d221 Added new application settings,Push ssl and repositories path Marcin Kuzminski <marcin@python-works.com> parents: 386 diff changeset	207 log.debug('reading hgrc from %s', path)
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	208 cfg = config.config()
1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	209 cfg.read(path)
386 a9a607a58b1c moved out ui_sections out of make ui function Marcin Kuzminski <marcin@python-works.com> parents: 381 diff changeset	210 for section in ui_sections:
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	211 for k, v in cfg.items(section):
724 a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	212 log.debug('settings ui from file[%s]%s:%s', section, k, v)
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	213 baseui.setconfig(section, k, v)
724 a9bc513a1fe3 fixed nasty bug with ui() Marcin Kuzminski <marcin@python-works.com> parents: 692 diff changeset	214
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	215
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	216 elif read_from == 'db':
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	217 sa = meta.Session()
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	218 ret = sa.query(RhodeCodeUi)\
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	219 .options(FromCache("sql_cache_short",
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	220 "get_hg_ui_settings")).all()
773 876776983c3c disabled dotencode format for mercurial 1.7 usage and hg <=1.6 compatibility Marcin Kuzminski <marcin@python-works.com> parents: 761 diff changeset	221
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	222 hg_ui = ret
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	223 for ui_ in hg_ui:
392 b27d32cb3157 Implemented hooks system, Marcin Kuzminski <marcin@python-works.com> parents: 388 diff changeset	224 if ui_.ui_active:
773 876776983c3c disabled dotencode format for mercurial 1.7 usage and hg <=1.6 compatibility Marcin Kuzminski <marcin@python-works.com> parents: 761 diff changeset	225 log.debug('settings ui from db[%s]%s:%s', ui_.ui_section,
876776983c3c disabled dotencode format for mercurial 1.7 usage and hg <=1.6 compatibility Marcin Kuzminski <marcin@python-works.com> parents: 761 diff changeset	226 ui_.ui_key, ui_.ui_value)
392 b27d32cb3157 Implemented hooks system, Marcin Kuzminski <marcin@python-works.com> parents: 388 diff changeset	227 baseui.setconfig(ui_.ui_section, ui_.ui_key, ui_.ui_value)
773 876776983c3c disabled dotencode format for mercurial 1.7 usage and hg <=1.6 compatibility Marcin Kuzminski <marcin@python-works.com> parents: 761 diff changeset	228
876776983c3c disabled dotencode format for mercurial 1.7 usage and hg <=1.6 compatibility Marcin Kuzminski <marcin@python-works.com> parents: 761 diff changeset	229 meta.Session.remove()
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	230 return baseui
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	231
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	232
548 b75b77ef649d renamed hg_app to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 547 diff changeset	233 def set_rhodecode_config(config):
756 01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	234 """
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	235 Updates pylons config with new settings from database
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	236 :param config:
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	237 """
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	238 from rhodecode.model.settings import SettingsModel
01be209b9828 project refactoring, cleaned up lib.utils from rarly used functions, and place them Marcin Kuzminski <marcin@python-works.com> parents: 735 diff changeset	239 hgsettings = SettingsModel().get_app_settings()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	240
381 55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	241 for k, v in hgsettings.items():
55377fdc1fc6 cleared global application settings. Marcin Kuzminski <marcin@python-works.com> parents: 367 diff changeset	242 config[k] = v
341 1ef52a70f3b7 Made config file free configuration based on database and capable of beeing manage via application settings + some code cleanups Marcin Kuzminski <marcin@python-works.com> parents: 301 diff changeset	243
692 cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	244 def invalidate_cache(cache_key, *args):
665 070f32743632 Moved out reposcan into hg Model. Marcin Kuzminski <marcin@python-works.com> parents: 659 diff changeset	245 """
070f32743632 Moved out reposcan into hg Model. Marcin Kuzminski <marcin@python-works.com> parents: 659 diff changeset	246 Puts cache invalidation task into db for
070f32743632 Moved out reposcan into hg Model. Marcin Kuzminski <marcin@python-works.com> parents: 659 diff changeset	247 further global cache invalidation
070f32743632 Moved out reposcan into hg Model. Marcin Kuzminski <marcin@python-works.com> parents: 659 diff changeset	248 """
692 cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	249 from rhodecode.model.scm import ScmModel
cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	250
cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	251 if cache_key.startswith('get_repo_cached_'):
cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	252 name = cache_key.split('get_repo_cached_')[-1]
cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	253 ScmModel().mark_for_invalidation(name)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	254
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	255 class EmptyChangeset(BaseChangeset):
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	256 """
643 9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	257 An dummy empty changeset. It's possible to pass hash when creating
9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	258 an EmptyChangeset
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	259 """
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	260
643 9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	261 def __init__(self, cs='0' * 40):
9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	262 self._empty_cs = cs
9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	263 self.revision = -1
9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	264 self.message = ''
9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	265 self.author = ''
9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	266 self.date = ''
636 ffd07396d315 Fixes for raw_id, needed for git Marcin Kuzminski <marcin@python-works.com> parents: 633 diff changeset	267
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	268 @LazyProperty
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	269 def raw_id(self):
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	270 """
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	271 Returns raw string identifying this changeset, useful for web
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	272 representation.
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	273 """
643 9dc1d92d82ed updated setup for all newest versions Marcin Kuzminski <marcin@python-works.com> parents: 636 diff changeset	274 return self._empty_cs
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	275
524 63212fea2471 a lot of fixes in templates, Marcin Kuzminski <marcin@python-works.com> parents: 520 diff changeset	276 @LazyProperty
520 eda96fb85ba7 dohh !! fixed EmptyCHangeset for new vcs Marcin Kuzminski <marcin@python-works.com> parents: 497 diff changeset	277 def short_id(self):
524 63212fea2471 a lot of fixes in templates, Marcin Kuzminski <marcin@python-works.com> parents: 520 diff changeset	278 return self.raw_id[:12]
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	279
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	280 def get_file_changeset(self, path):
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	281 return self
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	282
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	283 def get_file_content(self, path):
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	284 return u''
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	285
544 d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	286 def get_file_size(self, path):
d8778cde98f0 added limits to single file diffs Marcin Kuzminski <marcin@python-works.com> parents: 537 diff changeset	287 return 0
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	288
348 e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	289 def repo2db_mapper(initial_repo_list, remove_obsolete=False):
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	290 """
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	291 maps all found repositories into db
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	292 """
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	293
629 7e536d1af60d Code refactoring,models renames Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	294 sa = meta.Session()
692 cb0d9ce6ac5c #50 on point cache invalidation changes. Marcin Kuzminski <marcin@python-works.com> parents: 689 diff changeset	295 rm = RepoModel()
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	296 user = sa.query(User).filter(User.admin == True).first()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	297
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	298 for name, repo in initial_repo_list.items():
735 dbec976d9975 added action loggers to following repositories, Marcin Kuzminski <marcin@python-works.com> parents: 724 diff changeset	299 if not rm.get_by_repo_name(name, cache=False):
631 05528ad948c4 Hacking for git support,and new faster repo scan Marcin Kuzminski <marcin@python-works.com> parents: 629 diff changeset	300 log.info('repository %s not found creating default', name)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	301
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	302 form_data = {
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	303 'repo_name':name,
652 37dc1e8d84d8 changed repo type to use alias Marcin Kuzminski <marcin@python-works.com> parents: 643 diff changeset	304 'repo_type':repo.alias,
659 758f64f3fbda extended repo creation by repo type. fixed fork creation to maintain repo type. Marcin Kuzminski <marcin@python-works.com> parents: 656 diff changeset	305 'description':repo.description \
758f64f3fbda extended repo creation by repo type. fixed fork creation to maintain repo type. Marcin Kuzminski <marcin@python-works.com> parents: 656 diff changeset	306 if repo.description != 'unknown' else \
758f64f3fbda extended repo creation by repo type. fixed fork creation to maintain repo type. Marcin Kuzminski <marcin@python-works.com> parents: 656 diff changeset	307 '%s repository' % name,
297 a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	308 'private':False
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	309 }
a074dec6ee40 restored utils, wrongly deleted Marcin Kuzminski <marcin@python-works.com> parents: 295 diff changeset	310 rm.create(form_data, user, just_db=True)
348 e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	311
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	312 if remove_obsolete:
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	313 #remove from database those repositories that are not in the filesystem
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	314 for repo in sa.query(Repository).all():
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	315 if repo.repo_name not in initial_repo_list.keys():
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	316 sa.delete(repo)
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	317 sa.commit()
e8fc875467bd implemented manual repo rescann and remapping Marcin Kuzminski <marcin@python-works.com> parents: 345 diff changeset	318
358 23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	319 class OrderedDict(dict, DictMixin):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	320
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	321 def __init__(self, args, *kwds):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	322 if len(args) > 1:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	323 raise TypeError('expected at most 1 arguments, got %d' % len(args))
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	324 try:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	325 self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	326 except AttributeError:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	327 self.clear()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	328 self.update(args, *kwds)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	329
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	330 def clear(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	331 self.__end = end = []
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	332 end += [None, end, end] # sentinel node for doubly linked list
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	333 self.__map = {} # key --> [key, prev, next]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	334 dict.clear(self)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	335
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	336 def __setitem__(self, key, value):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	337 if key not in self:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	338 end = self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	339 curr = end[1]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	340 curr[2] = end[1] = self.__map[key] = [key, curr, end]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	341 dict.__setitem__(self, key, value)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	342
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	343 def __delitem__(self, key):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	344 dict.__delitem__(self, key)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	345 key, prev, next = self.__map.pop(key)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	346 prev[2] = next
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	347 next[1] = prev
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	348
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	349 def __iter__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	350 end = self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	351 curr = end[2]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	352 while curr is not end:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	353 yield curr[0]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	354 curr = curr[2]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	355
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	356 def __reversed__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	357 end = self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	358 curr = end[1]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	359 while curr is not end:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	360 yield curr[0]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	361 curr = curr[1]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	362
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	363 def popitem(self, last=True):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	364 if not self:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	365 raise KeyError('dictionary is empty')
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	366 if last:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	367 key = reversed(self).next()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	368 else:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	369 key = iter(self).next()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	370 value = self.pop(key)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	371 return key, value
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	372
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	373 def __reduce__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	374 items = [[k, self[k]] for k in self]
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	375 tmp = self.__map, self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	376 del self.__map, self.__end
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	377 inst_dict = vars(self).copy()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	378 self.__map, self.__end = tmp
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	379 if inst_dict:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	380 return (self.__class__, (items,), inst_dict)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	381 return self.__class__, (items,)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	382
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	383 def keys(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	384 return list(self)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	385
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	386 setdefault = DictMixin.setdefault
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	387 update = DictMixin.update
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	388 pop = DictMixin.pop
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	389 values = DictMixin.values
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	390 items = DictMixin.items
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	391 iterkeys = DictMixin.iterkeys
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	392 itervalues = DictMixin.itervalues
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	393 iteritems = DictMixin.iteritems
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	394
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	395 def __repr__(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	396 if not self:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	397 return '%s()' % (self.__class__.__name__,)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	398 return '%s(%r)' % (self.__class__.__name__, self.items())
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	399
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	400 def copy(self):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	401 return self.__class__(self)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	402
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	403 @classmethod
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	404 def fromkeys(cls, iterable, value=None):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	405 d = cls()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	406 for key in iterable:
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	407 d[key] = value
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	408 return d
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	409
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	410 def __eq__(self, other):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	411 if isinstance(other, OrderedDict):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	412 return len(self) == len(other) and self.items() == other.items()
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	413 return dict.__eq__(self, other)
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	414
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	415 def __ne__(self, other):
23e720be5f44 Added implementation of Ordered Dict. Marcin Kuzminski <marcin@python-works.com> parents: 351 diff changeset	416 return not self == other
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	417
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	418
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	419 #===============================================================================
629 7e536d1af60d Code refactoring,models renames Marcin Kuzminski <marcin@python-works.com> parents: 621 diff changeset	420 # TEST FUNCTIONS AND CREATORS
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	421 #===============================================================================
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	422 def create_test_index(repo_location, full_index):
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	423 """Makes default test index
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	424 :param repo_location:
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	425 :param full_index:
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	426 """
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	427 from rhodecode.lib.indexers.daemon import WhooshIndexingDaemon
1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	428 from rhodecode.lib.pidlock import DaemonLock, LockHeld
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	429 import shutil
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	430
688 8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	431 index_location = os.path.join(repo_location, 'index')
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	432 if os.path.exists(index_location):
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	433 shutil.rmtree(index_location)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	434
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	435 try:
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	436 l = DaemonLock()
688 8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	437 WhooshIndexingDaemon(index_location=index_location,
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	438 repo_location=repo_location)\
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	439 .run(full_index=full_index)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	440 l.release()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	441 except LockHeld:
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	442 pass
5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	443
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	444 def create_test_env(repos_test_path, config):
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	445 """Makes a fresh database and
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	446 install test repository into tmp dir
6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	447 """
547 1e757ac98988 renamed project to rhodecode Marcin Kuzminski <marcin@python-works.com> parents: 544 diff changeset	448 from rhodecode.lib.db_manage import DbManage
688 8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	449 from rhodecode.tests import HG_REPO, GIT_REPO, NEW_HG_REPO, NEW_GIT_REPO, \
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	450 HG_FORK, GIT_FORK, TESTS_TMP_PATH
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	451 import tarfile
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	452 import shutil
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	453 from os.path import dirname as dn, join as jn, abspath
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	454
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	455 log = logging.getLogger('TestEnvCreator')
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	456 # create logger
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	457 log.setLevel(logging.DEBUG)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	458 log.propagate = True
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	459 # create console handler and set level to debug
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	460 ch = logging.StreamHandler()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	461 ch.setLevel(logging.DEBUG)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	462
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	463 # create formatter
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	464 formatter = logging.Formatter("%(asctime)s - %(name)s - %(levelname)s - %(message)s")
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	465
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	466 # add formatter to ch
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	467 ch.setFormatter(formatter)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	468
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	469 # add ch to logger
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	470 log.addHandler(ch)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	471
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	472 #PART ONE create db
783 71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	473 dbconf = config['sqlalchemy.db1.url']
71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	474 log.debug('making test db %s', dbconf)
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	475
783 71113f64b2d8 fidex corrent variables passed to dnconfig, Marcin Kuzminski <marcin@python-works.com> parents: 773 diff changeset	476 dbmanage = DbManage(log_sql=True, dbconf=dbconf, root=config['here'],
552 2642f128ad46 removed egg info, update files for distutils build Marcin Kuzminski <marcin@python-works.com> parents: 549 diff changeset	477 tests=True)
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	478 dbmanage.create_tables(override=True)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	479 dbmanage.config_prompt(repos_test_path)
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	480 dbmanage.create_default_user()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	481 dbmanage.admin_prompt()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	482 dbmanage.create_permissions()
fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	483 dbmanage.populate_default_permissions()
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	484
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	485 #PART TWO make test repo
688 8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	486 log.debug('making test vcs repositories')
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	487
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	488 #remove old one from previos tests
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	489 for r in [HG_REPO, GIT_REPO, NEW_HG_REPO, NEW_GIT_REPO, HG_FORK, GIT_FORK]:
604 5cc96df705b9 fixed @repo into :repo for docs Marcin Kuzminski <marcin@python-works.com> parents: 569 diff changeset	490
688 8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	491 if os.path.isdir(jn(TESTS_TMP_PATH, r)):
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	492 log.debug('removing %s', r)
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	493 shutil.rmtree(jn(TESTS_TMP_PATH, r))
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	494
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	495 #CREATE DEFAULT HG REPOSITORY
491 fefffd6fd5f4 Added some more tests, rewrite testing schema, to autogenerate fresh db, new index. Marcin Kuzminski <marcin@python-works.com> parents: 489 diff changeset	496 cur_dir = dn(dn(abspath(__file__)))
688 8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	497 tar = tarfile.open(jn(cur_dir, 'tests', "vcs_test_hg.tar.gz"))
8acbfa837180 Tests rewrite for 1.2 added some globals configs to make tests easier. Marcin Kuzminski <marcin@python-works.com> parents: 684 diff changeset	498 tar.extractall(jn(TESTS_TMP_PATH, HG_REPO))
473 6b934c9607e7 Improved testing scenarios. Made test env creator Marcin Kuzminski <marcin@python-works.com> parents: 395 diff changeset	499 tar.close()
684 2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	500
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	501 class UpgradeDb(command.Command):
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	502 """Command used for paster to upgrade our database to newer version
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	503 """
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	504
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	505 max_args = 1
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	506 min_args = 1
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	507
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	508 usage = "CONFIG_FILE"
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	509 summary = "Upgrades current db to newer version given configuration file"
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	510 group_name = "RhodeCode"
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	511
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	512 parser = command.Command.standard_parser(verbose=True)
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	513
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	514 parser.add_option('--sql',
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	515 action='store_true',
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	516 dest='just_sql',
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	517 help="Prints upgrade sql for further investigation",
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	518 default=False)
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	519 def command(self):
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	520 config_name = self.args[0]
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	521 p = config_name.split('/')
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	522 root = '.' if len(p) == 1 else '/'.join(p[:-1])
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	523 config = ConfigParser.ConfigParser({'here':root})
2abb398cd9a7 upgrade-db command dummy Marcin Kuzminski <marcin@python-works.com> parents: 665 diff changeset	524 config.read(config_name)

Mercurial > kallithea

annotate rhodecode/lib/utils.py @ 783:71113f64b2d8 beta