http://localhost/ticket/316 <p> If you search for unescaped characters such as '`' (backtick) in the URL in Chrome then you get a 500 error. </p> <p> e.g. <a class="ext-link" href="http://www.ckan.net/package/search?q=fjdkf2B%C2%B4gfhgfkgf{gpk"><span class="icon">​</span>http://www.ckan.net/package/search?q=fjdkf2B%C2%B4gfhgfkgf{gpk</a> fjdkf2B´gfhgfkgf{gpk </p> <p> returns this exception: </p> <p> URL: <a class="ext-link" href="http://www.ckan.net/package/search?q=fjdkf%2B%C2%B4gfhgfkgf%7Bg%C2%B4pk&amp;search=Search+Packages+%C2%BB"><span class="icon">​</span>http://www.ckan.net/package/search?q=fjdkf%2B%C2%B4gfhgfkgf%7Bg%C2%B4pk&amp;search=Search+Packages+%C2%BB</a> Module weberror.errormiddleware:162 in <span class="underline">call</span> &lt;&lt; <span class="underline">traceback_supplement</span> = Supplement, self, environ </p> <blockquote> <p> sr_checker = <a class="missing wiki">ResponseStartChecker?</a>(start_response) app_iter = self.application(environ, sr_checker) return self.make_catching_iter(app_iter, environ, sr_checker) </p> </blockquote> <blockquote> <p> except: </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> app_iter = self.application(environ, sr_checker) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module repoze.who.middleware:107 in <span class="underline">call</span> &lt;&lt; wrapper = <a class="missing wiki">StartResponseWrapper?</a>(start_response) </p> <blockquote> <p> app_iter = app(environ, wrapper.wrap_start_response) </p> </blockquote> <p> </p> <blockquote> <p> # The challenge decider almost(?) always needs information from the </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> app_iter = app(environ, wrapper.wrap_start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module beaker.middleware:73 in <span class="underline">call</span> &lt;&lt; self.cache_manager) </p> <blockquote> <p> environ[self.environ_key] = self.cache_manager return self.app(environ, start_response) </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self.app(environ, start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module beaker.middleware:152 in <span class="underline">call</span> &lt;&lt; headers.append(('Set-cookie', cookie)) </p> <blockquote> <p> return start_response(status, headers, exc_info) </p> </blockquote> <blockquote> <p> return self.wrap_app(environ, session_start_response) </p> </blockquote> <p> </p> <blockquote> <p> def _get_session(self): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self.wrap_app(environ, session_start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module routes.middleware:130 in <span class="underline">call</span> &lt;&lt; environ<a class="missing wiki">SCRIPT_NAME?</a> = environ<a class="missing wiki">SCRIPT_NAME?</a>[:-1] </p> <blockquote> <p> response = self.app(environ, start_response) </p> </blockquote> <p> </p> <blockquote> <p> # Wrapped in try as in rare cases the attribute will be gone already </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> response = self.app(environ, start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module pylons.wsgiapp:125 in <span class="underline">call</span> &lt;&lt; </p> <blockquote> <p> controller = self.resolve(environ, start_response) response = self.dispatch(controller, environ, start_response) </p> </blockquote> <p> </p> <blockquote> <p> if 'paste.testing_variables' in environ and hasattr(response, </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> response = self.dispatch(controller, environ, start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module pylons.wsgiapp:324 in dispatch &lt;&lt; if log_debug: </p> <blockquote> <p> log.debug("Calling controller class with WSGI interface") </p> </blockquote> <blockquote> <p> return controller(environ, start_response) </p> </blockquote> <p> </p> <blockquote> <p> def load_test_env(self, environ): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return controller(environ, start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module ckan.lib.base:50 in <span class="underline">call</span> &lt;&lt; # available in environ<a class="missing wiki">pylons.routes_dict?</a> </p> <blockquote> <p> try: </p> <blockquote> <p> return WSGIController.<span class="underline">call</span>(self, environ, start_response) </p> </blockquote> <p> finally: </p> <blockquote> <p> model.Session.remove() </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return WSGIController.<span class="underline">call</span>(self, environ, start_response) </p> </blockquote> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module pylons.controllers.core:221 in <span class="underline">call</span> &lt;&lt; return response(environ, self.start_response) </p> <blockquote> <p> response = self._dispatch_call() if not start_response_called: </p> <blockquote> <p> self.start_response = start_response </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> response = self._dispatch_call() </p> </blockquote> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module pylons.controllers.core:172 in _dispatch_call &lt;&lt; req.environ<a class="missing wiki">pylons.action_method?</a> = func </p> <blockquote> <p> response = self._inspect_call(func) </p> </blockquote> <blockquote> <p> else: </p> <blockquote> <p> if log_debug: </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> response = self._inspect_call(func) </p> </blockquote> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module pylons.controllers.core:107 in _inspect_call &lt;&lt; func.<span class="underline">name</span>, args) </p> <blockquote> <p> try: </p> <blockquote> <p> result = self._perform_call(func, args) </p> </blockquote> <p> except HTTPException, httpe: </p> <blockquote> <p> if log_debug: </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> result = self._perform_call(func, args) </p> </blockquote> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module pylons.controllers.core:60 in _perform_call &lt;&lt; """Hide the traceback for everything above this method""" </p> <blockquote> <p> <span class="underline">traceback_hide</span> = 'before_and_this' return func(<strong>args) </strong></p> </blockquote> <p> </p> <blockquote> <p> def _inspect_call(self, func): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return func(<strong>args) </strong></p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module ckan.controllers.package:52 in search &lt;&lt; collection=query, </p> <blockquote> <p> page=request.params.get('page', 1), items_per_page=50 </p> </blockquote> <blockquote> <p> ) # filter out ranks from the query result </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> items_per_page=50 </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module webhelpers.paginate:333 in <span class="underline">init</span> &lt;&lt; self.item_count = item_count </p> <blockquote> <p> else: </p> <blockquote> <p> self.item_count = len(self.collection) </p> </blockquote> </blockquote> <p> </p> <blockquote> <p> # Compute the number of the first and last available page </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> self.item_count = len(self.collection) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module webhelpers.paginate:204 in <span class="underline">len</span> &lt;&lt; def <span class="underline">len</span>(self): </p> <blockquote> <p> return self.obj.count() </p> </blockquote> <p> </p> <blockquote> <p> # Since the items on a page are mainly a list we subclass the "list" type </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self.obj.count() </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.orm.query:1094 in count &lt;&lt; q = q.params(params) </p> <blockquote> <p> q = q._legacy_select_kwargs(<strong>kwargs) return q._count() </strong></p> </blockquote> <p> </p> <blockquote> <p> def _count(self): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return q._count() </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.orm.query:1103 in _count &lt;&lt; """ </p> <blockquote> <p> return self._col_aggregate(sql.literal_column('1'), sql.func.count, nested_cols=list(self.mapper.primary_key)) </p> </blockquote> <p> </p> <blockquote> <p> def _col_aggregate(self, col, func, nested_cols=None): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self._col_aggregate(sql.literal_column('1'), sql.func.count, nested_cols=list(self.mapper.primary_key)) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.orm.query:1125 in _col_aggregate &lt;&lt; if self._autoflush and not self._populate_existing: </p> <blockquote> <p> self.session._autoflush() </p> </blockquote> <blockquote> <p> return self.session.scalar(s, params=self._params, mapper=self.mapper) </p> </blockquote> <p> </p> <blockquote> <p> def compile(self): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self.session.scalar(s, params=self._params, mapper=self.mapper) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.orm.session:635 in scalar &lt;&lt; engine = self.get_bind(mapper, clause=clause, instance=instance) </p> <blockquote> <p> return self.<span class="underline">connection(engine, close_with_result=True).scalar(clause, params or {}) </span></p> </blockquote> <p> </p> <blockquote> <p> def close(self): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self.<span class="underline">connection(engine, close_with_result=True).scalar(clause, params or {}) </span></p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.engine.base:834 in scalar &lt;&lt; """ </p> <blockquote> <p> return self.execute(object, *multiparams, <strong>params).scalar() </strong></p> </blockquote> <p> </p> <blockquote> <p> def statement_compiler(self, statement, <strong>kwargs): </strong></p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self.execute(object, *multiparams, <strong>params).scalar() </strong></p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.engine.base:844 in execute &lt;&lt; for c in type(object).<span class="underline">mro</span>: </p> <blockquote> <p> if c in Connection.executors: </p> <blockquote> <p> return Connection.executors[c](self, object, multiparams, params) </p> </blockquote> </blockquote> <blockquote> <p> else: </p> <blockquote> <p> raise exceptions.<a class="missing wiki">InvalidRequestError?</a>("Unexecutable object type: " + str(type(object))) </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return Connection.executors[c](self, object, multiparams, params) </p> </blockquote> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.engine.base:895 in execute_clauseelement &lt;&lt; else: </p> <blockquote> <p> keys = None </p> </blockquote> <blockquote> <p> return self._execute_compiled(elem.compile(dialect=self.dialect, column_keys=keys, inline=len(params) &gt; 1), distilled_params=params) </p> </blockquote> <p> </p> <blockquote> <p> def _execute_compiled(self, compiled, multiparams=None, params=None, distilled_params=None): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> return self._execute_compiled(elem.compile(dialect=self.dialect, column_keys=keys, inline=len(params) &gt; 1), distilled_params=params) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.engine.base:907 in _execute_compiled &lt;&lt; context.pre_execution() </p> <blockquote> <p> self.<span class="underline">execute_raw(context) context.post_execution() self._autocommit(context) </span></p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> self.<span class="underline">execute_raw(context) </span></p> </blockquote> </blockquote> </blockquote> </span></blockquote> <p> Module sqlalchemy.engine.base:916 in <span class="underline">execute_raw &lt;&lt; self._cursor_executemany(context.cursor, context.statement, context.parameters, context=context) </p> <blockquote> <p> else: </p> <blockquote> <p> self._cursor_execute(context.cursor, context.statement, context.parameters<a class="missing changeset" title="No default repository defined">[0]</a>, context=context) </p> </blockquote> </blockquote> <p> </p> <blockquote> <p> def _execute_ddl(self, ddl, params, multiparams): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> self._cursor_execute(context.cursor, context.statement, context.parameters<a class="missing changeset" title="No default repository defined">[0]</a>, context=context) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.engine.base:958 in _cursor_execute &lt;&lt; self.engine.logger.info(repr(parameters)) </p> <blockquote> <p> try: </p> <blockquote> <p> self.dialect.do_execute(cursor, statement, parameters, context=context) </p> </blockquote> <p> except Exception, e: </p> <blockquote> <p> self._handle_dbapi_exception(e, statement, parameters, cursor) </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> self.dialect.do_execute(cursor, statement, parameters, context=context) </p> </blockquote> </blockquote> </blockquote> </blockquote> </blockquote> <p> Module sqlalchemy.engine.default:133 in do_execute &lt;&lt; def do_execute(self, cursor, statement, parameters, context=None): </p> <blockquote> <p> cursor.execute(statement, parameters) </p> </blockquote> <p> </p> <blockquote> <p> def is_disconnect(self, e): </p> <blockquote class="citation"> <blockquote class="citation"> <blockquote> <p> cursor.execute(statement, parameters) </p> </blockquote> </blockquote> </blockquote> </blockquote> <p> <a class="missing wiki">UnicodeEncodeError?</a>: 'ascii' codec can't encode character u'\xb4' in position 6: ordinal not in range(128) </p> en-us http://assets.okfn.org/p/ckan/img/ckan_logo_shortname.png http://localhost/ticket/316 Trac 0.12.3 dread Wed, 19 May 2010 10:45:59 GMT http://localhost/ticket/316#comment:1 http://localhost/ticket/316#comment:1 <ul> <li><strong>summary</strong> changed from <em>Search URL encoding issue</em> to <em>Search URL escaping</em> </li> </ul> Ticket dread Thu, 20 May 2010 14:46:41 GMT http://localhost/ticket/316#comment:2 http://localhost/ticket/316#comment:2 <ul> <li><strong>description</strong> modified (<a href="/ticket/316?action=diff&amp;version=2">diff</a>) </li> </ul> <p> This exception occurs for ckan.net with just this one character: <a class="ext-link" href="http://ckan.net/package/search?q=%C2"><span class="icon">​</span>http://ckan.net/package/search?q=%C2</a> (you can wget it) </p> <p> But I can't recreate it on my machine. Maybe it's a version issue. </p> <p> The client that is making all these crazy calls is googlebot. </p> Ticket thejimmyg Wed, 08 Dec 2010 17:59:37 GMT http://localhost/ticket/316#comment:3 http://localhost/ticket/316#comment:3 <ul> <li><strong>status</strong> changed from <em>new</em> to <em>closed</em> </li> <li><strong>resolution</strong> set to <em>fixed</em> </li> </ul> <p> I've just tested this on ckan.net and it gives a sensible message: </p> <blockquote> <p> There was an error while searching. Please try another search term. </p> </blockquote> Ticket