genome_diversity: BeautifulSoup.py annotate

author	Richard Burhans <burhans@bx.psu.edu>
date	Fri, 20 Sep 2013 13:54:23 -0400
parents
children

rev	line source
32 03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	1 """Beautiful Soup
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	2 Elixir and Tonic
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	3 "The Screen-Scraper's Friend"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	4 http://www.crummy.com/software/BeautifulSoup/
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	5
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	6 Beautiful Soup parses a (possibly invalid) XML or HTML document into a
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	7 tree representation. It provides methods and Pythonic idioms that make
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	8 it easy to navigate, search, and modify the tree.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	9
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	10 A well-formed XML/HTML document yields a well-formed data
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	11 structure. An ill-formed XML/HTML document yields a correspondingly
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	12 ill-formed data structure. If your document is only locally
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	13 well-formed, you can use this library to find and process the
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	14 well-formed part of it.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	15
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	16 Beautiful Soup works with Python 2.2 and up. It has no external
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	17 dependencies, but you'll have more success at converting data to UTF-8
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	18 if you also install these three packages:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	19
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	20 * chardet, for auto-detecting character encodings
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	21 http://chardet.feedparser.org/
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	22 * cjkcodecs and iconv_codec, which add more encodings to the ones supported
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	23 by stock Python.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	24 http://cjkpython.i18n.org/
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	25
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	26 Beautiful Soup defines classes for two main parsing strategies:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	27
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	28 * BeautifulStoneSoup, for parsing XML, SGML, or your domain-specific
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	29 language that kind of looks like XML.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	30
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	31 * BeautifulSoup, for parsing run-of-the-mill HTML code, be it valid
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	32 or invalid. This class has web browser-like heuristics for
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	33 obtaining a sensible parse tree in the face of common HTML errors.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	34
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	35 Beautiful Soup also defines a class (UnicodeDammit) for autodetecting
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	36 the encoding of an HTML or XML document, and converting it to
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	37 Unicode. Much of this code is taken from Mark Pilgrim's Universal Feed Parser.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	38
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	39 For more than you ever wanted to know about Beautiful Soup, see the
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	40 documentation:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	41 http://www.crummy.com/software/BeautifulSoup/documentation.html
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	42
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	43 Here, have some legalese:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	44
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	45 Copyright (c) 2004-2010, Leonard Richardson
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	46
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	47 All rights reserved.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	48
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	49 Redistribution and use in source and binary forms, with or without
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	50 modification, are permitted provided that the following conditions are
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	51 met:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	52
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	53 * Redistributions of source code must retain the above copyright
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	54 notice, this list of conditions and the following disclaimer.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	55
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	56 * Redistributions in binary form must reproduce the above
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	57 copyright notice, this list of conditions and the following
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	58 disclaimer in the documentation and/or other materials provided
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	59 with the distribution.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	60
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	61 * Neither the name of the the Beautiful Soup Consortium and All
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	62 Night Kosher Bakery nor the names of its contributors may be
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	63 used to endorse or promote products derived from this software
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	64 without specific prior written permission.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	65
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	66 THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	67 "AS IS" AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	68 LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	69 A PARTICULAR PURPOSE ARE DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT OWNER OR
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	70 CONTRIBUTORS BE LIABLE FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	71 EXEMPLARY, OR CONSEQUENTIAL DAMAGES (INCLUDING, BUT NOT LIMITED TO,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	72 PROCUREMENT OF SUBSTITUTE GOODS OR SERVICES; LOSS OF USE, DATA, OR
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	73 PROFITS; OR BUSINESS INTERRUPTION) HOWEVER CAUSED AND ON ANY THEORY OF
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	74 LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY, OR TORT (INCLUDING
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	75 NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	76 SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE, DAMMIT.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	77
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	78 """
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	79 from __future__ import generators
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	80
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	81 __author__ = "Leonard Richardson (leonardr@segfault.org)"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	82 __version__ = "3.2.1"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	83 __copyright__ = "Copyright (c) 2004-2012 Leonard Richardson"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	84 __license__ = "New-style BSD"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	85
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	86 from sgmllib import SGMLParser, SGMLParseError
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	87 import codecs
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	88 import markupbase
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	89 import types
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	90 import re
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	91 import sgmllib
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	92 try:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	93 from htmlentitydefs import name2codepoint
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	94 except ImportError:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	95 name2codepoint = {}
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	96 try:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	97 set
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	98 except NameError:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	99 from sets import Set as set
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	100
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	101 #These hacks make Beautiful Soup able to parse XML with namespaces
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	102 sgmllib.tagfind = re.compile('[a-zA-Z][-_.:a-zA-Z0-9]*')
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	103 markupbase._declname_match = re.compile(r'[a-zA-Z][-_.:a-zA-Z0-9]\s').match
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	104
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	105 DEFAULT_OUTPUT_ENCODING = "utf-8"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	106
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	107 def _match_css_class(str):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	108 """Build a RE to match the given CSS class."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	109 return re.compile(r"(^\|.*\s)%s($\|\s)" % str)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	110
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	111 # First, the classes that represent markup elements.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	112
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	113 class PageElement(object):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	114 """Contains the navigational information for some part of the page
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	115 (either a tag or a piece of text)"""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	116
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	117 def _invert(h):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	118 "Cheap function to invert a hash."
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	119 i = {}
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	120 for k,v in h.items():
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	121 i[v] = k
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	122 return i
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	123
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	124 XML_ENTITIES_TO_SPECIAL_CHARS = { "apos" : "'",
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	125 "quot" : '"',
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	126 "amp" : "&",
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	127 "lt" : "<",
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	128 "gt" : ">" }
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	129
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	130 XML_SPECIAL_CHARS_TO_ENTITIES = _invert(XML_ENTITIES_TO_SPECIAL_CHARS)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	131
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	132 def setup(self, parent=None, previous=None):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	133 """Sets up the initial relations between this element and
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	134 other elements."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	135 self.parent = parent
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	136 self.previous = previous
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	137 self.next = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	138 self.previousSibling = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	139 self.nextSibling = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	140 if self.parent and self.parent.contents:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	141 self.previousSibling = self.parent.contents[-1]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	142 self.previousSibling.nextSibling = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	143
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	144 def replaceWith(self, replaceWith):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	145 oldParent = self.parent
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	146 myIndex = self.parent.index(self)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	147 if hasattr(replaceWith, "parent")\
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	148 and replaceWith.parent is self.parent:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	149 # We're replacing this element with one of its siblings.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	150 index = replaceWith.parent.index(replaceWith)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	151 if index and index < myIndex:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	152 # Furthermore, it comes before this element. That
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	153 # means that when we extract it, the index of this
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	154 # element will change.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	155 myIndex = myIndex - 1
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	156 self.extract()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	157 oldParent.insert(myIndex, replaceWith)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	158
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	159 def replaceWithChildren(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	160 myParent = self.parent
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	161 myIndex = self.parent.index(self)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	162 self.extract()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	163 reversedChildren = list(self.contents)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	164 reversedChildren.reverse()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	165 for child in reversedChildren:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	166 myParent.insert(myIndex, child)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	167
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	168 def extract(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	169 """Destructively rips this element out of the tree."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	170 if self.parent:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	171 try:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	172 del self.parent.contents[self.parent.index(self)]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	173 except ValueError:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	174 pass
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	175
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	176 #Find the two elements that would be next to each other if
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	177 #this element (and any children) hadn't been parsed. Connect
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	178 #the two.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	179 lastChild = self._lastRecursiveChild()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	180 nextElement = lastChild.next
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	181
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	182 if self.previous:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	183 self.previous.next = nextElement
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	184 if nextElement:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	185 nextElement.previous = self.previous
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	186 self.previous = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	187 lastChild.next = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	188
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	189 self.parent = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	190 if self.previousSibling:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	191 self.previousSibling.nextSibling = self.nextSibling
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	192 if self.nextSibling:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	193 self.nextSibling.previousSibling = self.previousSibling
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	194 self.previousSibling = self.nextSibling = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	195 return self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	196
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	197 def _lastRecursiveChild(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	198 "Finds the last element beneath this object to be parsed."
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	199 lastChild = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	200 while hasattr(lastChild, 'contents') and lastChild.contents:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	201 lastChild = lastChild.contents[-1]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	202 return lastChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	203
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	204 def insert(self, position, newChild):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	205 if isinstance(newChild, basestring) \
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	206 and not isinstance(newChild, NavigableString):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	207 newChild = NavigableString(newChild)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	208
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	209 position = min(position, len(self.contents))
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	210 if hasattr(newChild, 'parent') and newChild.parent is not None:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	211 # We're 'inserting' an element that's already one
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	212 # of this object's children.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	213 if newChild.parent is self:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	214 index = self.index(newChild)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	215 if index > position:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	216 # Furthermore we're moving it further down the
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	217 # list of this object's children. That means that
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	218 # when we extract this element, our target index
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	219 # will jump down one.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	220 position = position - 1
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	221 newChild.extract()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	222
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	223 newChild.parent = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	224 previousChild = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	225 if position == 0:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	226 newChild.previousSibling = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	227 newChild.previous = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	228 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	229 previousChild = self.contents[position-1]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	230 newChild.previousSibling = previousChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	231 newChild.previousSibling.nextSibling = newChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	232 newChild.previous = previousChild._lastRecursiveChild()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	233 if newChild.previous:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	234 newChild.previous.next = newChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	235
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	236 newChildsLastElement = newChild._lastRecursiveChild()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	237
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	238 if position >= len(self.contents):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	239 newChild.nextSibling = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	240
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	241 parent = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	242 parentsNextSibling = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	243 while not parentsNextSibling:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	244 parentsNextSibling = parent.nextSibling
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	245 parent = parent.parent
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	246 if not parent: # This is the last element in the document.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	247 break
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	248 if parentsNextSibling:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	249 newChildsLastElement.next = parentsNextSibling
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	250 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	251 newChildsLastElement.next = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	252 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	253 nextChild = self.contents[position]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	254 newChild.nextSibling = nextChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	255 if newChild.nextSibling:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	256 newChild.nextSibling.previousSibling = newChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	257 newChildsLastElement.next = nextChild
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	258
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	259 if newChildsLastElement.next:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	260 newChildsLastElement.next.previous = newChildsLastElement
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	261 self.contents.insert(position, newChild)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	262
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	263 def append(self, tag):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	264 """Appends the given tag to the contents of this tag."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	265 self.insert(len(self.contents), tag)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	266
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	267 def findNext(self, name=None, attrs={}, text=None, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	268 """Returns the first item that matches the given criteria and
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	269 appears after this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	270 return self._findOne(self.findAllNext, name, attrs, text, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	271
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	272 def findAllNext(self, name=None, attrs={}, text=None, limit=None,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	273 **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	274 """Returns all items that match the given criteria and appear
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	275 after this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	276 return self._findAll(name, attrs, text, limit, self.nextGenerator,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	277 **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	278
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	279 def findNextSibling(self, name=None, attrs={}, text=None, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	280 """Returns the closest sibling to this Tag that matches the
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	281 given criteria and appears after this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	282 return self._findOne(self.findNextSiblings, name, attrs, text,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	283 **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	284
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	285 def findNextSiblings(self, name=None, attrs={}, text=None, limit=None,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	286 **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	287 """Returns the siblings of this Tag that match the given
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	288 criteria and appear after this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	289 return self._findAll(name, attrs, text, limit,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	290 self.nextSiblingGenerator, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	291 fetchNextSiblings = findNextSiblings # Compatibility with pre-3.x
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	292
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	293 def findPrevious(self, name=None, attrs={}, text=None, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	294 """Returns the first item that matches the given criteria and
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	295 appears before this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	296 return self._findOne(self.findAllPrevious, name, attrs, text, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	297
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	298 def findAllPrevious(self, name=None, attrs={}, text=None, limit=None,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	299 **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	300 """Returns all items that match the given criteria and appear
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	301 before this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	302 return self._findAll(name, attrs, text, limit, self.previousGenerator,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	303 **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	304 fetchPrevious = findAllPrevious # Compatibility with pre-3.x
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	305
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	306 def findPreviousSibling(self, name=None, attrs={}, text=None, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	307 """Returns the closest sibling to this Tag that matches the
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	308 given criteria and appears before this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	309 return self._findOne(self.findPreviousSiblings, name, attrs, text,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	310 **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	311
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	312 def findPreviousSiblings(self, name=None, attrs={}, text=None,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	313 limit=None, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	314 """Returns the siblings of this Tag that match the given
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	315 criteria and appear before this Tag in the document."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	316 return self._findAll(name, attrs, text, limit,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	317 self.previousSiblingGenerator, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	318 fetchPreviousSiblings = findPreviousSiblings # Compatibility with pre-3.x
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	319
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	320 def findParent(self, name=None, attrs={}, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	321 """Returns the closest parent of this Tag that matches the given
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	322 criteria."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	323 # NOTE: We can't use _findOne because findParents takes a different
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	324 # set of arguments.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	325 r = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	326 l = self.findParents(name, attrs, 1)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	327 if l:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	328 r = l[0]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	329 return r
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	330
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	331 def findParents(self, name=None, attrs={}, limit=None, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	332 """Returns the parents of this Tag that match the given
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	333 criteria."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	334
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	335 return self._findAll(name, attrs, None, limit, self.parentGenerator,
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	336 **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	337 fetchParents = findParents # Compatibility with pre-3.x
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	338
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	339 #These methods do the real heavy lifting.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	340
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	341 def _findOne(self, method, name, attrs, text, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	342 r = None
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	343 l = method(name, attrs, text, 1, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	344 if l:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	345 r = l[0]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	346 return r
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	347
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	348 def _findAll(self, name, attrs, text, limit, generator, **kwargs):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	349 "Iterates over a generator looking for things that match."
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	350
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	351 if isinstance(name, SoupStrainer):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	352 strainer = name
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	353 # (Possibly) special case some findAll*(...) searches
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	354 elif text is None and not limit and not attrs and not kwargs:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	355 # findAll*(True)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	356 if name is True:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	357 return [element for element in generator()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	358 if isinstance(element, Tag)]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	359 # findAll*('tag-name')
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	360 elif isinstance(name, basestring):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	361 return [element for element in generator()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	362 if isinstance(element, Tag) and
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	363 element.name == name]
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	364 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	365 strainer = SoupStrainer(name, attrs, text, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	366 # Build a SoupStrainer
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	367 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	368 strainer = SoupStrainer(name, attrs, text, **kwargs)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	369 results = ResultSet(strainer)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	370 g = generator()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	371 while True:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	372 try:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	373 i = g.next()
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	374 except StopIteration:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	375 break
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	376 if i:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	377 found = strainer.search(i)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	378 if found:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	379 results.append(found)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	380 if limit and len(results) >= limit:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	381 break
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	382 return results
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	383
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	384 #These Generators can be used to navigate starting from both
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	385 #NavigableStrings and Tags.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	386 def nextGenerator(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	387 i = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	388 while i is not None:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	389 i = i.next
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	390 yield i
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	391
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	392 def nextSiblingGenerator(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	393 i = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	394 while i is not None:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	395 i = i.nextSibling
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	396 yield i
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	397
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	398 def previousGenerator(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	399 i = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	400 while i is not None:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	401 i = i.previous
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	402 yield i
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	403
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	404 def previousSiblingGenerator(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	405 i = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	406 while i is not None:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	407 i = i.previousSibling
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	408 yield i
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	409
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	410 def parentGenerator(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	411 i = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	412 while i is not None:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	413 i = i.parent
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	414 yield i
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	415
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	416 # Utility methods
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	417 def substituteEncoding(self, str, encoding=None):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	418 encoding = encoding or "utf-8"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	419 return str.replace("%SOUP-ENCODING%", encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	420
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	421 def toEncoding(self, s, encoding=None):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	422 """Encodes an object to a string in some encoding, or to Unicode.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	423 ."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	424 if isinstance(s, unicode):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	425 if encoding:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	426 s = s.encode(encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	427 elif isinstance(s, str):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	428 if encoding:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	429 s = s.encode(encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	430 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	431 s = unicode(s)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	432 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	433 if encoding:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	434 s = self.toEncoding(str(s), encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	435 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	436 s = unicode(s)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	437 return s
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	438
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	439 BARE_AMPERSAND_OR_BRACKET = re.compile("([<>]\|"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	440 + "&(?!#\d+;\|#x[0-9a-fA-F]+;\|\w+;)"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	441 + ")")
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	442
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	443 def _sub_entity(self, x):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	444 """Used with a regular expression to substitute the
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	445 appropriate XML entity for an XML special character."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	446 return "&" + self.XML_SPECIAL_CHARS_TO_ENTITIES[x.group(0)[0]] + ";"
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	447
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	448
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	449 class NavigableString(unicode, PageElement):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	450
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	451 def __new__(cls, value):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	452 """Create a new NavigableString.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	453
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	454 When unpickling a NavigableString, this method is called with
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	455 the string in DEFAULT_OUTPUT_ENCODING. That encoding needs to be
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	456 passed in to the superclass's __new__ or the superclass won't know
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	457 how to handle non-ASCII characters.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	458 """
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	459 if isinstance(value, unicode):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	460 return unicode.__new__(cls, value)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	461 return unicode.__new__(cls, value, DEFAULT_OUTPUT_ENCODING)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	462
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	463 def __getnewargs__(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	464 return (NavigableString.__str__(self),)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	465
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	466 def __getattr__(self, attr):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	467 """text.string gives you text. This is for backwards
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	468 compatibility for NavigableString, but for CData it lets you
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	469 get the string without the CData wrapper."""
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	470 if attr == 'string':
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	471 return self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	472 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	473 raise AttributeError, "'%s' object has no attribute '%s'" % (self.__class__.__name__, attr)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	474
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	475 def __unicode__(self):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	476 return str(self).decode(DEFAULT_OUTPUT_ENCODING)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	477
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	478 def __str__(self, encoding=DEFAULT_OUTPUT_ENCODING):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	479 # Substitute outgoing XML entities.
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	480 data = self.BARE_AMPERSAND_OR_BRACKET.sub(self._sub_entity, self)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	481 if encoding:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	482 return data.encode(encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	483 else:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	484 return data
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	485
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	486 class CData(NavigableString):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	487
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	488 def __str__(self, encoding=DEFAULT_OUTPUT_ENCODING):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	489 return "<![CDATA[%s]]>" % NavigableString.__str__(self, encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	490
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	491 class ProcessingInstruction(NavigableString):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	492 def __str__(self, encoding=DEFAULT_OUTPUT_ENCODING):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	493 output = self
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	494 if "%SOUP-ENCODING%" in output:
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	495 output = self.substituteEncoding(output, encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	496 return "<?%s?>" % self.toEncoding(output, encoding)
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	497
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	498 class Comment(NavigableString):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	499 def __str__(self, encoding=DEFAULT_OUTPUT_ENCODING):
03c22b722882 remove BeautifulSoup dependency Richard Burhans <burhans@bx.psu.edu> parents: diff changeset	500 return "<!--%s-->" % NavigableString.__str__(self, encoding)

32

03c22b722882 remove BeautifulSoup dependency