i͟rdZddlZddlZddlZddlZddlZejdkrddZnddZ[GddeZ Gd d e Z Gd d e Z Gd de Z Gdde Z GddeZGddeZGddZGddeZGddeZdS)a :mod:`~gridData.OpenDX` --- routines to read and write simple OpenDX files ========================================================================== The OpenDX format for multi-dimensional grid data. OpenDX is a free visualization software, see http://www.opendx.org. .. Note:: This module only implements a primitive subset, sufficient to represent n-dimensional regular grids. The OpenDX scalar file format is specified in Appendix `B.2 Data Explorer Native Files`_ [#OpenDXformat]_. If you want to build a dx object from your data you can either use the convenient :class:`~gridData.core.Grid` class from the top level module (:class:`gridData.Grid`) or see the lower-level methods described below. .. _opendx-read-write: Reading and writing OpenDX files -------------------------------- If you have OpenDX files from other software and you just want to **read** it into a Python array then you do not really need to use the interface in :mod:`gridData.OpenDX`: just use :class:`~gridData.core.Grid` and load the file:: from gridData import Grid g = Grid("data.dx") This should work for files produced by common visualization programs (VMD_, PyMOL_, Chimera_). The documentation for :mod:`gridData` tells you more about what to do with the :class:`~gridData.core.Grid` object. If you want to **write** an OpenDX file then you just use the :meth:`gridData.core.Grid.export` method with `file_format="dx"` (or just use a filename with extension ".dx"):: g.export("data.dx") However, some visualization programs do not implement full OpenDX specifications and only read very specific, "OpenDX-like" files. :mod:`gridData.OpenDX` tries to be compatible with these formats. However, sometimes additional help is needed to write an OpenDX file that can be read by a specific software, as described below: Known issues for writing OpenDX files ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ * APBS require the delta to be written to the seventh significant figure. The delta is now written to reflect this increase in precision. .. versionchanged:: 0.6.0 * PyMOL_ requires OpenDX files with the type specification "double" in the `class array` section (see issue `#35`_). By default (since release 0.4.0), the type is set to the one that most closely approximates the dtype of the numpy array :attr:`Grid.grid`, which holds all data. This is often :class:`numpy.float64`, which will create an OpenDX type "double", which PyMOL will read. However, if you want to *force* a specific OpenDX type (such as "float" or "double", see :attr:`gridData.OpenDX.array.dx_types` for available values) then you can use the ``type`` keyword argument:: g.export("for_pymol.dx", type="double") If you always want to be able to read OpenDX files with PyMOL, it is suggested to always export with ``type="double"``. .. versionadded:: 0.4.0 .. _VMD: http://www.ks.uiuc.edu/Research/vmd/ .. _PyMOL: http://www.pymol.org/ .. _Chimera: https://www.cgl.ucsf.edu/chimera/ .. _`#35`: https://github.com/MDAnalysis/GridDataFormats/issues/35 Building a dx object from a numpy array ``A`` --------------------------------------------- If you have a numpy array ``A`` that represents a density in cartesian space then you can construct a dx object (named a *field* in OpenDX parlance) if you provide some additional information that fixes the coordinate system in space and defines the units along the axes. The following data are required: grid numpy nD array (typically a nD histogram) grid.shape the shape of the array origin the cartesian coordinates of the center of the (0,0,..,0) grid cell delta :math:`n \times n` array with the length of a grid cell along each axis; for regular rectangular grids the off-diagonal elements are 0 and the diagonal ones correspond to the 'bin width' of the histogram, eg ``delta[0,0] = 1.0`` (Angstrom) The DX data type ("type" in the DX file) is determined from the :class:`numpy.dtype` of the :class:`numpy.ndarray` that is provided as the *grid* (or with the *type* keyword argument to :class:`gridData.OpenDX.array`). For example, to build a :class:`field`:: dx = OpenDX.field('density') dx.add('positions', OpenDX.gridpositions(1, grid.shape, origin, delta)) dx.add('connections', OpenDX.gridconnections(2, grid.shape)) dx.add('data', OpenDX.array(3, grid)) or all with the constructor:: dx = OpenDX.field('density', components=dict( positions=OpenDX.gridpositions(1,grid.shape, d.origin, d.delta), connections=OpenDX.gridconnections(2, grid.shape), data=OpenDX.array(3, grid))) Building a dx object from a dx file ----------------------------------- One can also read data from an existing dx file:: dx = OpenDX.field(0) dx.read('file.dx') Only simple arrays are read and initially stored as a 1-d :class:`numpy.ndarray` in the `dx.components['data'].array` with the :class:`numpy.dtype` determined by the DX type in the file. The dx :class:`field` object has a method :meth:`~OpenDX.field.histogramdd` that produces output identical to the :func:`numpy.histogramdd` function by taking the stored dimension and deltas into account. In this way, one can store nD histograms in a portable and universal manner:: histogram, edges = dx.histogramdd() .. rubric:; Footnotes .. [#OpenDXformat] The original link to the OpenDX file format specs http://opendx.sdsc.edu/docs/html/pages/usrgu068.htm#HDREDF is dead so I am linking to an archived copy at the Internet Archive , `B.2 Data Explorer Native Files`_. .. _`B.2 Data Explorer Native Files`: https://web.archive.org/web/20080808140524/http://opendx.sdsc.edu/docs/html/pages/usrgu068.htm .. http://opendx.sdsc.edu/docs/html/pages/usrgu068.htm#HDREDF Classes ------- DX field class ~~~~~~~~~~~~~~ The primary class is :class:`field`, which is a container for the other classes. It contains the following classes: * :class:`gridpositions` * :class:`gridconnections` * :class:`array` The :class:`gridpositions` class contains the position of the grid cells. The :class:`gridconnections` class contains the connections between the grid cells. The :class:`array` class contains the data on the grid. .. autoclass:: field :members: DX components ~~~~~~~~~~~~~ The :class:`field` class contains the following components: .. autoclass:: gridpositions :members: .. autoclass:: gridconnections :members: .. autoclass:: array :members: DX parser ~~~~~~~~~~ The :class:`DXParser` class is used to parse the DX file and construct the :class:`field` object. .. autoclass:: DXParser :members: N)rtc,tj||SNgzipopenfilenamemodes Y/srv/www/vhosts/g4struct/public_html/venv/lib/python3.11/site-packages/gridData/OpenDX.py _gzip_openrsy4(((c*tj|Srrr s r rrsy"""rcJeZdZdZdZd dZed dZdZdZ d Z d S) DXclassz#'class' object as defined by OpenDXc>||_d|_d|_d|_dS)zid is the object numberN)idname componentD)selfclassids r __init__zDXclass.__init__s" rFct|j}|rd|zdz}d|zdzt|jzdz|zdz}|||dS)z=write the 'object' line; additional args are packed in string"zobject z class   N)strrr _write_line)rstream optstringquoterto_writes r writez DXclass.writesjdg,, +CKO'W$Y.s49~~=cA)KDP *****rct|tjr|}||dS)zwrite a line to the fileN) isinstancerGzipFileencoder&)r"liner$s r r!zDXclass._write_lines= fdm , , !;;==D Trc td)Nz#Reading is currently not supported.)NotImplementedError)rr"s r readz DXclass.reads!"GHHHrc0|t|jzS)zbReturns a string with as many repetitions of s as self has dimensions (derived from shape))lenshape)rss r ndformatzDXclass.ndformats3tz??""rcfdt|jzdzt|jzdzS)Nz)r rrrs r __repr__zDXclass.__repr__s,#di..(7DG DSHHrN)rF) __name__ __module__ __qualname____doc__rr& staticmethodr!r.r3r7rr rrs--++++\ III### IIIIIrrc0eZdZdZddZfdZdZxZS) gridpositionszOpenDX gridpositions class. shape D-tuplet describing size in each dimension origin coordinates of the centre of the grid cell with index 0,0,...,0 delta DxD array describing the deltas Nc |||td||_d|_d|_t j||_t j||_t|j|_ t j||_ t|j jdkrt j ||_ |j j|j |j fkr'td |j dS)N"all keyword arguments are requiredr? positionsz1Only regularly spaced grids allowed, not delta={}) ValueErrorrrrnumpyasarrayr1originr0rankdeltadiagr-format)rrr1rGrIkwargss r rzgridpositions.__init__ s =FNemABB B# $]5)) mF++  OO ]5))  tz A % %E**DJ :  495 5 5&'55;VDJ5G5GII I 6 5rc tt||d|dzt |jz||dt |jz|jD]9}||d|dj |zdz:dS)Ncounts  %dzorigin %f %f %f zdelta z {:.7g}r) superr?r&r3tupler1r!rGrIrK)rr"rI __class__s r r&zgridpositions.write s mT""(( Yt}}U333uTZ7H7HH J J J !4uT[7I7I!IJJJZ  E   8y118%@A      rcDfdtjDS)z}Edges of the grid cells, origin at centre of 0,0,..,0 grid cell. Only works for regular, orthonormal grids. cg|]U}j||ftjj|dzzj|zdj||fzz VS)rCg?)rIrEaranger1rG).0drs r z'gridpositions.edges../stEEE./ 1Q3%,tz!}Q"?"??$+a.Pdj1o%&EEEr)rangerHr6s`r edgeszgridpositions.edges*s@ EEEE383C3CEEE Er)NNN)r8r9r:r;rr&rZ __classcell__rRs@r r?r?sp IIII*     EEEEEEErr?c*eZdZdZddZfdZxZS)gridconnectionszOpenDX gridconnections classNc |td||_d|_d|_t j||_dS)NrAr^ connections)rDrrrrErFr1)rrr1rLs r rzgridconnections.__init__5s@ =ABB B% &]5)) rctt||d|dzt |jzdS)NrNrO)rPr^r&r3rQr1)rr"rRs r r&zgridconnections.write=sY ot$$** Yt}}U333uTZ7H7HH J J J J Jrr)r8r9r:r;rr&r[r\s@r r^r^3s[&&****JJJJJJJJJrr^c beZdZdZdddddddddd dd Zd d d d dddddddd ZddZfdZxZS)arrayzOpenDX array class. See `Array Objects`_ for details. .. _Array Objects: https://web.archive.org/web/20080808140524/http://opendx.sdsc.edu/docs/html/pages/usrgu068.htm#Header_440 byte signed byteunsigned shortshort unsigned intintfloatdouble) uint8int8uint16int16uint32int32uint64int64float32float64float16rlrmrnrorprqrtru) rdz unsigned bytererfrgz signed shortrhriz signed intrjrkNrc |td||_d|_d|_|t j||_ |j|jjj|_ n#t$rOtj d |jjj|jjj|_ YnwxYw t j||j||_nU#t$rHtd |t|jwxYw||_ ||_dS)av Parameters ---------- classid : int array : array_like type : str (optional) Set the DX type in the output file and cast `array` to the closest numpy dtype. `type` must be one of the allowed types in DX files as defined under `Array Objects`_. The default ``None`` tries to set the type from the :class:`numpy.dtype` of `array`. .. versionadded:: 0.4.0 Raises ------ ValueError if `array` is not provided; or if `type` is not of the correct DX type Nz"array keyword argument is requiredrcdatazarray dtype.name = {0} can not be automatically converted to a DX array type. Use the 'type' keyword to manually specify the correct type.)dtypezWDX type {0} cannot be converted to an appropriate numpy dtype. Available types are: {1})rDrrrrErFrcnp_typesrytypeKeyErrorwarningswarnrKdx_typeslistvalues typequote)rrrcr{rrLs r rzarray.__init__psd, =ABB B  <u--DJ 2 M$**:*?@  2 2 2  GHN#':#3#8I:I:;;;!J,1  2 Z"]5 d8KLLL  Z Z Z #3396$:>t}?S?S?U?U:V:V4X4XZZZ Z DI"s !A%%AB>=B>&C))AD;c |j|jvrLtd|jt |j|j|jz|jz}tt| |d||jj d}|jj j dks|jj j dkr>tj|jj j}dd|zdz}d}|jj} t#|D];}|||t'|d z<||d n&#t($r||d YnwxYw||d d S)zWrite the *class array* section. Parameters ---------- stream : stream Raises ------ ValueError If the `dxtype` is not a valid type, :exc:`ValueError` is raised. zlDX type {} is not supported in the DX format. Supported valus are: {} Use the type= keyword argument.z&type {0} rank 0 items {1} data followsz{:d}fcz{:.zf}rrC rz#attribute "dep" string "positions" N)r{rrDrKrkeysrrPrcr&sizerykindrEfinfo precisionflatrYr!next StopIteration) rr" typelabel fmt_stringrvalues_per_linerirRs r r&z array.writes 9DM ) )FGMv"&)T$-2D2D2F2F-G-GHIHIJJ J^DI-dn<  eT  )Q)X)X tz*(*( ) ) )  J  !S ( (DJ,<,AS,H,H DJ$455?Iv}}Y777->tF||-L-Lt-STTTT  ....      ...    !GHHHHHs4A!F F98F9)NNr) r8r9r:r;rzrrr&r[r\s@r rcrcBs"  H( " H /#/#/#/#b(I(I(I(I(I(I(I(I(Irrcc`eZdZdZddZdZfdZdZdZd Z d Z d Z d Z d Z dZxZS)fieldzOpenDX container class The *field* is the top-level object and represents the whole OpenDX file. It contains a number of other objects. Instantiate a DX object from this class and add subclasses with :meth:`add`. 0Nc|tddd}|ddg}n&t|turt|g}||_d|_d|_||_||_dS)a,OpenDX object, which is build from a list of components. Parameters ---------- id : str arbitrary string components : dict dictionary of DXclass instances (no sanity check on the individual ids!) which correspond to * positions * connections * data comments : list list of strings; each string becomes a comment line prefixed with '#'. Avoid newlines. A field must have at least the components 'positions', 'connections', and 'data'. Those components are associated with objects belonging to the field. When writing a dx file from the field, only the required objects are dumped to the file. (For a more general class that can use field: Because there could be more objects than components, we keep a separate object list. When dumping the dx file, first all objects are written and then the field object describes its components. Objects are referenced by their unique id.) .. Note:: uniqueness of the *id* is not checked. Example ------- Create a new dx object:: dx = OpenDX.field('density',[gridpoints,gridconnections,array]) N)rBr`rxz!OpenDX written by gridData.OpenDXz2from https://github.com/MDAnalysis/GridDataFormatsr) dictr{rr rrr componentscomments)rrrrs r rzfield.__init__szT  4HHHJ  ;LNHH (^^4 ' 'H H $ rcv|drtj|dSt|dS)z/Returns a regular or gz file stream for writing.gzwbw)endswithrr rr s r _openfile_writingzfield._openfile_writings:   U # # '9Xt,, ,#&& &rc Bd}|t|5}|jD]5}dt|z}|||d|dz6|D]\}}||t t||d|D]4\}}||d|dt|jd5 ddddS#1swxYwYdS) a8Write the complete dx object to the file. This is the simple OpenDX format which includes the data into the header via the 'object array ... data follows' statement. Only simple regular arrays are supported. The format should be compatible with VMD's dx reader plugin. Pz# NrT)r$z component "z" value ) rr rr!sorted_componentsr&rPrr) rr maxcoloutfiler+commentrobjectrRs r r&z field.writes  # #CMM 2 2 0g  A As4yy.  ''6'*:4*?@@@@%)%;%;%=%= & &! 6 W%%%% %   $ $WD $ 9 9 9%)%;%;%=%= 0 0! 6  IIs69~~~~+/0000 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0sC DDDcR|}t|}||dS)zRead DX field from file. dx = OpenDX.field.read(dxfile) The classid is discarded and replaced with the one from the file. N)DXParserparse)rr"DXfieldps r r.z field.read.s. V   rc|||<dS)zadd a component to the fieldNr=)rrDXobjs r addz field.add9sYrc:|j|dS)z add commentsN)rappend)rrs r add_commentzfield.add_comment=s W%%%%%rc#tKt|jdD] \}}||fV dS)z4iterator that returns (component,object) in id orderc|djS)NrC)r)comp_objs r z)field.sorted_components..Es HQKNr)keyN)sortedritems)rrrs r rzfield.sorted_componentsAsat,,..::<<< $ $ IvV# # # # # $ $rc|jdj}|jd}|jdj|}||fS)z=Return array data as (edges,grid), i.e. a numpy nD histogram.rBrx)rr1rZrcreshape)rr1rZhists r histogramddzfield.histogramddHsP ,2 ,2244v&,44U;;U|rc|j|Srr)rrs r __getitem__zfield.__getitem__Oss##rc||j|<dSrr)rrvalues r __setitem__zfield.__setitem__Rs$rcdt|jzdztt|jzdztt|jzdzS)Nz)r rr0rr6s r r7zfield.__repr__Us`*3tw<<7 A3t''(());<3t''(())45 5r)rNN)r8r9r:r;rrr&r.rrrrrrr7r[r\s@r rrs5 5 5 5 n'''000002      &&&$$$$$$%%%5555555rrceZdZdZdS) DXParseErrorz0general exception for parsing errors in DX filesNr8r9r:r;r=rr rr_s::DrrceZdZdZdS)DXParserNoTokensz)raised when the token buffer is exhaustedNrr=rr rrbs33Drrc neZdZdgdggddgdgdgddgdZdeeeed eeed Zd Zd Z d Z ddZ dZ d S)TokenCOMMENTWORD) QUOTEDSTRING BARESTRINGSTRING WHITESPACEINTEGERREAL)rrrrrrNUMBERc.tjdd|S)Nz#\s*r)resub)r2s r rzToken.pswr! 4 4rN) rrrrrrrrrc"||_||_dSr)codetext)rrrs r rzToken.__init__vs  rc|j|kSr)r)rvs r equalsz Token.equalsysyA~rc*|j|j|vSr)rcategory)rrs r iscodez Token.iscode{syDM$///rcJ||j}|j||jS)z9Return text cast to the correct type or the selected type)rcastr)rascodes r rz Token.value}s' >YF ty +++rcdt|jzdzt|zdzS)NzeZdZdZeeeedZdZ dZ dZ dZ dZ dS) DXInitObjectzStorage class that holds data to initialize one of the 'real' classes such as OpenDX.array, OpenDX.gridconnections, ... All variables are stored in args which will be turned into the arguments for the DX class. )r?r^rcrcH||_||_t|_dSr)r{rrargs)r classtypers r rzDXInitObject.__init__s FF rcH|j|j|jfi|jS)zgInitialize the corresponding DXclass from the data. class = DXInitObject.initialize() ) DXclassesr{rrr6s r initializezDXInitObject.initializes) )t~di(==49===rc|j|Srr)rks r rzDXInitObject.__getitem__sy|rc||j|<dSrr)rrrs r rzDXInitObject.__setitem__s ! rcfdt|jzdzt|jzdzS)Nz>> VVVVVrrceZdZdZejdejZdZdZ dZ dZ dZ dZ d Zd Zd Zd Zd ZdZdZdZdZdZdS)raBrain-dead baroque implementation to read a simple (VMD) dx file. Requires a OpenDX.field instance. 1) scan for 'object' lines: 'object' id 'class' class [data] [data ...] 2) parse data according to class 3) construct dx field from classes a  (?P\#.*$) # comment (until end of line) |(?P(object|class|counts|origin|delta|type|counts|rank|items|data)) |"(?P[^\"]*)" # string in double quotes (quotes removed) |(?P\s+) # white space |(?P[-+]? # true real number (decimal point or (\d+(\.\d*)?|\.\d+) # scientific notation) and integers ([eE][-+]?\d+)?) |(?P[a-zA-Z_][^\s\#\"]+) # unquoted strings, starting with non-numeric ct||_tdd|jg|_|j|j|j|j|j|j |j d|_ dS)aSetup a parser for a simple DX file (from VMD) >>> DXfield_object = OpenDX.field(id) >>> p = DXparser('bulk.dx') >>> p.parse(DXfield_object) The field object will be completely rewritten (including the id if one is found in the input file. The input files component layout is currently ignored. Note that quotes are removed from quoted strings. z grid dataz filename: {0})r)generalrrr?r^rcrN) r r rrK_DXParser__general_DXParser__comment_DXParser__object_DXParser__gridpositions_DXParser__gridconnections_DXParser__array_DXParser__fieldparsersrs r rzDXParser.__init__soH  ;1G1G 1V1V0WXXX #'."&.4=(,(<*.*@ $ dl  rcD||_d|_g|_g|_|jdrHt |jd5|_|ddddn #1swxYwYnGt|jd5|_|ddddn #1swxYwY|jD]N}|j dkr |j |_ | }|j |j|O|`|`dS)aBParse the dx file and construct a DX field object with component classes. A :class:`field` instance *DXfield* must be provided to be filled by the parser:: DXfield_object = OpenDX.field(*args) parse(DXfield_object) A tokenizer turns the dx file into a stream of tokens. A hierarchy of parsers examines the stream. The level-0 parser ('general') distinguishes comments and objects (level-1). The object parser calls level-3 parsers depending on the object found. The basic idea is that of a 'state machine'. There is one parser active at any time. The main loop is the general parser. * Constructing the dx objects with classtype and classid is not implemented yet. * Unknown tokens raise an exception. Nrrrrr)r currentobjectobjectstokensr rrdxfile use_parserr r{rrrr)rrors r rzDXParser.parses, !  = ! !% ( ( +DM400 +DK *** + + + + + + + + + + + + + + +dmS)) +T[ *** + + + + + + + + + + + + + + + , ,Av  T  A L  Q[ + + + +   s$ A33A7:A7B;;B?B?c |}nE#t$r8|jr-|j|jvr|j|jYdSwxYw|dr|dnm|dr+|dr|dn-|j|j urtdt|z|  )zlLevel-0 parser and main loop. Look for a token that matches a level-1 parser and hand over control.rCNrrrrzUnknown level-1 construct at ) _DXParser__peekrrrrr set_parserr_DXParser__parserrrr apply_parserrtoks r __generalzDXParser.__general s  kkmm#   %<$*AAc|}|j||ddS)zLevel-1 parser for comments. pattern: #.* Append comment (with initial '# ' stripped) to all comments. rN)_DXParser__consumerrrrr s r __commentzDXParser.__comment,sI nn   ---  """""rc||j}|j}|dkrtd|z|jr|j|j|j}t |||_||dS)zLevel-1 parser for objects. pattern: 'object' id 'class' type ... id ::= integer|string|'"'white space string'"' type ::= string classz*reserved word %s should have been 'class'.)rrN)rrrrrrrr)rrwordrs r __objectzDXParser.__object6s ..""'~~$ 7??KdRSS S   4 L   2 3 3 3NN$$) )IgNNN  """""rc: |}n#t$rYdSwxYw|drg} |d|}||dd#tt f$rYnwxYwt|dkrtd||j d<dS|drg} | ds'| d r|}||| db| d n#t$rYnwxYwt|dkrtd ||j d<dS|d rLg} | ds'| d r|}||| db| d n#t$rYnwxYwt|dkrtd  |j d |dS#t$r|g|j d <YdSwxYwtd t|zdz)zLevel-2 parser for gridpositions. pattern: object 1 class gridpositions counts 97 93 99 origin -46.5 -45.5 -48.5 delta 1 0 0 delta 0 1 0 delta 0 0 1 NcountsTrrz"gridpositions: no shape parametersr1rGrz#gridpositions: no origin parametersrIz'gridpositions: missing delta parameterszgridpositions:  not recognized.) rrrrrrrDr0rrrr|r )rr r1rGrWs r __gridpositionszDXParser.__gridpositionsMs ..""CC    FF  ::h  ) NE 7KKMM'' 222..**CLL9!5!5666 7 %j1    5zzQ"#GHHH*/D w ' ' ' ZZ ! ! NF {{}}++I66/{{}}++F33/..**CMM#))++...{{}}++I66/{{}}++F33/$    6{{a"#HIII+1D x ( ( ( ZZ  NA {{}}++I66*{{}}++F33*..**CHHSYY[[))){{}}++I66*{{}}++F33*$    1vv{{"#LMMM 2"7+22155555 2 2 2/0c"7++++ 20S9:LLMM MsW %%A%B%%B98B9CG G('G(2CL LL= MM87M8c |}n#t$rYdSwxYw|drg} |d|}||dd#tt f$rYnwxYwt|dkrtd||j d<dStdt|zd z) zuLevel-2 parser for gridconnections. pattern: object 2 class gridconnections counts 97 93 99 NrTrrz$gridconnections: no shape parametersr1zgridconnections: r) rrrrrrrDr0rrr )rr r1s r __gridconnectionszDXParser.__gridconnectionss&  ..""CC    FF  ::h   PE 7KKMM'' 222..**CLL9!5!5666 7 %j1    5zzQ"#IJJJ*/D w ' ' '23s88;>##**844 @"#>???NN$$**,,EEEyS12DDEE Es$ %%C$$"D3E"E4c" |}n#t$rYdSwxYw|dr|}|dst d|} ||jd|<dS#t $r||i|jd<YdSwxYwt dt|zdz)zLevel-2 parser for a DX field object. pattern: object "site map 1" class field component "positions" value 1 component "connections" value 2 component "data" value 3 Nrrzfield: "value" expectedrzfield: r)rrrrrrr|r )rr rrs r __fieldzDXParser.__fields/ ..""CC    FF  ::k " " F((..00I>>##**733 >"#<===nn&&,,..G G>E"<0;;; G G G4=g3F"<0000 GyS12DDEE Es %%CC,+C,cR|j||_|dS)z2Set parsername as the current parser and apply it.Nrr r parsernames r rzDXParser.use_parsers! Z0  rc*|j||_dS)z%Set parsername as the current parser.Nr'r(s r rzDXParser.set_parser s Z0 rc.|dS)z-Apply the current parser to the token stream.N)r r6s r r zDXParser.apply_parsers rc$|j|D]b}|j}||j}t ||}|ds|j|cdS)zSplit s into tokens and update the token buffer. __tokenize(string) New tokens are appended to the token buffer, discarding white space. Based on http://effbot.org/zone/xml-scanner.htm rN) dx_regexfinditerr! lastgroupgrouprrrr)rrmrrr s r __tokenizezDXParser.__tokenizes'' 77 ) )A;D771;''DT""C::l++ )##C(((  ) )rct|jdkr.||jdSdS)aGAdd a new tokenized line from the file to the token buffer. __refill_tokenbuffer() Only reads a new line if the buffer is empty. It is safe to call it repeatedly. At end of file, method returns empty strings and it is up to __peek and __consume to flag the end of the stream. rN)r0r_DXParser__tokenizerr r6s r __refill_tokenbufferzDXParser.__refill_tokenbuffer"sG t{  q OODK0022 3 3 3 3 3 ! rcp| |jdS#t$rtwxYw)Nr)_DXParser__refill_tokenbufferr IndexErrorrr6s r __peekzDXParser.__peek0sF !!### #;q> ! # # #" " #s #5c| |jdS#t$rtwxYw)zGet the next token from the buffer and remove it/them. try: while 1: token = __consume() except DXParserNoTokens: pass r)r7rpopr8rr6s r __consumezDXParser.__consume7sP !!### #;??1%% % # # #" " #s 0AN)r8r9r:r;rcompileVERBOSEr-rrrrrrrrrrrr r4r7rrr=rr rrsB  rz    H21-1-1-j   @######.8N8N8NvPPP8CFCFCFJFFF<111 ) ) ) 4 4 4########rr)r)r;rErrr}sys version_inforrrr?r^rcr Exceptionrrrrrr=rr rBs{ GGP  u)))))#####I#I#I#I#If#I#I#IL,E,E,E,E,EG,E,E,E^ J J J J Jg J J JGIGIGIGIGIGGIGIGIRM5M5M5M5M5GM5M5M5h     9        |   BBBBBBBB>VVVVV6VVV:c#c#c#c#c#vc#c#c#c#c#r