Class DelimitersHandler
This class creates an array of boolean values representing all
characters up to the maximum delimiter character's codepoint. It uses the
codepoint value of a given character as a lookup into the boolean array.
An entry that returns true from the array is a delimiter character.
In theory this will technically work (at a memory cost) with the full
UTF-16 range of characters but in practice the delimiters are limited to
the standard ASCII range.
@author DeviceAtlas Limited
|
|
| __init__(self,
code_point_delimiters) |
|
|
|
|
is_delimiter(self,
code_point)
Determines if the passed character is a delimiter. |
|
|
|
|
| get_any_delimiter_code_point(self) |
|
|