This scenario demonstrates how to use the UnicodeCharacters class in order to tokenize lexical identifiers within a string. The code iterates through the characters, detects surrogate pairs and delimits the identifiers using the appropriate methods in
the class.