A tokenizer of type uax_url_email
which works exactly like the standard
tokenizer, but also handles emails and urls.
The following are settings that can be set for a uax_url_email
tokenizer type:
Setting | Description |
---|---|
max_token_length |
The maximum token length. If a token is seen that exceeds this length then it is discarded. Defaults to 255 . |