Sarcasm and more can be measured in text using modern LLMs.

Current state-of-the-art NLP can mostly measure sentiment and simple variables such as word count and bag-of-word measures. With modern LLMs such as text-davinci-003, we are able to create new ways to measure texts.

Examples might be: Sarcasm, bias, grammatical errors and domain-specific language use.

For AI safety, this can become useful to