python-offside-rule-context-sensitive

Summary

Python's indentation rules mean you cannot break source code into tokens in isolation — the lexer must remember the nesting depth it saw in earlier lines before it can decide what tokens the current line produces. This forces every tool that touches Python syntax, from editors to linters to transpilers, to treat tokenization as a stateful, context-dependent process rather than a simple one-pass scan.