Apocrypha

ASTAligner

ASTAligner is designed to align tokens from source code snippets to Abstract Syntax Tree (AST) nodes using Tree-sitter for AST generation and various HuggingFace tokenizers for language tokenization. The library supports a wide range of programming languages and Fast tokenizers, enabling precise mapping between source code elements and their AST representations.

Available in

OverlayNewestEbuildsLast activity
pypi GitHub ↗ 1.0.2 1 5 mo details ›

Versions & arches

VersionOverlay amd64x86 Committed
1.0.2 pypi amd64 testing x86 testing view · download · history ↗

Use flags of 1.0.2

4 expansion flags (python targets, ABIs, cpu flags…)
  • python_targets_python3_11
  • python_targets_python3_12
  • python_targets_python3_13
  • python_targets_python3_14

Runtime dependencies of 1.0.2

show 32 lines
python_targets_python3_11? (
)
python_targets_python3_12? (
)
python_targets_python3_13? (
)
python_targets_python3_14? (
)