Sochen
b086123bec
Implements four major improvements to the Pealim Anki deck pipeline:
1. Automated .apkg generation (genanki) — no more manual Anki Desktop step.
Both vocabulary and conjugation decks are built programmatically.
2. Word frequency ranking from hermitdave/FrequencyWords he_50k corpus.
Notes sorted by rank so Anki presents most common words first.
3. Example sentences from Ben Yehuda public domain corpus (not pealim.com).
Downloads txt_stripped.zip, indexes 25k texts, ~89% coverage on test set.
4. Conjugation drill deck — one card per form × verb.
Input: verbs_input.txt (Hebrew infinitives). Initial set: 7 verbs (one
per binyan). Extracts 28 forms each via pealim.com/search/ + table parse.
New files:
apkg_builder.py — genanki deck builder for both decks
benyehuda.py — Ben Yehuda corpus downloader + sentence indexer
frequency_lookup.py — FrequencyWords downloader + rank lookup
verbs_input.txt — verb input list (7 test verbs, one per binyan)
data/ — baseline CSVs + generated caches
Updated:
conjugation_extract.py — rewritten: reads verbs_input.txt, searches
/search/?q= for slug, parses table by row labels
requirements.txt — add genanki, beautifulsoup4, lxml
run.py — full orchestration pipeline with CLI flags
.gitignore — exclude venv/, benyehuda_index.json, audio/, output/
CLI:
python run.py --skip-scrape --skip-audio --test 20 (quick test)
python run.py --skip-scrape (full build)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
22 lines
321 B
Text
22 lines
321 B
Text
archive
|
|
nikkud.csv
|
|
practice.py
|
|
cardinal_one_to_ten.*
|
|
*.swp
|
|
bin**
|
|
lib**
|
|
include**
|
|
lib64**
|
|
pyvenv.cfg
|
|
venv/
|
|
__pycache__/
|
|
*.pyc
|
|
|
|
# Large generated cache files (rebuild locally)
|
|
data/benyehuda_index.json
|
|
|
|
# Audio directory (large; rebuild with --skip-scrape)
|
|
data/audio/
|
|
|
|
# Output .apkg files (generated by pipeline)
|
|
output/
|