Commit b3684be
committed
Reorganize project into modular architecture with separate configs and reusable components
## New Structure
- configs/ - Script-specific configuration files (4 files)
- download.py - YouTube download settings
- build_manifest.py - Transcript processing config
- extract_mediapipe.py - MediaPipe extraction config
- extract_mmpose.py - MMPose 3D extraction config
- src/asl_prep/ - Core library modules
- common/ - Shared utilities (files.py, video.py)
- download/ - YouTube download logic
- transcripts/ - Text preprocessing
- pipeline/ - Task orchestration
- extractors/ - Landmark extraction (base, mediapipe, mmpose)
- scripts/ - Executable entry points
- 1_download_data.py - Download videos & transcripts
- 2_build_manifest.py - Build manifest CSV
- 3a_extract_mediapipe.py - Extract MediaPipe landmarks
- 3b_extract_mmpose.py - Extract MMPose 3D landmarks
- assets/ - Demo files and metadata (moved from resource/)
## Key Improvements
- Eliminated ~200 lines of duplicate code (FPSSampler, file utils, validation)
- Separated concerns with script-specific configs instead of monolithic conf.py
- Created reusable modules following DRY principle
- Added comprehensive documentation with type hints and docstrings
- Implemented abstract base class for landmark extractors
- Improved error handling and logging throughout
## Breaking Changes
- Old scripts (s1_*.py, s2_*.py, s3_*.py) replaced with new scripts/ directory
- conf.py split into 4 separate config files in configs/
- resource/ directory renamed to assets/
## Files Changed
- Created: 23 Python modules + 8 __init__.py files (~2,500 lines)
- Updated: .gitignore, README.md
- Moved: resource/ → assets/1 parent f843fb6 commit b3684be
File tree
33 files changed
+625449
-1641
lines changed- assets
- configs
- scripts
- src/asl_prep
- common
- download
- extractors
- pipeline
- transcripts
33 files changed
+625449
-1641
lines changed| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
163 | 163 | | |
164 | 164 | | |
165 | 165 | | |
166 | | - | |
167 | | - | |
| 166 | + | |
| 167 | + | |
| 168 | + | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| 179 | + | |
| 180 | + | |
| 181 | + | |
168 | 182 | | |
0 commit comments