Initial commit: cc-cursor 全链路量化研究平台

7 Sprints 全部完成:
  Sprint 0: 基础设施 (DataManager + MariaDB)
  Sprint 1: 因子引擎 (34因子/12分类)
  Sprint 2: VectorBT 回测 (5策略+截面)
  Sprint 3: Optuna 优化 (+Walk-Forward)
  Sprint 4: ML 模型 (LightGBM+CatBoost)
  Sprint 5: Qwen 情绪因子 (三源新闻+日期对齐)
  Sprint 6: Agent 系统 (4Agent+日报.md/.html)

生产加固 (15项): Tushare双源fallback, SSH自动恢复, pool_pre_ping,
  save_daily先删后插, load_dotenv绝对路径, 日报5d/20d修复,
  RiskAgent改上证指数, 昨日对比+数据截止, mac_report utf8mb4,
  CLAUDE-*.md 9条已知Bug, demo全参数化, djapi数据源归一化,
  indexDatas API修正

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
2026-06-07 15:59:05 +08:00
co-authored by Claude Opus 4.7
commit 271a9343a5
293 changed files with 59598 additions and 0 deletions
@@ -0,0 +1,23 @@
# Code Style & Conventions
## Python
- Django app: all business logic in `api/stock/`, not in views
- views.py is thin forwarding layer: extract params -> call function -> return Response
- Double import pattern for standalone scripts: try relative import first, fall back to absolute
- Use `viewFunc_tsCodeAndDate()` wrapper for ts_code + date_range endpoints
- Use `viewFunc_singleParam()` wrapper for single-param endpoints
- DRF `@api_view(['GET'])` + `@extend_schema` on all views
- DRF `Response` (not `JsonResponse`) — no `safe=False` parameter
- Configuration split: config.py (token) / strategy_config.py / scan_config.py
## Constraints
- `api/video/` is protected — do NOT modify unless user explicitly asks
- No python-dotenv dependency — use stdlib env loaders only
- Backward compatibility: keep re-exports when splitting modules
- Server `.env` file manages all secrets; uwsgi.ini only has DJANGO_SETTINGS_MODULE
## Secrets
- All API keys/tokens/passwords via os.getenv()
- Local: .env file (not committed)
- Server: /home/simon/myquant/djapi/.env
- Django loads via djapi/env_loader.py, video loads via api/video/env.py
@@ -0,0 +1,32 @@
# Project Overview
djapi is a Django 5.2 project providing financial data APIs for A-share stocks and CCTV news broadcast video processing.
## Tech Stack
- Python 3.10, Django 5.2, uWSGI, nginx
- Tushare (stock data), akshare (alternative stock data)
- DRF + drf-spectacular (API documentation)
- MySQL (business data), SQLite (Django admin only)
- yt-dlp + ffmpeg + pydub (video/audio processing)
- DashScope (ASR), DeepSeek API (AI text processing)
## Architecture
- Single Django app: `api`
- `api/stock/` — stock data module (Tushare/akshare -> pandas -> JsonResponse/DRF Response)
- `api/video/` — independent video processing pipeline (download -> audio -> ASR -> AI split -> MySQL)
- views.py is thin: extracts params, calls stock functions, returns Response
## Key Files
- `api/views.py` — all ~15 API views, using @api_view + @extend_schema
- `api/stock/stock_utils.py` — shared utilities: tscodeCheck, viewFunc_tsCodeAndDate, viewFunc_singleParam
- `api/stock/config.py` — Tushare token + re-exports from strategy_config, scan_config
- `api/serializers.py` — 13 DRF Serializer classes
- `djapi/env_loader.py` — .env file loader (stdlib, no python-dotenv)
- `api/video/env.py` — standalone .env loader for video module
- `api/utils/mysql_handler.py` — shared MySQLDB class
## Deployment
- Server: simon@doorcome.cn, path: /home/simon/myquant/djapi/
- Virtual env: /opt/miniconda/envs/django/
- uWSGI on port 5004, nginx reverse proxy
- Domains: api.doorcome.cn, echart.doorcome.cn
@@ -0,0 +1,44 @@
# Suggested Commands
## Development
```bash
python manage.py runserver 0.0.0.0:8000 # dev server
python manage.py check --deploy # check config
python manage.py test api # run tests
```
## uWSGI
```bash
uwsgi --ini uwsgi.ini # start
uwsgi --reload uwsgi.pid # hot reload
uwsgi --stop uwsgi.pid # stop
# On server:
/opt/miniconda/envs/django/bin/uwsgi --ini /home/simon/myquant/djapi/uwsgi.ini
kill $(lsof -ti:5004) # force stop
```
## Deploy
```bash
# Full sync (exclude production data)
rsync -avz --delete \
--exclude='.env' --exclude='db.sqlite3' \
--exclude='*.log' --exclude='uwsgi.pid' \
--exclude='__pycache__/' --exclude='*.pyc' \
--exclude='xwlb_video/' --exclude='audio_processing/' \
/Users/summer/Downloads/cc-cursor/djapi/ \
simon@doorcome.cn:/home/simon/myquant/djapi/
# Single file sync MUST use full target path
rsync -avz api/views.py simon@doorcome.cn:/home/simon/myquant/djapi/api/views.py
```
## API Docs
- /api/docs/ — Swagger UI
- /api/redoc/ — ReDoc
- /api/schema/ — OpenAPI JSON
## Video Processing
```bash
cd api/video
python main.py
```