Initial commit: cc-cursor 全链路量化研究平台

7 Sprints 全部完成:
  Sprint 0: 基础设施 (DataManager + MariaDB)
  Sprint 1: 因子引擎 (34因子/12分类)
  Sprint 2: VectorBT 回测 (5策略+截面)
  Sprint 3: Optuna 优化 (+Walk-Forward)
  Sprint 4: ML 模型 (LightGBM+CatBoost)
  Sprint 5: Qwen 情绪因子 (三源新闻+日期对齐)
  Sprint 6: Agent 系统 (4Agent+日报.md/.html)

生产加固 (15项): Tushare双源fallback, SSH自动恢复, pool_pre_ping,
  save_daily先删后插, load_dotenv绝对路径, 日报5d/20d修复,
  RiskAgent改上证指数, 昨日对比+数据截止, mac_report utf8mb4,
  CLAUDE-*.md 9条已知Bug, demo全参数化, djapi数据源归一化,
  indexDatas API修正

Co-Authored-By: Claude Opus 4.7 <noreply@anthropic.com>
This commit is contained in:
2026-06-07 15:59:05 +08:00
co-authored by Claude Opus 4.7
commit 271a9343a5
293 changed files with 59598 additions and 0 deletions
+2
View File
@@ -0,0 +1,2 @@
/cache
/project.local.yml
@@ -0,0 +1,23 @@
# Code Style & Conventions
## Python
- Django app: all business logic in `api/stock/`, not in views
- views.py is thin forwarding layer: extract params -> call function -> return Response
- Double import pattern for standalone scripts: try relative import first, fall back to absolute
- Use `viewFunc_tsCodeAndDate()` wrapper for ts_code + date_range endpoints
- Use `viewFunc_singleParam()` wrapper for single-param endpoints
- DRF `@api_view(['GET'])` + `@extend_schema` on all views
- DRF `Response` (not `JsonResponse`) — no `safe=False` parameter
- Configuration split: config.py (token) / strategy_config.py / scan_config.py
## Constraints
- `api/video/` is protected — do NOT modify unless user explicitly asks
- No python-dotenv dependency — use stdlib env loaders only
- Backward compatibility: keep re-exports when splitting modules
- Server `.env` file manages all secrets; uwsgi.ini only has DJANGO_SETTINGS_MODULE
## Secrets
- All API keys/tokens/passwords via os.getenv()
- Local: .env file (not committed)
- Server: /home/simon/myquant/djapi/.env
- Django loads via djapi/env_loader.py, video loads via api/video/env.py
@@ -0,0 +1,32 @@
# Project Overview
djapi is a Django 5.2 project providing financial data APIs for A-share stocks and CCTV news broadcast video processing.
## Tech Stack
- Python 3.10, Django 5.2, uWSGI, nginx
- Tushare (stock data), akshare (alternative stock data)
- DRF + drf-spectacular (API documentation)
- MySQL (business data), SQLite (Django admin only)
- yt-dlp + ffmpeg + pydub (video/audio processing)
- DashScope (ASR), DeepSeek API (AI text processing)
## Architecture
- Single Django app: `api`
- `api/stock/` — stock data module (Tushare/akshare -> pandas -> JsonResponse/DRF Response)
- `api/video/` — independent video processing pipeline (download -> audio -> ASR -> AI split -> MySQL)
- views.py is thin: extracts params, calls stock functions, returns Response
## Key Files
- `api/views.py` — all ~15 API views, using @api_view + @extend_schema
- `api/stock/stock_utils.py` — shared utilities: tscodeCheck, viewFunc_tsCodeAndDate, viewFunc_singleParam
- `api/stock/config.py` — Tushare token + re-exports from strategy_config, scan_config
- `api/serializers.py` — 13 DRF Serializer classes
- `djapi/env_loader.py` — .env file loader (stdlib, no python-dotenv)
- `api/video/env.py` — standalone .env loader for video module
- `api/utils/mysql_handler.py` — shared MySQLDB class
## Deployment
- Server: simon@doorcome.cn, path: /home/simon/myquant/djapi/
- Virtual env: /opt/miniconda/envs/django/
- uWSGI on port 5004, nginx reverse proxy
- Domains: api.doorcome.cn, echart.doorcome.cn
@@ -0,0 +1,44 @@
# Suggested Commands
## Development
```bash
python manage.py runserver 0.0.0.0:8000 # dev server
python manage.py check --deploy # check config
python manage.py test api # run tests
```
## uWSGI
```bash
uwsgi --ini uwsgi.ini # start
uwsgi --reload uwsgi.pid # hot reload
uwsgi --stop uwsgi.pid # stop
# On server:
/opt/miniconda/envs/django/bin/uwsgi --ini /home/simon/myquant/djapi/uwsgi.ini
kill $(lsof -ti:5004) # force stop
```
## Deploy
```bash
# Full sync (exclude production data)
rsync -avz --delete \
--exclude='.env' --exclude='db.sqlite3' \
--exclude='*.log' --exclude='uwsgi.pid' \
--exclude='__pycache__/' --exclude='*.pyc' \
--exclude='xwlb_video/' --exclude='audio_processing/' \
/Users/summer/Downloads/cc-cursor/djapi/ \
simon@doorcome.cn:/home/simon/myquant/djapi/
# Single file sync MUST use full target path
rsync -avz api/views.py simon@doorcome.cn:/home/simon/myquant/djapi/api/views.py
```
## API Docs
- /api/docs/ — Swagger UI
- /api/redoc/ — ReDoc
- /api/schema/ — OpenAPI JSON
## Video Processing
```bash
cd api/video
python main.py
```
+120
View File
@@ -0,0 +1,120 @@
# the name by which the project can be referenced within Serena
project_name: "djapi"
# list of languages for which language servers are started; choose from:
# al ansible bash clojure cpp
# cpp_ccls crystal csharp csharp_omnisharp dart
# elixir elm erlang fortran fsharp
# go groovy haskell haxe hlsl
# java json julia kotlin lean4
# lua luau markdown matlab msl
# nix ocaml pascal perl php
# php_phpactor powershell python python_jedi python_ty
# r rego ruby ruby_solargraph rust
# scala solidity swift systemverilog terraform
# toml typescript typescript_vts vue yaml
# zig
# (This list may be outdated. For the current list, see values of Language enum here:
# https://github.com/oraios/serena/blob/main/src/solidlsp/ls_config.py
# For some languages, there are alternative language servers, e.g. csharp_omnisharp, ruby_solargraph.)
# Note:
# - For C, use cpp
# - For JavaScript, use typescript
# - For Free Pascal/Lazarus, use pascal
# Special requirements:
# Some languages require additional setup/installations.
# See here for details: https://oraios.github.io/serena/01-about/020_programming-languages.html#language-servers
# When using multiple languages, the first language server that supports a given file will be used for that file.
# The first language is the default language and the respective language server will be used as a fallback.
# Note that when using the JetBrains backend, language servers are not used and this list is correspondingly ignored.
languages:
- typescript
- python
# the encoding used by text files in the project
# For a list of possible encodings, see https://docs.python.org/3.11/library/codecs.html#standard-encodings
encoding: "utf-8"
# line ending convention to use when writing source files.
# Possible values: unset (use global setting), "lf", "crlf", or "native" (platform default)
# This does not affect Serena's own files (e.g. memories and configuration files), which always use native line endings.
line_ending:
# The language backend to use for this project.
# If not set, the global setting from serena_config.yml is used.
# Valid values: LSP, JetBrains
# Note: the backend is fixed at startup. If a project with a different backend
# is activated post-init, an error will be returned.
language_backend:
# whether to use project's .gitignore files to ignore files
ignore_all_files_in_gitignore: true
# advanced configuration option allowing to configure language server-specific options.
# Maps the language key to the options.
# Have a look at the docstring of the constructors of the LS implementations within solidlsp (e.g., for C# or PHP) to see which options are available.
# No documentation on options means no options are available.
ls_specific_settings: {}
# list of additional paths to ignore in this project.
# Same syntax as gitignore, so you can use * and **.
# Note: global ignored_paths from serena_config.yml are also applied additively.
ignored_paths: []
# whether the project is in read-only mode
# If set to true, all editing tools will be disabled and attempts to use them will result in an error
# Added on 2025-04-18
read_only: false
# list of tool names to exclude.
# This extends the existing exclusions (e.g. from the global configuration)
# Find the list of tools here: https://oraios.github.io/serena/01-about/035_tools.html
excluded_tools: []
# list of tools to include that would otherwise be disabled (particularly optional tools that are disabled by default).
# This extends the existing inclusions (e.g. from the global configuration).
# Find the list of tools here: https://oraios.github.io/serena/01-about/035_tools.html
included_optional_tools: []
# fixed set of tools to use as the base tool set (if non-empty), replacing Serena's default set of tools.
# This cannot be combined with non-empty excluded_tools or included_optional_tools.
# Find the list of tools here: https://oraios.github.io/serena/01-about/035_tools.html
fixed_tools: []
# list of mode names that are to be activated by default, overriding the setting in the global configuration.
# The full set of modes to be activated is base_modes (from global config) + default_modes + added_modes.
# If the setting is undefined/empty, the default_modes from the global configuration (serena_config.yml) apply.
# Otherwise, this overrides the setting from the global configuration (serena_config.yml).
# Therefore, you can set this to [] if you do not want the default modes defined in the global config to apply
# for this project.
# This setting can, in turn, be overridden by CLI parameters (--mode).
# See https://oraios.github.io/serena/02-usage/050_configuration.html#modes
default_modes:
# list of mode names to be activated additionally for this project, e.g. ["query-projects"]
# The full set of modes to be activated is base_modes (from global config) + default_modes + added_modes.
# See https://oraios.github.io/serena/02-usage/050_configuration.html#modes
added_modes:
# initial prompt for the project. It will always be given to the LLM upon activating the project
# (contrary to the memories, which are loaded on demand).
initial_prompt: ""
# time budget (seconds) per tool call for the retrieval of additional symbol information
# such as docstrings or parameter information.
# This overrides the corresponding setting in the global configuration; see the documentation there.
# If null or missing, use the setting from the global configuration.
symbol_info_budget:
# list of regex patterns which, when matched, mark a memory entry as readonly.
# Extends the list from the global configuration, merging the two lists.
read_only_memory_patterns: []
# list of regex patterns for memories to completely ignore.
# Matching memories will not appear in list_memories or activate_project output
# and cannot be accessed via read_memory or write_memory.
# To access ignored memory files, use the read_file tool on the raw file path.
# Extends the list from the global configuration, merging the two lists.
# Example: ["_archive/.*", "_episodes/.*"]
ignored_memory_patterns: []