Data Sources
| # | Database | Script | Source | Type |
|---|---|---|---|---|
| 1 | 国家法律法规数据库 (NPC) | scripts/download.py | flk.npc.gov.cn | JSON API |
| 2 | 国家规章库 (Gov Rules) | scripts/gov_rules_crawler.py | gov.cn/zhengce/xxgk/gjgzk | Athena API + HTML |
| 3 | 外交条约库 (Treaty) | scripts/treaty_crawler.py | treaty.mfa.gov.cn | HTML |
| 4 | 国务院政策文件库 | scripts/gov_policy_library.py | sousuo.www.gov.cn | REST API (GET) |
| 5 | 司法部行政法规库 | scripts/moj_law_crawler.py | xzfg.moj.gov.cn | HTML |
| 6 | 党内法规库 | scripts/party_law_crawler.py | www.12371.cn | HTML |
| 7 | 国防部法规文库 | scripts/mod_law_crawler.py | www.mod.gov.cn | HTTP |
| 8 | 税务法规库 | scripts/tax_law_crawler.py | fgk.chinatax.gov.cn | REST API (POST) |
| 9 | 生态环境部法规规章 | scripts/mee_law_crawler.py | mee.gov.cn | HTML |
| 10 | 最高人民法院发布栏目 | scripts/court_law_crawler.py | court.gov.cn | HTML |
All scripts share --search, --info, --size, --output, --rate-limit, --no-cache, --cache-stats, --cache-clear. Run python <script> --help for full parameter lists.
Core Rules
Search Strategy (applies to ALL data sources)
Decide before calling the script — never default to fuzzy for everything:
- Known title (e.g. "物业管理条例", "北京市生活垃圾管理条例"): use
--exactto reduce noise. - Broad topic (e.g. "出租车", "环境保护"): use fuzzy search (default).
- Full-text match: add
--range contentwhen you need documents where the keyword appears in the body, not just the title. - Ambiguous: ask the user, or run both exact+fuzzy and compare.
Status Filtering
NPC status codes (sxx / --status):
| Code | Meaning |
|---|---|
1 | 已废止 |
2 | 已修改 |
3 | 现行有效 |
4 | 尚未生效 |
Other sources use their own status values (e.g. --status effective for MoJ). Check --help per script.
Article-Level Queries (NPC)
For individual articles instead of full documents:
| Command | When | Output |
|---|---|---|
--preview <id> | Understand structure first | Title, article count, TOC |
--article <id> "第X条" | Know the article number | Single article text |
--article <id> --grep "kw" | Find articles by keyword in one law | All matching articles |
Supports Chinese numerals (第三十八条), Arabic (第38条), or bare numbers (38).
For cross-law article search, use scripts/article_search.py <keyword> --max-laws N.
Rate Limiting
Auto mode picks by estimated requests: OFF (≤10), FIXED 5 req/s (11–100), ADAPTIVE 1–8 req/s with 429 backoff (>100). Override: --rate-limit {off|fixed|adaptive}.
Caching
Local file cache enabled (~/.cache/ per namespace). Search results: 1h TTL. Detail metadata: 24h. DOCX: 7 days. Use --no-cache to bypass, --cache-stats to inspect.
Validity Rules — MANDATORY
- Only state 现行有效, 已废止, 已修改, or 尚未生效 when the official page or API response explicitly provides that status.
- If the source has no explicit validity field, say: "官方页面未明确标注效力状态".
- Do not infer validity from file accessibility or recency of publication date.
- Always return: official URL, file type, issuing authority, publication date, and retrieval date — even when status is absent.
- For same-name / multi-version documents, flag the ambiguity and verify amendment, repeal, and effective-date information.
- Distinguish document types: 法律, 行政法规, 地方性法规, 规章, 司法解释, 司法文件, 党内法规, 政策文件, 通知, 案例, 条约. Do not conflate.
- Never write "现行法律" as a generic label for all official publications.
Document Type Attribution
When reporting results, always identify the document type and source database explicitly. Use the format:
来源: [数据库名称] ([URL])
文件类型: [法律/行政法规/规章/司法解释/党内法规/政策文件/通知/...]
发布机关: [authority]
发布日期: [date]
效力状态: [现行有效/已废止/...] 或 "官方页面未明确标注效力状态"
Script Routing Summary
| Script | Purpose | Key flags | Output dir |
|---|---|---|---|
scripts/download.py | NPC search, download, article, preview | --search, --exact, --range, --status, --download, --article, --preview, --urls-only | stdout, files |
scripts/article_search.py | Cross-law article-level search | keyword, --law, --range, --max-laws, --context, --json, --offset, --resume | stdout |
scripts/gov_rules_crawler.py | Gov.cn rules | --search, --categories, --download, --info | gov_rules_output/ |
scripts/treaty_crawler.py | MFA treaties | --search, --collections, --download, --info | treaty_output/ |
scripts/gov_policy_library.py | State Council policies | --search, --range, --category, --year | gov_policy_output/ |
scripts/moj_law_crawler.py | MoJ admin regulations | --search, --range, --status | moj_law_output/ |
scripts/party_law_crawler.py | Party regulations (12371.cn) | --search, --category | party_law_output/ |
scripts/mod_law_crawler.py | MOD law library | --search, --category | mod_law_output/ |
scripts/tax_law_crawler.py | Tax regulations (chinatax) | --search, --category | tax_law_output/ |
scripts/mee_law_crawler.py | MEE env regulations | --search, --category | mee_law_output/ |
scripts/court_law_crawler.py | SPC announcements | --search, --category | court_law_output/ |
scripts/region_classifier.py | Province/city classification | --classify, --matrix | JSON/CSV |
Each script has --help. Run it for detailed parameter lists.
Reference Files
Read these on demand, not proactively:
| File | Read when... |
|---|---|
references/setup.md | First run, dependency issues, or switching agent environments |
references/api_reference.md | Need full NPC API payloads, field mappings, auth, or pagination details |
references/gov_rules_api_reference.md | Gov Rules auth issues (401/403) or response field parsing |
references/gov_policy_api_reference.md | Need State Council API parameter details beyond --help |
references/treaty_api_reference.md | Treaty HTML structure or field extraction patterns |
references/page_structure.md | Browser automation — page layout, selectors, UI-only search flow |
references/kimi_bridge_adapter.md | Running on Kimi Agent or Claude Code + kimi-webbridge |
references/codex_adapter.md | Running on Codex |
references/batch_collection.md | Large-scale collection (200+ items), batch download workflows |
Browser fallback: only when the API/script fails or UI-only search is required. Read references/page_structure.md first.
Key Notes by Data Source
- NPC:
ossFilepaths from detail API are not directly downloadable — always use--download.bbbs= unique law ID. - Gov Rules: Requires dynamic RSA auth from the frontend JS bundle; may expire during long runs. Restart on 401/403.
- Treaty: Pure HTML, no API. Collections:
全部,双边,多边. - Party Law (12371.cn): No search API; keyword filtering is client-side on titles only.
- MOD: Static HTML, no search API. Client-side title filtering.
- Tax: POST API, requires session cookie (auto-managed). Channel ID auto-discovered.
- MEE: Static HTML, categories pre-loaded in page. No search API. Standards (环保标准) excluded.
- Court: List pages paginated (
/fabu/gengduo/{id}.html→{id}_{n}.html). No search API.
