* Feat: add a new datdump tool
* Refactor: address code review comments
* Refactor: remove export all from main program
use datdump instead
* Refactor: allow spaces in exportlists
e.g. `--exportlists="lista, listb"`
* all: cleanup
* apply review suggestion
---------
Co-authored-by: database64128 <[email protected]>
* Refactor: improve deduplicate
* Feat: support to export all lists to a plain yml
use: `--exportlists=_all_`
* Docs: add links for dlc plain yml
[skip ci]
* Refactor: reduce the use of strings.TrimSpace
* Refactor: use string attr before toProto
* Refactor parseEntry
- add value/attribute checker(check missing space)
- allow multiple spaces
- sort attributes
- improve readablity
* Refactor exportPlainTextList
- remove unnecessary variable
- improve readablity
* Remove support for partial include
This reverts e640ac2783
It is problematic and I will implement a new one
* Refactor: promote refMap
* Feat: add support for partial include
- refactor inclusion logic
- add basic deduplicate
* Refactor exporting plaintext list
* Feat: add support for affiliation
A domain rule is always added to the list corresponding to the filename
it resides in. Additionally, you can now add affiliations to a domain
rule, and the rule will be added to the list specified by the
affiliation. Each affiliation begins with `&` and followed by the name
of the affiliation.
This helps us to reduce the number of data files without compromising
functionality, and avoid writing a same rule in different files.
* Feat: add advanced deduplicate for subdomains
only for domain/full subdomains without attr
* Refactor: import and use slices
* Refactor: improve code
* apple: deduplicate
- swift is included in apple-dev
- `full:certs.apple.com @cn` is added in apple-pki
- `full:crl.apple.com @cn` is added in apple-pki
- `full:ocsp-lb.apple.com.akadns.net @cn` is added in apple-pki
- `full:ocsp.apple.com @cn` is added in apple-pki
- `full:ocsp2-lb.apple.com.akadns.net @cn` is added in apple-pki
- `full:ocsp2.apple.com @cn` is added in apple-pki
- `full:valid.apple.com @cn` is added in apple-pki
* apple: move `valid.origin-apple.com.akadns.net` to apple-pki
keep consistent with valid.apple.com
- `full:safebrowsing-cache.google.com @cn` appears twice
- `full:crl.pki.goog @cn` is added in google-trust-services
- `full:firebase-settings.crashlytics.com @cn` is added in firebase
- `full:ocsp.pki.goog @cn` is added in google-trust-services
- `full:pki-goog.l.google.com @cn` is added in google-trust-services
- `full:redirector.c.play.google.com @cn` is added in google-play
* tvdb: remove redundant entry
the only domain `thetvdb.com` is already in category-entertainment
* category-entertainment: remove redundant `litv.tv`
it's already in data/litv and included
* sina-ads: clean up
drop some problematic/unreliable/stale rules
* iqiyi-ads: clean up
drop some problematic/unreliable/stale rules
* youku-ads: clean up
drop some problematic/unreliable/stale rules
* alibaba-ads: clean up
drop some problematic/unreliable/stale rules
* baidu-ads: clean up
drop some problematic/unreliable/stale rules
* sohu-ads: clean up
drop some problematic/unreliable/stale rules
* tencent-ads: add more domains
* google-ads: add more domains
* category-ads: reinclude meta-ads
It should be safe to be included now.
This reverts commit 24c112a6e3.
* category-ads: add more domains
* Add ads attr for more domains
* category-companies: remove some unnecessary inclusion
anthropic, groq, openai, perplexity and xai are included in category-ai-!cn
* category-dev: merge imageglass and mpv
* category-media: remove inclusion of tver
tver is included in category-entertainment
* accuweather: add awxcdn.com
* taptap: add !cn attribute for taptap.io
* bluepoch: remove unnecessary cn attribute
bluepoch(-games) is only included by geolocation-cn/category-games-cn
* bilibili-game: remove unnecessary cn attribute
bilibili-game is only included by bilibili/category-games-cn
* category-entertainment: remove inclusion of mihoyo
mihoyo's non-cn part(hoyoverse) is already included via category-games-!cn
* mihoyo-cn: remove unnecessary cn attribute
mihoyo-cn is only included by mihoyo/category-games-cn
* tencent-games: remove unnecessary cn attribute
tencent-games is only included by tencent/category-games-cn
* category-electronic-cn: include jlc directly
jlc: add more domains
* bootcdn: merge bootcss
* category-bank-cn: remove redundant domain
ccb.com is included in ccb
* category-games-cn: remove improper domain
steampp.net is included in category-game-accelerator-cn
* category-scholar-cn: remove redundant domain
sslibrary.com is included in chaoxing
* category-securities-cn: cleanup and improve
gtja.com appears twice
include hsbc-cn
* 58tongcheng: cleanup
58corp.com appears twice
* qcloud: cleanup
tamaegis.com appears twice
* qihoo360: remove redundant domains
qiku is included in starworld
baomitu.com is included in 75team
* geolocation-cn: remove redundant domains/includes
citic is included in category-bank-cn
eleme is included in alibaba
wanfang is included in category-scholar-cn
sina is included in category-social-media-cn
sogou is included in sohu
188.com is included in netease
cankaoxiaoxi.com is included in category-media-cn
ctfile.com is included in category-netdisk-cn
duokanbox.com is included in xiaomi
elecfans.com is included in category-electronic-cn
jianguoyun.com is included in category-netdisk-cn
privateapi.xyz is included in category-collaborate-cn
MkQtSandGitHub
