-
Notifications
You must be signed in to change notification settings - Fork 7
/
template
157 lines (108 loc) · 7.14 KB
/
template
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
<div align="center">
##### In this Repo, I've created a shell script to automate the process of collecting and compiling all the Hosts from various sources, then cleaning and optimizing it to be used in ["PersonalDNSfilter"](https://www.zenz-solutions.de/personaldnsfilter/)
##### This collection is suitable for blocking the domains containing ads, tracking, malware, phishing, ransomware, spyware, trojans and virus (for PC and Smartphones).
#### ℹ️ Updates & News 📢
<h4 align="left">
2021/07/27
📌 Added support for converting sources from [AdBlockPlus/uBlock/AdGuard] format to Domains/Hosts format!
📌 Added many new sources!
📌 Improved the code to reduce false positives.
</h4>
<details>
<summary>Expand to see previous changes!</summary>
<h4 align="left">
2021/07/18
📌 Improved checking TLDs of domains + fixes
📌 Implemented "idna to dns (utf8)" converting function for domains and TLDs.
📌 Optimized the code speed.
📌 Added support for checking more TLDs (IANA / Blockchain-registered / OpenNIC / FurNIC / Emercoin / New Nations / Onion).
2021/07/10
📌 Implemented personal Allow-List for falsely blocked domains.
2021/07/03
📌 Implemented parallel downloading of sources.(disabled by default due to github limitations)
📌 Separated the sources list from code.
2021/03/18
📌 Improved removing redundant subdomains! (thanks @badmojr for reporting 😉)
2021/03/15
📌 Implemented removing redundant subdomains!
📌 Greatly reduced blocklist size without affecting the quality!(same blocking power)
📌 The original blocklist (without whitelisting / subdomains removing) is also available in Section "B: (Manual Method)"
2021/03/13
📌 Implemented Whitelisting: For now I apply mkb2091's whitelist source!
📌 Also, the original Hosts is preserved, too (without applying whitelists)↩️
You can find it in Section "B: (Manual Method)"
📌 To get statistics about the (input) sources used in this Repo, check 'stats' file.
📌 The previous Hosts releases and backups of the input sources (in compressed format)↩️
can be found in 'Releases' page, under tha tag 'v1.0.0-backup'.
</h4>
</details>
<br>
</br>
### ⚠️ Disclaimer:
<details>
<summary>Click to expand!</summary>
The Hosts sources that are used in this Repository, have their own Licenses. The links of the HOSTS sources that are used in this repo (which includes their own licenses) can be found here: ["sources.conf"](https://github.com/j-moriarti/pDNSf-Hosts-collection/blob/master/sources.conf). The compiled hosts in this Repo are meant for my personal usage only. I have no responsibility about others misusing of these files.
###### ⚠️YOU HAVE BEEN WARNED⚠️ :wink:
</details>
#### ℹ️ Notes:
<details>
<summary>Click to expand!</summary>
This hosts file is specially optimized for ["PersonalDNSfilter"](https://www.zenz-solutions.de/personaldnsfilter/) app. This [Open-Source](https://github.com/IngoZenz/personaldnsfilter) app can handle Huge number of Domains without affecting on battery or ram usage! So there would be no problems adding these hosts to it!
###### !!! THIS HOSTS FILE IS EXTREMELY LARGE, and only pDNSf can easily handle it !!!
###### !!! Although applied whitelists to remove falsely blocked domains, but There may be a possibility of FALSE-POSITIVE or UNWANTED BLOCKING !!!
###### !!! Be prepared for manual whitelisting in pDNSf !!!
###### !!!YOU HAVE BEEN WARNED AGAIN!!!
</details>
<br>
</br>
#### ℹ️ Hosts Info
<h4>
[Original Blocklist]
Blocked Domains: _originalhostsnum_
Blocklist size: _originalhostssize_
[Optimized Blocklist 🚀]
Blocked Domains: _hostsnum_
Blocklist size: _hostssize_
Number of Blocked IPs: _ipnum_
IP Blocklist size: _ipsize_
Auto Updates: Every 24 hours
</h4>
<br>
</br>
### A: (Set & Forget Method)
### Download Hosts in multi-part (Domains-only Format)
(Add these links directly to pDNSf config)
(Additionally, you also can add IP blocklist.(links can be found at 'Extra Hosts' table below))
| Name | Download Link | Mirror Link | Size |
|:----:|:-------:|:-------:|:-------:|
| pDNSf-hosts-part0.txt | [Domains (Part 0)](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/pDNSf-hosts-part0.txt) | [Mirror (Part 0)](https://www.dl.dropboxusercontent.com/s/9jpe80edva776ei/pDNSf-hosts-part0.txt?dl=1) | _part0size_ |
| pDNSf-hosts-part1.txt | [Domains (Part 1)](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/pDNSf-hosts-part1.txt) | [Mirror (Part 1)](https://www.dl.dropboxusercontent.com/s/d1x9nrjn8wmdgkn/pDNSf-hosts-part1.txt?dl=1) | _part1size_ |
| pDNSf-hosts-part2.txt | [Domains (Part 2)](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/pDNSf-hosts-part2.txt) | [Mirror (Part 2)](https://www.dl.dropboxusercontent.com/s/500rbwazmyotd5c/pDNSf-hosts-part2.txt?dl=1) | _part2size_ |
<br>
</br>
### B: (Manual Method)
### Download GZip Compressed Hosts (Domains-only Format)
(First, download and extract (uncompress) 'pDNSf-hosts.txt.gz' to somewhere, then add the LOCAL PATH of 'pDNSf-hosts.txt' to pDNSf config)
| Name | Download Link | Mirror Link | Size |
|:----:|:-------:|:-------:|:-------:|
| pDNSf-hosts.txt.gz | [Download](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/pDNSf-hosts.txt.gz) | [Mirror](https://www.dl.dropboxusercontent.com/s/0qkl500uldf0ryo/pDNSf-hosts.txt.gz) | _gzsize_ |
| pDNSf-hosts_no-whitelist.txt.gz | [Download](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/pDNSf-hosts_no-whitelist.txt.gz) | [Mirror](https://www.dl.dropboxusercontent.com/s/b1dzuemxspu7j73/pDNSf-hosts_no-whitelist.txt.gz?dl=1) | _originalgzsize_ |
ℹ️ Notes:
<details>
<summary>Click to expand!</summary>
<h4 align="left">
📌 Example of a LOCAL PATH format in pDNSf:
PC version: file:///D:/Downloads folder/pDNSf-hosts.txt
Mobile version: file:///sdcard/Downloads/pDNSf-hosts.txt
📌 Use "pDNSf-hosts_no-whitelist.txt.gz" if you want to use the Hosts without applying "whitelists" or "redundant subdomains removing".
</h4>
</details>
<br>
</br>
### Download Extra Hosts (IPs-only & Domains-only Format)
| Name | Download Link | Mirror Link | Size | # of Lines |
|:---------:|:-------:|:--------:|:-------:|:-------:|
| CIDR-IPs Block-List | [Download](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/CIDR-IPs.txt) | [Mirror](https://www.dl.dropboxusercontent.com/s/ef6ya9o2wf0rqy0/CIDR-IPs.txt?dl=1) | _cidrsize_ | _cidrnum_ |
| Wildcard Block-List | [Download](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/Wildcards.txt) | [Mirror](https://www.dl.dropboxusercontent.com/s/v1hdmolkekzevhl/Wildcards.txt) | _wildcardsize_ | _wildcardnum_ |
| IP Addresses Block-List | [Download](https://github.com/j-moriarti/pDNSf-Hosts-collection/releases/download/v1.0.0/just-IPs.txt) | [Mirror](https://www.dl.dropboxusercontent.com/s/r7685b8ahxhro2d/just-IPs.txt?dl=1) | _ipsize_ | _ipnum_ |
</div>