update Piwik to version 2.16 (fixes #91)

This commit is contained in:
oliver 2016-04-10 18:55:57 +02:00
commit d885a4baa9
5833 changed files with 418860 additions and 226988 deletions

View file

@ -0,0 +1,13 @@
# Contributing
To add a new referrer spammer to the list, [click here to edit the spammers.txt file](https://github.com/piwik/referrer-spam-blacklist/edit/master/spammers.txt) and create a pull request. Alternatively you can create a [new issue](https://github.com/piwik/referrer-spam-blacklist/issues/new).
If you open a pull request, please:
- **add one new domain per pull request**
- explain where the referrer domain appeared and why you think it is a spammer
- name the pull request in the format `Add xxx.yyy` so that it's easy to manage duplicates (for example `Add cyber-monday.ga`)
- keep the list ordered alphabetically
- use [Linux line endings](http://en.wikipedia.org/wiki/Newline)
Please [search](https://github.com/piwik/referrer-spam-blacklist/issues?utf8=%E2%9C%93&q=is%3Aopen+) if somebody already reported the host before opening a new one.

View file

@ -0,0 +1,89 @@
This is a community-contributed list of [referrer spammers](http://en.wikipedia.org/wiki/Referer_spam) maintained by [Piwik](http://piwik.org/), the leading open source web analytics platform.
## Usage
The list is stored in this repository in `spammers.txt`. This text file contains one host per line.
You can [download this file manually](https://github.com/piwik/referrer-spam-blacklist/blob/master/spammers.txt), download the [whole folder as zip](https://github.com/piwik/referrer-spam-blacklist/archive/master.zip) or clone the repository using git:
```
git clone https://github.com/piwik/referrer-spam-blacklist.git
```
### PHP
If you are using PHP, you can also install the list through Composer:
```
composer require piwik/referrer-spam-blacklist
```
Parsing the file should be pretty easy using your favorite language. Beware that the file can contain empty lines.
Here is an example using PHP:
```php
$list = file('spammers.txt', FILE_IGNORE_NEW_LINES | FILE_SKIP_EMPTY_LINES);
```
### Nginx
Nginx's `server` block can be configured to check the referer and return an error:
```nginx
if ($http_referer ~ '0n-line.tv') {return 403;}
if ($http_referer ~ '100dollars-seo.com') {return 403;}
...
```
When combined, list exceeds the max length for a single regex expression, so hosts must be broken up as shown above.
Here is a bash script to create an nginx conf file:
```bash
sort spammers.txt | uniq | sed 's/\./\\\\./g' | while read host;
do
echo "if (\$http_referer ~ '$host') {return 403;}" >> /etc/nginx/referer_spam.conf
done;
```
you would then `include /etc/nginx/referer_spam.conf;` inside your `server` block
Now as a daily cron job so the list stays up to date:
```bash
0 0 * * * cd /etc/nginx/referrer-spam-blacklist/ && git pull > /dev/null && echo "" > /etc/nginx/referer_spam.conf && sort spammers.txt | uniq | sed 's/\./\\\\\\\\./g' | while read host; do echo "if (\$http_referer ~ '$host') {return 403;}" >> /etc/nginx/referer_spam.conf; done; service nginx reload > /dev/null
```
### In Piwik
This list is included in each [Piwik](http://piwik.org) release so that referrer spam is filtered automatically. Piwik will also automatically update this list to its latest version every week.
## Contributing
To add a new referrer spammer to the list, [click here to edit the spammers.txt file](https://github.com/piwik/referrer-spam-blacklist/edit/master/spammers.txt) and create a pull request. Alternatively you can create a [new issue](https://github.com/piwik/referrer-spam-blacklist/issues/new). In your issue or pull request please explain where the referrer domain appeared and why you think it is a spammer. **Please open one pull request per new domain**.
If you open a pull request, it is appreciated if you keep one hostname per line, keep the list ordered alphabetically, and use [Linux line endings](http://en.wikipedia.org/wiki/Newline).
Please [search](https://github.com/piwik/referrer-spam-blacklist/issues) if somebody already reported the host before opening a new one.
### Subdomains
Piwik does sub-string matching on domain names from this list, so adding `semalt.com` is enough to block all subdomain referrers too, such as `semalt.semalt.com`.
However, there are cases where you'd only want to add a subdomain but not the root domain. For example, add `referrerspammer.tumblr.com` but not `tumblr.com`, otherwise all `*.tumblr.com` sites would be affected.
### Sorting
To keep the list sorted the same way across forks it is recommended to let the computer do the sorting. The list follows the merge sort algorithm as implemented in [sort](https://en.wikipedia.org/wiki/Sort_(Unix)). You can use sort to both sort the list and filter out doubles:
```
sort -uf -o spammers.txt spammers.txt
```
## Disclaimer
This list of Referrer spammers is contributed by the community and is provided as is. Use at your own discretion: it may be incomplete (although we aim to keep it up to date) and it may contain outdated entries (let us know if a hostname was added but is not actually a spammer).
## License
Public Domain (no copyright).

View file

@ -0,0 +1,5 @@
{
"name": "piwik/referrer-spam-blacklist",
"description": "Community-contributed list of referrer spammers",
"license": "Public Domain"
}

View file

@ -0,0 +1,329 @@
0n-line.tv
100dollars-seo.com
12masterov.com
1pamm.ru
1webmaster.ml
2your.site
4webmasters.org
5forex.ru
7makemoneyonline.com
7zap.com
acads.net
acunetix-referrer.com
adcash.com
adf.ly
adspart.com
adventureparkcostarica.com
adviceforum.info
affordablewebsitesandmobileapps.com
afora.ru
akuhni.by
alibestsale.com
allknow.info
allnews.md
allwomen.info
alpharma.net
altermix.ua
amt-k.ru
anal-acrobats.hol.es
anapa-inns.ru
android-style.com
anticrawler.org
arendakvartir.kz
arkkivoltti.net
artparquet.ru
aruplighting.com
autovideobroadcast.com
aviva-limoux.com
azartclub.org
baixar-musicas-gratis.com
baladur.ru
balitouroffice.com
bard-real.com.ua
best-seo-offer.com
best-seo-software.xyz
best-seo-solution.com
bestmobilityscooterstoday.com
bestwebsitesawards.com
bif-ru.info
biglistofwebsites.com
billiard-classic.com.ua
bizru.info
black-friday.ga
blackhatworth.com
blogtotal.de
blue-square.biz
bluerobot.info
brakehawk.com
break-the-chains.com
brk-rti.ru
brothers-smaller.ru
budmavtomatika.com.ua
burger-imperia.com
buttons-for-website.com
buttons-for-your-website.com
buy-cheap-online.info
buy-forum.ru
cardiosport.com.ua
cartechnic.ru
cenokos.ru
cenoval.ru
cezartabac.ro
chinese-amezon.com
ci.ua
cityadspix.com
civilwartheater.com
clicksor.com
coderstate.com
codysbbq.com
conciergegroup.org
connectikastudio.com
copyrightclaims.org
covadhosting.biz
cubook.supernew.org
customsua.com.ua
cyber-monday.ga
dailyrank.net
darodar.com
dbutton.net
delfin-aqua.com.ua
demenageur.com
descargar-musica-gratis.net
detskie-konstruktory.ru
dipstar.org
djekxa.ru
dktr.ru
dojki-hd.com
domination.ml
doska-vsem.ru
dostavka-v-krym.com
drupa.com
dvr.biz.ua
e-buyeasy.com
e-kwiaciarz.pl
ecomp3.ru
econom.co
edakgfvwql.ru
egovaleo.it
ekto.ee
elmifarhangi.com
erot.co
escort-russian.com
este-line.com.ua
euromasterclass.ru
europages.com.ru
eurosamodelki.ru
event-tracking.com
fast-wordpress-start.com
fbdownloader.com
floating-share-buttons.com
for-your.website
forex-procto.ru
forsex.info
forum69.info
free-floating-buttons.com
free-share-buttons.com
free-social-buttons.com
freewhatsappload.com
fsalas.com
generalporn.org
germes-trans.com
get-free-social-traffic.com
get-free-traffic-now.com
get-your-social-buttons.info
ghazel.ru
girlporn.ru
gkvector.ru
glavprofit.ru
gobongo.info
goodprotein.ru
googlemare.com
googlsucks.com
guardlink.org
handicapvantoday.com
hdmoviecamera.net
hongfanji.com
hosting-tracker.com
howopen.ru
howtostopreferralspam.eu
hulfingtonpost.com
humanorightswatch.org
hundejo.com
hvd-store.com
ico.re
igru-xbox.net
iloveitaly.ro
iloveitaly.ru
ilovevitaly.co
ilovevitaly.com
ilovevitaly.info
ilovevitaly.org
ilovevitaly.ru
iminent.com
imperiafilm.ru
investpamm.ru
iskalko.ru
ispaniya-costa-blanca.ru
it-max.com.ua
jjbabskoe.ru
justprofit.xyz
kabbalah-red-bracelets.com
kambasoft.com
kazrent.com
kino-fun.ru
kino-key.info
kinopolet.net
knigonosha.net
konkursov.net
laxdrills.com
littleberry.ru
livefixer.com
lsex.xyz
luxup.ru
makemoneyonline.com
manualterap.roleforum.ru
maridan.com.ua
masterseek.com
mebelcomplekt.ru
mebeldekor.com.ua
med-zdorovie.com.ua
minegam.com
mirobuvi.com.ua
mirtorrent.net
mobilemedia.md
moyakuhnia.ru
muscle-factory.com.ua
myftpupload.com
niki-mlt.ru
novosti-hi-tech.ru
nufaq.com
o-o-6-o-o.com
o-o-6-o-o.ru
o-o-8-o-o.com
o-o-8-o-o.ru
online-hit.info
onlinetvseries.me
onlywoman.org
ooo-olni.ru
ozas.net
palvira.com.ua
petrovka-online.com
photokitchendesign.com
pizza-imperia.com
pizza-tycoon.com
pops.foundation
pornhub-forum.ga
pornhub-forum.uni.me
pornhub-ru.com
pornoforadult.com
portnoff.od.ua
pozdravleniya-c.ru
priceg.com
pricheski-video.com
prlog.ru
producm.ru
prodvigator.ua
prointer.net.ua
promoforum.ru
psa48.ru
qualitymarketzone.com
quit-smoking.ga
qwesa.ru
rankings-analytics.com
ranksonic.info
ranksonic.net
ranksonic.org
rapidgator-porn.ga
rcb101.ru
rednise.com
research.ifmo.ru
resellerclub.com
reversing.cc
rightenergysolutions.com.au
rospromtest.ru
rusexy.xyz
sady-urala.ru
sanjosestartups.com
santasgift.ml
savetubevideo.com
screentoolkit.com
scripted.com
search-error.com
semalt.com
semaltmedia.com
seo-platform.com
seo-smm.kz
seoanalyses.com
seoexperimenty.ru
seopub.net
sexyali.com
sexyteens.hol.es
share-buttons.xyz
sharebutton.net
sharebutton.to
shop.xz618.com
sibecoprom.ru
simple-share-buttons.com
siteripz.net
sitevaluation.org
sledstvie-veli.net
slftsdybbg.ru
slkrm.ru
smailik.org
snip.to
snip.tw
soaksoak.ru
social-buttons.com
socialseet.ru
sohoindia.net
solnplast.ru
sosdepotdebilan.com
spravka130.ru
steame.ru
success-seo.com
superiends.org
taihouse.ru
tattooha.com
tedxrj.com
theguardlan.com
tomck.com
top1-seo-service.com
topseoservices.co
traffic2cash.org
traffic2cash.xyz
traffic2money.com
trafficgenius.xyz
trafficmonetize.org
trafficmonetizer.org
trion.od.ua
uasb.ru
uptimechecker.com
uzungil.com
video--production.com
video-woman.com
videos-for-your-business.com
viel.su
viktoria-center.ru
vodaodessa.com
vodkoved.ru
w3javascript.com
webmaster-traffic.com
webmonetizer.net
website-analyzer.info
websites-reviews.com
websocial.me
wmasterlead.com
wordpress-crew.net
ykecwqlixx.ru
youporn-forum.ga
youporn-forum.uni.me
youporn-ru.com
yourserverisdown.com
zastroyka.org
грузоподъемные-машины.рф
лечениенаркомании.com
непереводимая.рф
профмонтаж-врн.рф
снятьдомвсевастополе.рф
холодныйобзвон.рф
годом.рф