Linux Format forums Forum Index Linux Format forums
Help, discussion, magazine feedback and more
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

eliminating spammers

 
Post new topic   Reply to topic    Linux Format forums Forum Index -> Off Topic
View previous topic :: View next topic  
Author Message
heiowge
LXF regular


Joined: Wed Feb 27, 2008 8:21 pm
Posts: 1901
Location: Cheshire, UK

PostPosted: Fri Sep 21, 2012 4:50 pm    Post subject: eliminating spammers Reply with quote

I want to create a search for the ton of spammers I get on another forum I admin.

We have a ton of people joining with addresses like:

fvwfg.d.g.v.b.dfd.ertg.sdv.sgv@gmail.com

There are a ton of these pillocks with lots of dots in their email address. Problem is that there are a ton of genuine users with gmail.com email addresses.

I can search by date, but I could really do with a search that pulls in people with lots of dots in their email address.

Any ideas?
_________________
i5 4440 3.1Ghz, Asus H87M-E motherboard, 8GB DDR3, 2GB DDR5 nVidia card, 2x500GB Seagate hd, Coolermaster 750W PSU running Mint 16 MATE and Win7

eeepc 1015PX, 1.66 Ghz Intel atom processor, 2 GB DDR3, 320 GB hd, Mint 14 MATE. Fan needs fixing.
Back to top
View user's profile Send private message
M-Saunders
LXF regular


Joined: Mon Apr 11, 2005 1:14 pm
Posts: 2893

PostPosted: Fri Sep 21, 2012 5:51 pm    Post subject: Reply with quote

What sort of checks do you perform when users sign up? Do they have to click a validation link in an email? Even with that step, we used to get loads of spammers on this forum. The most powerful defence, I found, was to put a Linux-specific question in the sign-up stage. It was really easy, but weeded out the spammers who had no idea what the forum was for (ie 99% of them).

M
Back to top
View user's profile Send private message Visit poster's website
Dutch_Master
LXF regular


Joined: Tue Mar 27, 2007 2:49 am
Posts: 2430

PostPosted: Fri Sep 21, 2012 5:56 pm    Post subject: Reply with quote

I had a similar problem earlier on one of my forums. That one uses a phpBB3 board, that has the option of having user's accounts manually activated by a moderator. I performed a whois on their IP and if it's not a regular western-European ISP, they're out. I did post a notice for any users who were from outside Europe to contact me directly via email. Not many did Razz I also have a captcha module and it asks questions, related to the subject of the forum. Plus, and that's a benefit of a non-English target audience, the questions are asked in a different language, one not easily mastered Wink

HTH!

PS: I manually removed all applicants and banned them by IP. It's a royal PITA, but eventually, after the questionnaire was introduced, the flood disappeared. I did get >250 applications for membership in just 10 days or so, of which 3 (at max) were genuine... Rolling Eyes
Back to top
View user's profile Send private message
heiowge
LXF regular


Joined: Wed Feb 27, 2008 8:21 pm
Posts: 1901
Location: Cheshire, UK

PostPosted: Fri Sep 21, 2012 7:37 pm    Post subject: Reply with quote

The checks are already in place. The problem is that all the new spam is coming from accounts set up before the advanced screenings came in. Since there are over 30000 accounts, I really don't want to go through them one by one. If I can search for these types I'll eliminate the biggest group of problem.

Oh, and it's not my forum. It's owned by a company. I just moderate and clean up. I have admin Privileges, but it's not my board to put new stuff on. I asked them to let me moderate signups and it was denied. All I can do is moderate posts and wipe out the morons. I can, however, wipe out anyone who I believe is a spammer before they spam.

Only an demi-god, not a full god. Laughing
_________________
i5 4440 3.1Ghz, Asus H87M-E motherboard, 8GB DDR3, 2GB DDR5 nVidia card, 2x500GB Seagate hd, Coolermaster 750W PSU running Mint 16 MATE and Win7

eeepc 1015PX, 1.66 Ghz Intel atom processor, 2 GB DDR3, 320 GB hd, Mint 14 MATE. Fan needs fixing.
Back to top
View user's profile Send private message
heiowge
LXF regular


Joined: Wed Feb 27, 2008 8:21 pm
Posts: 1901
Location: Cheshire, UK

PostPosted: Fri Sep 21, 2012 10:02 pm    Post subject: Reply with quote

sysyphus.jones off the Sixgun forum (those Linux Outlaw lads' forum) pointed me here, that's got some sweet email addresses that can be added to the ban list. 10s of thousands of known spammer emails and over 100,000 spammer IPs. Very Happy

http://www.streetsie.com/phpbb-email-banlist/
_________________
i5 4440 3.1Ghz, Asus H87M-E motherboard, 8GB DDR3, 2GB DDR5 nVidia card, 2x500GB Seagate hd, Coolermaster 750W PSU running Mint 16 MATE and Win7

eeepc 1015PX, 1.66 Ghz Intel atom processor, 2 GB DDR3, 320 GB hd, Mint 14 MATE. Fan needs fixing.
Back to top
View user's profile Send private message
Dutch_Master
LXF regular


Joined: Tue Mar 27, 2007 2:49 am
Posts: 2430

PostPosted: Sat Sep 22, 2012 12:14 am    Post subject: Reply with quote

Ah yes, the sleepy spammer accounts. Most of those have 0 posts to begin with (or a small amount) so selecting those will weed out genuine users who actively take part. I don't know much about databases, so can't tell you how wildcards are handled, but if you can use them, issue search strings like *.*.*.*.*.@gmail and reduce by a single wildcard at a time to find the "excessively dotted" addresses.
Back to top
View user's profile Send private message
heiowge
LXF regular


Joined: Wed Feb 27, 2008 8:21 pm
Posts: 1901
Location: Cheshire, UK

PostPosted: Sat Sep 22, 2012 9:57 am    Post subject: Reply with quote

Dutch_Master wrote:
, issue search strings like *.*.*.*.*.@gmail


I tried that exact search with a small window of time (so as not to overload things) and got tons of false positives. I need a search with no false positives. Confused
_________________
i5 4440 3.1Ghz, Asus H87M-E motherboard, 8GB DDR3, 2GB DDR5 nVidia card, 2x500GB Seagate hd, Coolermaster 750W PSU running Mint 16 MATE and Win7

eeepc 1015PX, 1.66 Ghz Intel atom processor, 2 GB DDR3, 320 GB hd, Mint 14 MATE. Fan needs fixing.
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8455
Location: Warrington, UK

PostPosted: Sat Sep 22, 2012 11:12 am    Post subject: Reply with quote

That's probably because in some regexp flavours . matches any character, so you'd need to escape the dots and search for *\.*\.*\.*@gmail
_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
heiowge
LXF regular


Joined: Wed Feb 27, 2008 8:21 pm
Posts: 1901
Location: Cheshire, UK

PostPosted: Sat Sep 22, 2012 1:31 pm    Post subject: Reply with quote

Tried that. I got this:


Information

No users fit the selected criteria.
_________________
i5 4440 3.1Ghz, Asus H87M-E motherboard, 8GB DDR3, 2GB DDR5 nVidia card, 2x500GB Seagate hd, Coolermaster 750W PSU running Mint 16 MATE and Win7

eeepc 1015PX, 1.66 Ghz Intel atom processor, 2 GB DDR3, 320 GB hd, Mint 14 MATE. Fan needs fixing.
Back to top
View user's profile Send private message
nelz
Site admin


Joined: Mon Apr 04, 2005 12:52 pm
Posts: 8455
Location: Warrington, UK

PostPosted: Sat Sep 22, 2012 7:54 pm    Post subject: Reply with quote

What are you using to search? Grep, sed, SQL? They all have different regex rules.
_________________
"Insanity: doing the same thing over and over again and expecting different results." (Albert Einstein)
Back to top
View user's profile Send private message
heiowge
LXF regular


Joined: Wed Feb 27, 2008 8:21 pm
Posts: 1901
Location: Cheshire, UK

PostPosted: Sat Sep 22, 2012 9:34 pm    Post subject: Reply with quote

I'm just using the admin panel in the board (phpbb)
_________________
i5 4440 3.1Ghz, Asus H87M-E motherboard, 8GB DDR3, 2GB DDR5 nVidia card, 2x500GB Seagate hd, Coolermaster 750W PSU running Mint 16 MATE and Win7

eeepc 1015PX, 1.66 Ghz Intel atom processor, 2 GB DDR3, 320 GB hd, Mint 14 MATE. Fan needs fixing.
Back to top
View user's profile Send private message
View previous topic :: View next topic  
Display posts from previous:   
Post new topic   Reply to topic    Linux Format forums Forum Index -> Off Topic All times are GMT
Page 1 of 1

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
Linux Format forums topic RSS feed 


Powered by phpBB © 2001, 2005 phpBB Group


Copyright 2011 Future Publishing, all rights reserved.


Web hosting by UKFast