It is currently March 29th, 2024, 1:50 pm



Post new topic Reply to topic  [ 8 posts ] 
Author Message
 Post subject: Allow RSS feed duplicates.
PostPosted: October 28th, 2015, 8:02 am 

Joined: September 15th, 2011, 12:04 am
Posts: 38
I just found out that if each one of http://website1.com/feed/, http://website2.com/feed/, http://website3.com/feed/ posts an entry with the same title, only the earliest of the three gets leeched/saved by themaleecher.

Please fix this and allow duplicates to be saved or leeched no matter how many there are. I am trying to monitor websites and I don't want to miss out on a single post they publish. Sometimes even if the title is the same, the content is different.

I see that you fixed this with "Topics" but forgot about RSS feeds:

Quote:
2.13:

* Added option when saving multiple messages to files and file with name already exists to add increment number at the end of the file name and don't ask again.


Top
 Profile  
Reply with quote  
 Post subject: Re: Please allow RSS feed duplicates!
PostPosted: October 28th, 2015, 8:08 am 
Site Admin
User avatar

Joined: March 10th, 2011, 11:14 pm
Posts: 12630
Location: Earth
Why would you want a duplicate message?

You already have the message, it doesn't make sense to leech the same message again.

That option which you quoting has nothing to do with topics. Duplicates are not leeched from anywhere.

_________________
themaPoster | themaCreator | themaManager | themaLeecher | themaRegister


Top
 Profile  
Reply with quote  
 Post subject: Re: Please allow RSS feed duplicates!
PostPosted: October 28th, 2015, 8:09 am 

Joined: September 15th, 2011, 12:04 am
Posts: 38
Quote:
I am trying to monitor websites and I don't want to miss out on a single post they publish. Sometimes even if the title is the same, the content is different.


For example, some blog owners don't care to indicate in the title if a release is a "Remastered Edition" or a "Proper" release but they put the edition or version in the description within the message. Besides, I don't leave all the work to themaposter. I still manually check the leeched messages and decide whether something is a duplicate or not. It's better if themaleecher leeches everything and let the user have the option to leech duplicates (or not) and check for duplicates manually later.


Last edited by techdaemon on October 28th, 2015, 8:18 am, edited 1 time in total.

Top
 Profile  
Reply with quote  
 Post subject: Re: Please allow RSS feed duplicates!
PostPosted: October 28th, 2015, 8:10 am 
Site Admin
User avatar

Joined: March 10th, 2011, 11:14 pm
Posts: 12630
Location: Earth
I don't really see how the title can be the same with different content, if it's a movie "Avengers" it will Avengers content, etc.

_________________
themaPoster | themaCreator | themaManager | themaLeecher | themaRegister


Top
 Profile  
Reply with quote  
 Post subject: Re: Please allow RSS feed duplicates!
PostPosted: October 28th, 2015, 8:22 am 
Site Admin
User avatar

Joined: March 10th, 2011, 11:14 pm
Posts: 12630
Location: Earth
If I won't check for duplicates you will have tons of duplicate messages with exactly the same content (or almost the same) because almost all websites re-post the same stuff.

Do you really want to do all that work manually? That seems a bit pointless for one extra "Remastered" message.

Would be better to just find better sources where they actually have normal titles or just skip that one message and don't bother.

Time is money after all. Checking manually each duplicate will just eat more time.

_________________
themaPoster | themaCreator | themaManager | themaLeecher | themaRegister


Top
 Profile  
Reply with quote  
 Post subject: Re: Please allow RSS feed duplicates!
PostPosted: October 28th, 2015, 8:35 am 

Joined: September 15th, 2011, 12:04 am
Posts: 38
I sent you a message further explaining the need for this option.

I actually leech from only a couple of websites and it's not very time consuming to sort the dupes out.

I don't see how it will hurt to just add the option to allow or disallow duplicates. It's on the discretion of the user to check or uncheck this option. If he chooses to enable, just add an incrementing number affixed to the title or something.

I am hoping that you will add it soon.


Last edited by techdaemon on October 28th, 2015, 8:40 am, edited 1 time in total.

Top
 Profile  
Reply with quote  
 Post subject: Re: Please allow RSS feed duplicates!
PostPosted: October 28th, 2015, 8:39 am 
Site Admin
User avatar

Joined: March 10th, 2011, 11:14 pm
Posts: 12630
Location: Earth
Might add (with being disabled by default).

_________________
themaPoster | themaCreator | themaManager | themaLeecher | themaRegister


Top
 Profile  
Reply with quote  
 Post subject: Re: Allow RSS feed duplicates.
PostPosted: November 10th, 2015, 7:38 am 
Site Admin
User avatar

Joined: March 10th, 2011, 11:14 pm
Posts: 12630
Location: Earth
2.21:
* Added setting for RSS feeds "Don't check for duplicate subjects (leech messages with the same subjects)." in "Options" -> RSS.

_________________
themaPoster | themaCreator | themaManager | themaLeecher | themaRegister


Top
 Profile  
Reply with quote  
Display posts from previous:  Sort by  
Post new topic Reply to topic  [ 8 posts ] 

Who is online

Users browsing this forum: No registered users and 29 guests


You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot post attachments in this forum

Search for:
Jump to:  
cron
Theme designed by stylerbb.net © 2008
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
All times are UTC