themaLeecher
http://leecher.themasoftware.com/forum/

Allow RSS feed duplicates.
http://leecher.themasoftware.com/forum/viewtopic.php?f=3&t=6157		 Page 1 of 1
Author:  techdaemon [ October 28th, 2015, 8:02 am ]
Post subject:  Allow RSS feed duplicates.
I just found out that if each one of http://website1.com/feed/, http://website2.com/feed/, http://website3.com/feed/ posts an entry with the same title, only the earliest of the three gets leeched/saved by themaleecher.

Please fix this and allow duplicates to be saved or leeched no matter how many there are. I am trying to monitor websites and I don't want to miss out on a single post they publish. Sometimes even if the title is the same, the content is different.

I see that you fixed this with "Topics" but forgot about RSS feeds:

Quote:
2.13:

* Added option when saving multiple messages to files and file with name already exists to add increment number at the end of the file name and don't ask again.
Author:  Freddy [ October 28th, 2015, 8:08 am ]
Post subject:  Re: Please allow RSS feed duplicates!
Why would you want a duplicate message?

You already have the message, it doesn't make sense to leech the same message again.

That option which you quoting has nothing to do with topics. Duplicates are not leeched from anywhere.
Author:  techdaemon [ October 28th, 2015, 8:09 am ]
Post subject:  Re: Please allow RSS feed duplicates!
Quote:
I am trying to monitor websites and I don't want to miss out on a single post they publish. Sometimes even if the title is the same, the content is different.


For example, some blog owners don't care to indicate in the title if a release is a "Remastered Edition" or a "Proper" release but they put the edition or version in the description within the message. Besides, I don't leave all the work to themaposter. I still manually check the leeched messages and decide whether something is a duplicate or not. It's better if themaleecher leeches everything and let the user have the option to leech duplicates (or not) and check for duplicates manually later.
Author:  Freddy [ October 28th, 2015, 8:10 am ]
Post subject:  Re: Please allow RSS feed duplicates!
I don't really see how the title can be the same with different content, if it's a movie "Avengers" it will Avengers content, etc.
Author:  Freddy [ October 28th, 2015, 8:22 am ]
Post subject:  Re: Please allow RSS feed duplicates!
If I won't check for duplicates you will have tons of duplicate messages with exactly the same content (or almost the same) because almost all websites re-post the same stuff.

Do you really want to do all that work manually? That seems a bit pointless for one extra "Remastered" message.

Would be better to just find better sources where they actually have normal titles or just skip that one message and don't bother.

Time is money after all. Checking manually each duplicate will just eat more time.
Author:  techdaemon [ October 28th, 2015, 8:35 am ]
Post subject:  Re: Please allow RSS feed duplicates!
I sent you a message further explaining the need for this option.

I actually leech from only a couple of websites and it's not very time consuming to sort the dupes out.

I don't see how it will hurt to just add the option to allow or disallow duplicates. It's on the discretion of the user to check or uncheck this option. If he chooses to enable, just add an incrementing number affixed to the title or something.

I am hoping that you will add it soon.
Author:  Freddy [ October 28th, 2015, 8:39 am ]
Post subject:  Re: Please allow RSS feed duplicates!
Might add (with being disabled by default).
Author:  Freddy [ November 10th, 2015, 7:38 am ]
Post subject:  Re: Allow RSS feed duplicates.
2.21:
* Added setting for RSS feeds "Don't check for duplicate subjects (leech messages with the same subjects)." in "Options" -> RSS.
Page 1 of 1 All times are UTC
Powered by phpBB © 2000, 2002, 2005, 2007 phpBB Group
http://www.phpbb.com/