FeedDotNet Work Item Rss Feed

COMMENTED ISSUE: Property named "published" and "updated" is not worked in lasted updated dll

Kostik — Thu, 25 Oct 2007 12:53:08 GMT

Hi,

Property named "published" and "updated" is not worked in last updated dll.

for some Rss files "published" date is found with dll while for some rss files "published" date is not found with dll

i use following rss url :
http://finance.yahoo.com/rss/headline?s=XLNX

pl help me for this problem

Regards,

Nmraja
Comments: ** Comment from web user: Kostik **

Do you mean when? As soon as there will be more bug/bugfixes. What compile errors do you get exactly?
Konstantin

COMMENTED ISSUE: Property named "published" and "updated" is not worked in lasted updated dll

nmraja — Tue, 23 Oct 2007 04:27:52 GMT

Thanking u for reply.
Where will u release of FeedDotNet ?

COMMENTED ISSUE: Property named "published" and "updated" is not worked in lasted updated dll

nmraja — Tue, 23 Oct 2007 04:26:29 GMT

Thanking you for such reply.
Pl say me ,where will u release this FeedDotNet? Beacause, your source code give errors during building porject.

COMMENTED ISSUE: Property named "published" and "updated" is not worked in lasted updated dll

Kostik — Mon, 22 Oct 2007 09:28:23 GMT

Hi and thank you for rising this issue. That's a bug in the System.DateTime.TryParse() method. Your feed has a special date format in the <pubDate> element, like this: Thu, 18 Oct 2007 21:03:29 Etc/GMT. To fix this, just add following line to the static constructor of the FeedDotNet.Utilities.DTHelper class:

timeZones.Add("ETC/GMT","+0000");

I will also inculde this fix in the next release of FeedDotNet.

CREATED ISSUE: Property named "published" and "updated" is not worked in lasted updated dll

nmraja — Sat, 20 Oct 2007 07:04:59 GMT

COMMENTED ISSUE: Parsing Error on some feed

ncornu — Tue, 09 Oct 2007 21:27:21 GMT

http://www.motomag.com/spip/backend-breves.php3?id_rubrique=1
http://www.mondesvirtuels.info/backend.php?op=RSS2.0
http://flux.jeuxonline.info/actualites.rss
http://www.gentoo.fr/securite/alertes-securite.rss
http://gentoofr.org/backend.php3
http://www.games4linux.eu/spip.php?page=backend&id_rubrique=1
http://www.clubic.com/xml/demo.xml
http://www.debianaddict.org/backend.php3
http://www.abondance.com/rss/rss.xml
http://www.cafebabel.com/fr/babel_rss.xml
http://www.tf1.fr/xml/rss/0,,9,00.xml
http://archlinux.fr/index.php?option=com_rss&feed=RSS2.0&no_html=1
http://www.jeuxvideo.fr/xml/tout.xml
http://www.actumoto.fr/feed/
http://www.actu-mmorpg.com/index2.php?option=com_rss&feed=RSS2.0&no_html=1
http://www.krissnature.net/atom.php
http://www.latribune.fr/Cobrand/Articles.nsf/Articles.rss?OpenView&Channel=Bourse
http://www.easybourse.com/RSS/easybourse-rss-news-fr.rss
Comments: ** Comment from web user: ncornu **

Yes i tried with a different UserAgent without success.
Thanks for the new method.

I use FeedDotNet on linux using mono 1.2.5.1, i get errors. I will update mono when new release come out. With other Feed library i had less errors.
Extract of the Error log:

2007-10-09 23:00:33,333 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.jeuxvideo.fr/xml/tout.xml System.UriFormatException: Invalid URI: The format of the URI could not be determined.
at System.Uri..ctor (System.String uriString, UriKind uriKind) [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:33,849 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.actumoto.fr/feed/ System.NotImplementedException: The requested feature is not implemented.
at System.UriParser.IsWellFormedOriginalString (System.Uri uri) [0x00000]
at System.Uri.IsWellFormedOriginalString () [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:34,108 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.actu-mmorpg.com/index2.php?option=com_rss&feed=RSS2.0&no_html=1 System.UriFormatException: Invalid URI: The format of the URI could not be determined.
at System.Uri..ctor (System.String uriString, UriKind uriKind) [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:34,125 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.krissnature.net/atom.php System.NotImplementedException: The requested feature is not implemented.
at System.UriParser.IsWellFormedOriginalString (System.Uri uri) [0x00000]
at System.Uri.IsWellFormedOriginalString () [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.AtomParser.readEntry (System.Xml.XmlReader subReader) [0x00000]
at FeedDotNet.AtomParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:41,645 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.latribune.fr/Cobrand/Articles.nsf/Articles.rss?OpenView&Channel=Bourse System.UriFormatException: Invalid URI: The format of the URI could not be determined.
at System.Uri..ctor (System.String uriString, UriKind uriKind) [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:41,778 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.easybourse.com/RSS/easybourse-rss-news-fr.rss System.UriFormatException: Invalid URI: The format of the URI could not be determined.
at System.Uri..ctor (System.String uriString, UriKind uriKind) [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:47,949 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.dotnet-project.com/dpRss.aspx System.NullReferenceException: Object reference not set to an instance of an object
at System.Uri.IsWellFormedOriginalString () [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:48,036 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.techheadbrothers.com/rss.aspx?id=news System.NullReferenceException: Object reference not set to an instance of an object
at System.Uri.IsWellFormedOriginalString () [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]
2007-10-09 23:00:53,817 [-1210541360] ERROR FeedCrawler.Program [(null)] - Error parsing the feed, Feed url: http://www.notre-planete.info/news/news.xml System.UriFormatException: Invalid URI: The format of the URI could not be determined.
at System.Uri..ctor (System.String uriString, UriKind uriKind) [0x00000]
at System.Uri.IsWellFormedUriString (System.String uriString, UriKind uriKind) [0x00000]
at FeedDotNet.RssParser.Parse () [0x00000]
at FeedDotNet.FeedReader.Read (System.String uri, FeedDotNet.FeedReaderSettings settings) [0x00000]

I will use the new method later, ignore the feed on error that need custom http headers.

Thanks again.

COMMENTED ISSUE: Parsing Error on some feed

Kostik — Mon, 08 Oct 2007 11:04:16 GMT

The feed
http://www.actu-mmorpg.com/index2.php?option=com_rss&feed=RSS2.0&no_html=1
requires no UserAgent-header OR requires both UserAgent+Accept headers. Please check the updated FeedReaderSettings class (FeedDotNet ver. 1.2.1.1). It now has 3 new members:
string HttpUserAgentString
string HttpAcceptString
Dictionary<HttpRequestHeader, string> HttpHeaders

Defaults of HttpUserAgentString and HttpAcceptString are set to the browser defaults, so that we can simulate a real browser agent (some feeds, thereunder http://www.actu-mmorpg.com/index2.php?option=com_rss&feed=RSS2.0&no_html=1 require this behavior). If you are still in situations where your browser (or other feed agent/library) shows a feed as expected, but the FeedDotNet doesn't, you can experiment with adding of custom Http-headers to the HttpHeaders-collection.

Not valid XML document: xml declaration not at start of external entity:
http://www.motomag.com/spip/backend-breves.php3?id_rubrique=1

No errors found:
http://www.mondesvirtuels.info/backend.php?op=RSS2.0
http://flux.jeuxonline.info/actualites.rss
http://www.gentoo.fr/securite/alertes-securite.rss
http://gentoofr.org/backend.php3
http://www.games4linux.eu/spip.php?page=backend&id_rubrique=1
http://www.clubic.com/xml/demo.xml
http://www.debianaddict.org/backend.php3
http://www.abondance.com/rss/rss.xml
http://www.cafebabel.com/fr/babel_rss.xml
http://www.tf1.fr/xml/rss/0,,9,00.xml
http://archlinux.fr/index.php?option=com_rss&feed=RSS2.0&no_html=1
http://www.jeuxvideo.fr/xml/tout.xml
http://www.actumoto.fr/feed/
http://www.krissnature.net/atom.php
http://www.latribune.fr/Cobrand/Articles.nsf/Articles.rss?OpenView&Channel=Bourse
http://www.easybourse.com/RSS/easybourse-rss-news-fr.rss

COMMENTED ISSUE: Parsing Error on some feed

Kostik — Mon, 08 Oct 2007 11:01:45 GMT

Not valid XML document: xml declaration not at start of external entity:
http://www.motomag.com/spip/backend-breves.php3?id_rubrique=1

CREATED ISSUE: Parsing Error on some feed

ncornu — Fri, 05 Oct 2007 13:41:01 GMT

COMMENTED ISSUE: content:encoded

Kostik — Fri, 13 Jul 2007 09:56:14 GMT

Feeds that use content:encoded to store the full content of a post have the content being truncated so when I go to process the data in item.Content, the text is truncated with the trailing [...] leading me to believe feeds with content:encoded are storing the content from the feed's description element in the item.Content property.
Comments: ** Comment from web user: Kostik **

Take a look the latest release (1.1.1.0) - I've implemented "Content" module, so that <content:encoded> should now be available (over FeedItem.ModuleItems). Check ClientApplication to see how it works..

COMMENTED ISSUE: content:encoded

abrudtkuhl — Wed, 11 Jul 2007 21:40:35 GMT

My original thought was that this may be a result on Line 62 in the Complete() method of Parser.cs that corrects feeds that use summary as content.

But, after stepping through the client application it appears that RssParser.cs is not handling this correctly. It is setting the feedItem.Content to the description and not handling <content:encoded> at all. It tries to handle it in the readModules (due to the default case).

So, should this be added as a case and corrected so that description gets saved to the correct property (feedItem.Summary) and <content:encoded> be saved to be feedItem.Content.

Not sure the best way to handle this. What do you think Kostik?

- Andy

CREATED ISSUE: content:encoded

abrudtkuhl — Wed, 11 Jul 2007 20:43:26 GMT