-
web_feed_importer.js erroring out
From
Kurisu@VERT/FINALZON to
All on Sun Oct 18 17:09:25 2020
I just learned of this script thanks to another post here on Dovenet and I went through the process of setting up the modopts feed options and the timed event.ããIn attempting to run the event, however, I get error notifications and no joy on data being imported.ããThe text in the error log is as follows:ããSun Oct 18 17:03:15 2020ãevnt FEEDIMP !JavaScript C:\sbbs\exec\web_feed_importer.js line 1: SyntaxError: illegal characterããSun Oct 18 17:03:15 2020ãevnt FEEDIMP !ERROR 2 (No such file or directory) (WinError 0) in exec.cpp line 668 (sbbs_t::js_execfile) compiling "C:\sbbs\exec\web_feed_importer.js" access=0ããSun Oct 18 17:03:15 2020ãevnt FEEDIMP Timed event: FEEDIMP returned -1ããI know bugger all of Javascript or much else programming wise, so I can't even begin to debug this myself - my first thoughts lead nowhere so now to ask you fellow hackers for help.ããThanks.ã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
Digital Man@VERT to
Kurisu on Sun Oct 18 18:13:40 2020
Re: web_feed_importer.js erroring outã By: Kurisu to All on Sun Oct 18 2020 05:09 pmãã > I just learned of this script thanks to another post here on Dovenet and Iã > went through the process of setting up the modopts feed options and theã > timed event.ã >ã > In attempting to run the event, however, I get error notifications and noã > joy on data being imported.ã >ã > The text in the error log is as follows:ã >ã > Sun Oct 18 17:03:15 2020ã > evnt FEEDIMP !JavaScript C:\sbbs\exec\web_feed_importer.js line 1:ã > SyntaxError: illegal characterããWhat is on line 1 of the file?ãã digital manããSynchronet "Real Fact" #51:ãRob Swindell was introduced to BBSing in 1982 by his older brother, Dr. Seuss.ãNorco, CA WX: 77.2øF, 56.0% humidity, 9 mph ENE wind, 0.00 inches rain/24hrsã---ã þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.netã
-
From
echicken@VERT/ECBBS to
Kurisu on Sun Oct 18 22:45:33 2020
Re: web_feed_importer.js erroring outã By: Kurisu to All on Sun Oct 18 2020 17:09:25ãã Ku> Sun Oct 18 17:03:15 2020ã Ku> evnt FEEDIMP !JavaScript C:\sbbs\exec\web_feed_importer.js line 1: SyntaxError: illegal characterãã Ku> I know bugger all of Javascript or much else programming wise, so I can't even begin to debug thisã Ku> myself - my first thoughts lead nowhere so now to ask you fellow hackers for help. ããCan't really help you without having a look at the feed you're trying to import.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Hatton@VERT/THRCORN to
echicken on Mon Oct 19 03:42:07 2020
Re: web_feed_importer.js erroring outã By: echicken to Kurisu on Sun Oct 18 2020 10:45 pmãã Ku>> evnt FEEDIMP !JavaScript C:\sbbs\exec\web_feed_importer.js line 1:ã Ku>> SyntaxError: illegal character ã Co> Can't really help you without having a look at the feed you're trying toã Co> import. ããI'm trying to implement the same thing (curious minds and all) and while he's getting an error I'm not seeing anything happen when I poll
https://www.theonion.com/rssããI can confirm the RSS feed works.ããHattonãã... Love conquers all things except poverty and toothacheãã---ã þ Synchronet þ Three Corners and Beyond!
http://3corners.usã
-
From
Kurisu@VERT/FINALZON to
Digital Man on Sun Oct 18 21:54:32 2020
Re: web_feed_importer.js erroring outã By: Digital Man to Kurisu on Sun Oct 18 2020 06:13 pmãã > What is on line 1 of the file?ããload("sbbsdefs.js");ããThe file is precisely what is in the repository at the moment - I've tried both with and without the commented instructions to identical effect. Even running the script directly via the SBBS control panel results in the same error.ã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
Digital Man@VERT to
Kurisu on Sun Oct 18 21:47:11 2020
Re: web_feed_importer.js erroring outã By: Kurisu to Digital Man on Sun Oct 18 2020 09:54 pmãã > Re: web_feed_importer.js erroring outã > By: Digital Man to Kurisu on Sun Oct 18 2020 06:13 pmã >ã > > What is on line 1 of the file?ã >ã > load("sbbsdefs.js");ããAh, that line number must be a red herring then.ãã digital manããRush quote #68:ãHe's a radio receiver, tuned to factories and farms .. New World ManãNorco, CA WX: 67.8øF, 71.0% humidity, 0 mph SE wind, 0.00 inches rain/24hrsã---ã þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.netã
-
From
Kurisu@VERT/FINALZON to
echicken on Mon Oct 19 02:15:28 2020
Re: web_feed_importer.js erroring outã By: echicken to Kurisu on Sun Oct 18 2020 10:45 pmãã > Can't really help you without having a look at the feed you're trying toã > import.ããIt appears at least that it actually fails before the import can even happen - even if you clear the [feed] section of modopts it results in the same error. In my rudimentary debugging I considered the feed URL being the issue and tried a few things.ããThat being said, the feed I'm looking to import is that of my website,
https://www.xadara.com/feed/ Perhaps, of course, a test import or something on a known working system could shed some light...ããã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
Kurisu@VERT/FINALZON to
Digital Man on Mon Oct 19 02:22:29 2020
Re: web_feed_importer.js erroring outã By: Digital Man to Kurisu on Sun Oct 18 2020 09:47 pmãã > Ah, that line number must be a red herring then.ããHas me for one heck of a loop, honestly.ããAny options to try to run it with a verbose output that may shed light? The original post contains the entire log entry of me running my import command and the error output so naturally we'd need more info.ããHappy to try out whatever options may be available and report back.ã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
echicken@VERT/ECBBS to
Hatton on Mon Oct 19 10:34:34 2020
Re: web_feed_importer.js erroring outã By: Hatton to echicken on Mon Oct 19 2020 03:42:07ãã Ha> not seeing anything happen when I poll
https://www.theonion.com/rss ããWhen I visit the above in my browser, I'm redirected to '
https://theonion.com/rss'. Remove 'www.' from the URL and try again; maybe it'll work then.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Digital Man on Mon Oct 19 10:51:42 2020
Re: web_feed_importer.js erroring outã By: Digital Man to Kurisu on Sun Oct 18 2020 21:47:11ãã DM> Ah, that line number must be a red herring then.ããI suspect the error is coming from E4X, so it's 'line 1' of the XML document that's being parsed.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Kurisu on Mon Oct 19 11:01:59 2020
Re: web_feed_importer.js erroring outã By: Kurisu to Digital Man on Mon Oct 19 2020 02:22:29ãã >> Ah, that line number must be a red herring then.ãã Ku> Has me for one heck of a loop, honestly.ããNot sure what to tell you. I have this in modopts.ini:ãã [feeds]ã local_rss =
https://www.xadara.com/feed/ããweb_feed_importer.js imported your feed into my 'local_rss' message base without issue.ãã Ku> Any options to try to run it with a verbose output that may shed light? The original post containsããCreate a file called rss-test.js in your mods directory, with its contents being:ãã load("rss-atom.js");ã new Feed("
https://www.xadara.com/feed/");ããRun it via jsexec from a shell or command prompt:ãã ../exec/jsexec ./rss-test.jsãã(Adjust the above if necessary if you're on Windows.)ããIf there's a problem, it should shit out with a verbose error.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Kurisu on Mon Oct 19 11:16:19 2020
Re: web_feed_importer.js erroring outã By: Kurisu to echicken on Mon Oct 19 2020 02:15:28ãã Ku> It appears at least that it actually fails before the import can even happen - even if you clear theã Ku> [feed] section of modopts it results in the same error. In my rudimentary debugging I considered theããWithout a [feeds] section, I would expect web_feed_importer.js to throw 'TypeError: opts is not an object'. So it's not even getting as far as running its main function.ããThere's almost certainly a problem with one of the scripts that web_feed_importer is loading, or one of the scripts that one of those scripts is loading, and so forth on down the line.ããI have no such problem on my system, where all of the scripts are up to date as of a few minutes ago.ããDifficult to give specific advice without knowing how you update and manage your system, but you may want to back up your exec/ directory structure and replace it with a fresh copy.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Digital Man on Mon Oct 19 11:16:46 2020
Re: web_feed_importer.js erroring outã By: echicken to Digital Man on Mon Oct 19 2020 10:51:42ãã ec> I suspect the error is coming from E4X, so it's 'line 1' of the XML document that's being parsed.ããOn reflection, probably not. :)ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Kurisu@VERT/FINALZON to
echicken on Mon Oct 19 12:57:14 2020
Re: web_feed_importer.js erroring outã By: echicken to Kurisu on Mon Oct 19 2020 11:16 amãã > Difficult to give specific advice without knowing how you update and manageã > your system, but you may want to back up your exec/ directory structure andã > replace it with a fresh copy.ããFor full clarity I'm running 3.18b on Windows Server 2008.ããI tried the other posts suggestion of making an rss-test file as instructed and that gave no errors. Given that went okay enough I decided to follow this suggestion replaced all the JS modules in my exec folder with current ones pulled from git and got better results than before - running the timed event no longer results in the previous error, but a new one regarding the server response being "empty."ããI've forgotten exactly what that error said as in the middle of typing this message up to generate that error again I got a DIFFERENT one indicating my message base name was incorrect, which had not shown before. Fixing that typo (I often incorrectly format my message base names when putting them in manually, one day I'll get it right) resulted in the code executing with proper import messages via jsexec.ããI'm not quite sure what I did to get it going. I played around with debugging in jsexec just to see if I could see where the issue crept up (no dice) and following that it just magically worked.ããIt certainly seems out of date JS may have been a key factor. In whatever case, it is working now, so, I guess mission complete for the time being? We'll see how it plays out.ããAs always I greatly appreciate the help. I wish I didn't have to ask so often but these things elude me at times...ããWish we could figure out where the actual issue was...ã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
echicken@VERT/ECBBS to
Kurisu on Mon Oct 19 15:20:42 2020
Re: web_feed_importer.js erroring outã By: Kurisu to echicken on Mon Oct 19 2020 12:57:14ãã Ku> Given that went okay enough I decided to follow this suggestion replaced all the JS modules in myã Ku> exec folder with current ones pulled from git and got better results than before - running the timedãã Ku> event no longer results in the previous error, but a new one regarding the server response beingã Ku> "empty." ãã Ku> that error again I got a DIFFERENT one indicating my message base name was incorrect, which had notã Ku> shown before. Fixing that typo (I often incorrectly format my message base names when putting themãã Ku> I'm not quite sure what I did to get it going. I played around with debugging in jsexec just to seeããCleaning up your exec directory likely solved the problem. It's hard to say why that was necessary. A bad update or bad edit in there is the likely culprit.ããIf you ever want to modify a script from exec/ or exec/load/, please copy the original script to your mods/ directory and then edit the copy in mods/. This keeps exec/ "clean" and separates your local changes from the stock scripts. More info here:ãã
http://wiki.synchro.net/dir:modsããThe other errors ("empty response" and the typo) are unrelated to the SyntaxError that you initiallyãreported. "Empty response" may be an intermittent problem with the server you're loading the feed from, or it may be an unrelated problem on our end (via http.js).ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Kurisu@VERT/FINALZON to
echicken on Mon Oct 19 15:42:29 2020
Re: web_feed_importer.js erroring outã By: echicken to Kurisu on Mon Oct 19 2020 03:20 pmãã > Cleaning up your exec directory likely solved the problem. It's hard to sayã > why that was necessary. A bad update or bad edit in there is the likelyã > culprit.ããThat's what I'm suspecting. I had to kind of bastardize 3.18b onto my setup... ah, the learning process.ãã > If you ever want to modify a script from exec/ or exec/load/, please copyã > the original script to your mods/ directory and then edit the copy in mods/.ã > This keeps exec/ "clean" and separates your local changes from the stockã > scripts. More info here:ã >ã >
http://wiki.synchro.net/dir:modsããI really must take advantage of the mods directory. Never had the best workflow with these kinds of things. Could well be what caused the original improper files to be lurking around, as I may have avoided updating something I should have, like a fool.ããNow if only I could figure out enough syntaxt to make my feeds from my blog not be so ugly... but that's it's own thing. The function is working fine for me now, it would seem, so I'll get to implimenting the random ideas I had for it.ããThanks again.ã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
Bob Roberts@VERT/HOVAL to
echicken on Mon Oct 19 14:28:11 2020
Re: web_feed_importer.js erroring outã By: echicken to Kurisu on Mon Oct 19 2020 11:16 amãã ec> There's almost certainly a problem with one of the scripts that web_feed_importer is loading, or one of the scripts that oneã ec> of those scripts is loading, and so forth on down the line. ãã ec> I have no such problem on my system, where all of the scripts are up to date as of a few minutes ago.ããIf it makes anyone feel any better, I'm having no problems pulling in RSS headlines from CNN on my BBS. However the feeds from Politico result in an error. So if one feed doesn't work... maybe another will.ãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãããã... No good deed goes unpunished.ãã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
Hatton@VERT/THRCORN to
echicken on Mon Oct 19 19:33:00 2020
not seeing anything happen when I poll https://www.theonion.com/rssãã ec> When I visit the above in my browser, I'm redirected toã ec> 'https://theonion.com/rss'. Remove 'www.' from the URL and try again;ã ec> maybe it'll work then.ããWhen I do that I get a log entry "Empty Response from Server"ããCould the SSL address be throwing things off?ããHattonããã... Support bacteria! It's the only culture some people have.ã--- MultiMail/Win v0.52ã þ Synchronet þ Three Corners and Beyond! http://3corners.usã
-
From
Tracker1@VERT/TRN to
Digital Man on Mon Oct 19 20:20:56 2020
On 10/18/2020 6:13 PM, Digital Man wrote:
evnt FEEDIMP !JavaScript C:\sbbs\exec\web_feed_importer.js line 1:
SyntaxError: illegal character
What is on line 1 of the file?
Guessing it's a BOM character sequence if loaded in a windows text
editor and re-saved.
--
Michael J. Ryan
tracker1 +o Roughneck BBS
---
þ Synchronet þ Roughneck BBS - coming back 2/2/20
-
From
echicken@VERT/ECBBS to
Bob Roberts on Tue Oct 20 00:09:07 2020
Re: web_feed_importer.js erroring outã By: Bob Roberts to echicken on Mon Oct 19 2020 14:28:11ãã BR> BBS. However the feeds from Politico result in an error. So if one feed doesn't work... maybeããIf you want to share the URL to a particular Politico feed that isn't working, I can take a look.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Hatton on Tue Oct 20 00:11:09 2020
Re: web_feed_importer.js erroã By: Hatton to echicken on Mon Oct 19 2020 19:33:00ãã ec>> '
https://theonion.com/rss'. Remove 'www.' from the URL and try again;ãã Ha> When I do that I get a log entry "Empty Response from Server"ãã Ha> Could the SSL address be throwing things off?ããNot sure; same thing is happening to me here. HTTPS shouldn't be a problem, but I'll have to take a closer look and see what's up.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Hatton on Tue Oct 20 00:15:34 2020
Re: web_feed_importer.js erroã By: echicken to Hatton on Tue Oct 20 2020 00:11:09ãã ec>>> '
https://theonion.com/rss'. Remove 'www.' from the URL and try again;ãã Ha>> When I do that I get a log entry "Empty Response from Server"ãã Ha>> Could the SSL address be throwing things off?ãã ec> Not sure; same thing is happening to me here. HTTPS shouldn't be a problem, but I'll have to take aã ec> closer look and see what's up. ããOkay, never mind - my browser was misleading me, and the 'www' is required after all.ããThis little test script, run via jsexec, is able to load the feed and print some articles to my terminal. Please give it a try and let me know what you see:ããload("rss-atom.js");ãvar f = new Feed("
https://www.theonion.com/rss");ãfor(var c = 0; c < f.channels.length; c++) {ã writeln(f.channels[c].title);ã writeln(f.channels[c].updated);ã for(var i = 0; i < f.channels[c].items.length; i++) {ã writeln(f.channels[c].items[i].title);ã writeln(f.channels[c].items[i].author);ã writeln(f.channels[c].items[i].date);ã writeln(f.channels[c].items[i].body);ã writeln("---");ã }ã writeln("---");ã}ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Hatton@VERT/THRCORN to
echicken on Tue Oct 20 11:25:14 2020
This little test script, run via jsexec, is able to load the feed and ãprintã > some articles to my terminal. Please give it a try and let me know what ãyouã > see:ããLooking at the output below and comparing it to the actual XML output, I ãthink the culprit here lies in elements that are expressed with "CDATA".ããAlso the code references the "body" element and that does not exist in thisãfeed, they use "description" instead.ããReading script from /sbbs/exec/rsstest.jsã/sbbs/exec/rsstest.js compiled in 0.00 secondsãThe Onionãããããã---ããããã---ã<snipped for ease of reading>ã/sbbs/exec/rsstest.js executed in 0.18 secondsããJavaScript: Destroying contextãJavaScript: Destroying runtimeã---ã þ Synchronet þ Three Corners and Beyond! http://3corners.usã
-
From
echicken@VERT/ECBBS to
Hatton on Tue Oct 20 12:02:17 2020
Re: Re: web_feed_importer.js erroã By: Hatton to echicken on Tue Oct 20 2020 11:25:14ãã Ha> Also the code references the "body" element and that does not exist inã Ha> this feed, they use "description" instead.ããThat's fine - "body" is a property of the Item object, which is produced when parsing a feed. It's derived from an item's "description" (RSS) or "summary" (Atom) element. It's not a direct reference to an XML element.ãã Ha> Looking at the output below and comparing it to the actual XML output, I ã Ha> think the culprit here lies in elements that are expressed with "CDATA".ããWhen I run that script on my system, all of the CDATA-enclosed content appears to be parsed out properly. I don't have blank lines in my output (except for 'author', which appears to be absent from their items).ããWe're seeing different results, so there's some difference in the code we're running on our systems. How up to date is your BBS, including the scripts in exec/ and exec/load/?ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Hatton@VERT/THRCORN to
echicken on Tue Oct 20 17:20:43 2020
Re: Re: web_feed_importer.js erroã By: echicken to Hatton on Tue Oct 20 2020 12:02 pmãã ec> We're seeing different results, so there's some difference in the codeã ec> we're running on our systems. How up to date is your BBS, including theã ec> scripts in exec/ and exec/load/? ããI thought I was running latest version, I'll do a git pull and rebuild (with symlinks) and see what happens.ããHattonãã... File not found, I'll load something *I* think is interesting.ãã---ã þ Synchronet þ Three Corners and Beyond!
http://3corners.usã
-
From
Hatton@VERT/THRCORN to
echicken on Tue Oct 20 17:45:40 2020
Re: Re: web_feed_importer.js erroã By: Hatton to echicken on Tue Oct 20 2020 05:20 pmãã ec>> We're seeing different results, so there's some difference in theã ec>> code we're running on our systems. How up to date is your BBS,ã ec>> including the scripts in exec/ and exec/load/? ãã Ha> I thought I was running latest version, I'll do a git pull and rebuildã Ha> (with symlinks) and see what happens. ããThat was the issue - I've been doing GIT pulls and rebuilds but have not been copying over the updated JS files from exec and exec/load.ããThanks!ãHattonãã... Men will always be men -- no matter where they are.ãã---ã þ Synchronet þ Three Corners and Beyond!
http://3corners.usã
-
From
Bob Roberts@VERT/HOVAL to
echicken on Tue Oct 20 12:29:52 2020
Re: web_feed_importer.js erroring outã By: echicken to Bob Roberts on Tue Oct 20 2020 12:09 amãã BR>> BBS. However the feeds from Politico result in an error. So if oneã BR>> feed doesn't work... maybe ãã ec> If you want to share the URL to a particular Politico feed that isn'tã ec> working, I can take a look. ããWell, I tried it again and it's working now. So perhaps a temporary error. I'm now importing 6-7 different feeds into 3 different local message bases, allowing me to use SBBS as a bit of an RSS reader, which is fun.ããIt would be fun if there was a modopts.ini option that would allow you to specify the "from" name for each feed. The autogenerated names get kinda ugly.ãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãããã... I want to write a mystery novel...or do I?ãã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
echicken@VERT/ECBBS to
Bob Roberts on Tue Oct 20 16:09:23 2020
Re: web_feed_importer.js erroring outã By: Bob Roberts to echicken on Tue Oct 20 2020 12:29:52ãã BR> It would be fun if there was a modopts.ini option that would allow you to specify the "from" name for each feed. Theã BR> autogenerated names get kinda ugly. ããUnfortunately the current configuration scheme doesn't allow for that sort of thing. The script either uses the contents of the 'author' field for each item as the 'from' address, or if that's empty/absent, uses 'Web Feed Importer'.ããI'd really like to rewrite this script since there are a lot of things I'd do better/differently now - but I made some poor choices when I wrote it, so I'll need to be careful to avoid it creating a bunch of dupe messages.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Bob Roberts@VERT/HOVAL to
echicken on Tue Oct 20 12:51:12 2020
Re: web_feed_importer.js erroã By: echicken to Hatton on Tue Oct 20 2020 12:15 amãã ec> This little test script, run via jsexec, is able to load the feed andã ec> print some articles to my terminal. Please give it a try and let me knowã ec> what you see: ããI'm having some problems with
https://www.theverge.com/rss/full.xmlããSo I'm using your test script, and nothing is coming out. But when I load it in Firefox the XML displays OK.ããLoading configuration files from /sbbs/ctrlãJavaScript-C 1.8.5 2011-03-31ãJavaScript: Creating runtime: 8388608 bytesãJavaScript: Initializing context (stack: 16384 bytes)ããReading script from /home/sbbs/sbbs/mods/rss-test.jsã/home/sbbs/sbbs/mods/rss-test.js compiled in 0.00 secondsããã---ã/home/sbbs/sbbs/mods/rss-test.js executed in 0.15 secondsãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãããã... Hello, he lied.ã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
Kurisu@VERT/FINALZON to
echicken on Tue Oct 20 17:00:22 2020
Re: web_feed_importer.js erroring outã By: echicken to Bob Roberts on Tue Oct 20 2020 04:09 pmãã > BR> It would be fun if there was a modopts.ini option that would allow youã > BR> to specify the "from" name for each feed. Theã > BR> autogenerated names get kinda ugly.ã >ã > Unfortunately the current configuration scheme doesn't allow for that sortã > of thing. The script either uses the contents of the 'author' field for eachã > item as the 'from' address, or if that's empty/absent, uses 'Web Feedã > Importer'.ã >ã > I'd really like to rewrite this script since there are a lot of things I'dã > do better/differently now - but I made some poor choices when I wrote it, soã > I'll need to be careful to avoid it creating a bunch of dupe messages.ããTo circumvent some of the nasty I spent much of last night making a custom RSS feed for my website to try to pull things a LITTLE better. It's one hell of a kludge and requires a very particular combination of Wordpress hack + constant polling to really make it "sane" in the script, but it at least allowed for things like article names (rather than just "Xadara" for everything) but again, you have to really force it to pull that info and do posts one-at-a-time... so it wound up being something I wasn't happy with.ããKind of makes it annoying to use on my site for now, but hey, it works great for a weather feed! Now if only I could find one that didn't update every 10 minutes, lol...ããIf it ever gets to being rewritten I'd LOVE to put it to its paces for importing content from a Wordpress site and formatting them reasonably well, since of course any updated script would wind up being more intricate, as the above request from Bob hints at.ããHell, if I could code worth a damn I'd try to improve it, but all the logic in that (obviously) eludes me when it comes to pulling X value to Y area.ããWhat I'm getting at is for multi-faceted BBS sysops, like me, such is already a useful enough idea to start with and could mature quite a bit... but, priorities. I could always get off my ass and figure it out myself, right?ããBah, I'm just thinking out loud. Consider this a supportive post of "if you ever want to try to write a new version of it, I'd be willing to support as best I can with testing in my particular use cases which seem unique enough here."ã_____ãKurisu Yamatoãwww.xadara.comãã---ã þ Synchronet þ Final Zone BBS - finalzone.ddns.net - www.xadara.comã
-
From
echicken@VERT/ECBBS to
Bob Roberts on Tue Oct 20 22:29:03 2020
Re: web_feed_importer.js erroã By: Bob Roberts to echicken on Tue Oct 20 2020 12:51:12ãã BR> I'm having some problems with
https://www.theverge.com/rss/full.xmlãã BR> So I'm using your test script, and nothing is coming out. But when I load it in Firefox the XML displays OK.ããSame result here. It's an Atom feed rather than RSS - which should work, but I haven't tested against one in a long time. Will see if I can figure it out.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Bob Roberts on Tue Oct 20 23:28:49 2020
Re: web_feed_importer.js erroã By: echicken to Bob Roberts on Tue Oct 20 2020 22:29:03ãã BR>> I'm having some problems with
https://www.theverge.com/rss/full.xmlããI've just pushed a couple of changes to exec/load/rss-atom.js which should help. A little more work may be needed; it's possible that not all of the fields (title, author, date, etc.) are being handled correctly for this type of feed. Too tired to dig deeper right now; please let me know if you see anything weird.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Bob Roberts@VERT/HOVAL to
echicken on Wed Oct 21 13:19:10 2020
Re: web_feed_importer.js erroã By: echicken to Bob Roberts on Tue Oct 20 2020 11:28 pmãã ec> I've just pushed a couple of changes to exec/load/rss-atom.js which shouldã ec> help. A little more work may be needed; it's possible that not all of theã ec> fields (title, author, date, etc.) are being handled correctly for thisã ec> type of feed. Too tired to dig deeper right now; please let me know if youã ec> see anything weird. ããYup. After pulling the new rss-atom.js down the feed from theverge works pretty good. Thanks!ã ãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãããã... If you can't learn to do it well, learn to enjoy doing it badly.ãã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
Bob Roberts@VERT/HOVAL to
echicken on Tue Oct 27 22:59:04 2020
Re: web_feed_importer.js erroã By: echicken to Bob Roberts on Tue Oct 20 2020 11:28 pmãã ec> I've just pushed a couple of changes to exec/load/rss-atom.js which shouldã ec> help. A little more work may be needed; it's possible that not all of theã ec> fields (title, author, date, etc.) are being handled correctly for thisã ec> type of feed. Too tired to dig deeper right now; please let me know if youã ec> see anything weird. ããHi there,ããI'm getting periodic crashes with this updated script. It happens occasionally perhaps due to the content of one of the RSS feeds. When it happens SBBS dies completely, then restarts itself. There isn't an error in the System Journal other then lack of exit from RSSIN, then I see all the reload messages.ããIs there something I can do that might provide more info on the crash?ãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãããã... This tagline's just for you.ãã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
echicken@VERT/ECBBS to
Bob Roberts on Wed Oct 28 10:43:36 2020
Re: web_feed_importer.js erroã By: Bob Roberts to echicken on Tue Oct 27 2020 22:59:04ãã BR> I'm getting periodic crashes with this updated script. It happensã BR> occasionally perhaps due to the content of one of the RSS feeds. When itã BR> happens SBBS dies completely, then restarts itself. There isn't an errorã BR> in the System Journal other then lack of exit from RSSIN, then I see allã BR> the reload messages. ãã BR> Is there something I can do that might provide more info on the crash?ããProbably not. I'd have to add a bunch of debug logging to the script so that we might figure out exactly when/why this is happening.ããIf you noticed that this started after you added a particular feed, you could disable that feed for the time being.ããI'm thinking about creating a new project to handle viewing / importing feeds, but I probably won't get to that for a few weeks.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Digital Man@VERT to
Bob Roberts on Wed Oct 28 09:59:16 2020
Re: web_feed_importer.js erroã By: Bob Roberts to echicken on Tue Oct 27 2020 10:59 pmãã > Re: web_feed_importer.js erroã > By: echicken to Bob Roberts on Tue Oct 20 2020 11:28 pmã >ã > ec> I've just pushed a couple of changes to exec/load/rss-atom.js whichã > ec> should help. A little more work may be needed; it's possible that notã > ec> all of the fields (title, author, date, etc.) are being handledã > ec> correctly for this type of feed. Too tired to dig deeper right now;ã > ec> please let me know if you see anything weird.ã >ã > Hi there,ã >ã > I'm getting periodic crashes with this updated script. It happensã > occasionally perhaps due to the content of one of the RSS feeds. When itã > happens SBBS dies completely, then restarts itself. There isn't an error inã > the System Journal other then lack of exit from RSSIN, then I see all theã > reload messages.ã >ã > Is there something I can do that might provide more info on the crash?ããThis would be helpful:ã
http://wiki.synchro.net/howto:gdbã-- ã digital manããSling Blade quote #15:ãDoyle Hargraves: What'cha doin' with that lawn mower blade Karl?ãNorco, CA WX: 65.1øF, 33.0% humidity, 0 mph SSW wind, 0.00 inches rain/24hrsã---ã þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.netã
-
From
Bob Roberts@VERT/HOVAL to
echicken on Wed Oct 28 08:32:21 2020
Re: web_feed_importer.js erroã By: echicken to Bob Roberts on Wed Oct 28 2020 10:43 amãã ec> Probably not. I'd have to add a bunch of debug logging to the script soã ec> that we might figure out exactly when/why this is happening. ããI'll try to figure out what feed it is, and let you know. My suspicion it's a missing xml tag or something that periodically happens based on whatever content they are running at the time. ãã ec> I'm thinking about creating a new project to handle viewing / importingã ec> feeds, but I probably won't get to that for a few weeks. ããThat would be cool. Not sure if you're thinking of creating an external RSS "door", but I really like having them imported into the message bases, as it creates a nice integrated feel and gives at least the illusion of activity. Most RSS feeds integrate pretty cleanly, some have extra spaces or funny characters, but overall it works well.ãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãããã... The average raindrop falls at 7 miles per hour.ãã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
echicken@VERT/ECBBS to
Bob Roberts on Wed Oct 28 14:49:46 2020
Re: web_feed_importer.js erroã By: Bob Roberts to echicken on Wed Oct 28 2020 08:32:21ãã BR> I'll try to figure out what feed it is, and let you know. My suspicionã BR> it's a missing xml tag or something that periodically happens based onã BR> whatever content they are running at the time. ããI think that's unlikely - you'd probably just see an error message which might hint at a failed attempt at XML parsing, but the BBS is unlikely to crash. But maybe.ããI lean toward there being some unexpected characters in an item title or something like that, causing a problem when an attempt is made to save the message. Or some massive amount of memory being used, something like that.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
echicken@VERT/ECBBS to
Bob Roberts on Wed Oct 28 14:55:26 2020
Re: web_feed_importer.js erroã By: Bob Roberts to echicken on Wed Oct 28 2020 08:32:21ãã BR> That would be cool. Not sure if you're thinking of creating an externalã BR> RSS "door", but I really like having them imported into the message bases,ããI am thinking of that, but it would still be backed by a message base. There would be an RSS reader module that you could browse feeds from, but ultimately it's pulling data out of message bases. You could hide those bases from your users or not, or use the reader module or not. Could be a news ticker or scrolling newsreader, that sort of thing.ããIn reality it's just a chance for me to sidestep some problems with web_feed_importer by offering an alternative. There are certain things that make revising or overhauling the existing script a bit problematic.ãã---ãechickenãelectronic chicken bbs - bbs.electronicchicken.comã þ Synchronet þ electronic chicken bbs - bbs.electronicchicken.comã
-
From
Bob Roberts@VERT/HOVAL to
Digital Man on Wed Oct 28 13:45:33 2020
Re: web_feed_importer.js erroã By: Digital Man to Bob Roberts on Wed Oct 28 2020 09:59 amãã DM> This would be helpful:ã DM>
http://wiki.synchro.net/howto:gdbããOkay, I think I've got the configuration done for core dumps, so if it happens again I'll try the gdb steps.ãã|08~|05B|03ob|08:|06R|03ob|08~ã|07ãã---ã þ Synchronet þ Halls of Valhalla <> San Francisco <> hovalbbs.comã
-
From
Digital Man@VERT to
Bob Roberts on Wed Oct 28 16:28:36 2020
Re: web_feed_importer.js erroã By: Bob Roberts to Digital Man on Wed Oct 28 2020 01:45 pmãã > Re: web_feed_importer.js erroã > By: Digital Man to Bob Roberts on Wed Oct 28 2020 09:59 amã >ã > DM> This would be helpful:ã > DM>
http://wiki.synchro.net/howto:gdbã >ã > Okay, I think I've got the configuration done for core dumps, so if itã > happens again I'll try the gdb steps.ããAppreciate it,ã-- ã digital manããRush quote #50:ãI've always been a big sponge. - Neil PeartãNorco, CA WX: 74.6øF, 32.0% humidity, 8 mph NE wind, 0.00 inches rain/24hrsã---ã þ Synchronet þ Vertrauen þ Home of Synchronet þ [vert/cvs/bbs].synchro.netã
-
From
Gamgee@VERT/PALANT to
echicken on Wed Oct 28 20:48:00 2020
echicken wrote to Bob Roberts <=-ãã ec> Re: web_feed_importer.js erroã ec> By: Bob Roberts to echicken on Wed Oct 28 2020 08:32:21ãã BR> That would be cool. Not sure if you're thinking of creating an externalã BR> RSS "door", but I really like having them imported into the message bases,ãã ec> I am thinking of that, but it would still be backed by a messageã ec> base. There would be an RSS reader module that you could browseã ec> feeds from, but ultimately it's pulling data out of messageã ec> bases. You could hide those bases from your users or not, or useã ec> the reader module or not. Could be a news ticker or scrollingã ec> newsreader, that sort of thing.ããI'd be quite interested in this also, and I'll thank you in ãadvance for considering it.ãããã... A day without sunshine is like night.ã--- MultiMail/Linux v0.52ã þ Synchronet þ Palantir BBS * palantirbbs.ddns.net * Pensacola, FLã