Asp Forum - HTML-Parser / SGML-Parser

Zach Dennis

10/1/2003 5:36:00 AM

Ok, silly question.

I am writing a script to determine my router's WAN ip address and then to
email me once an hour in case it changes. Currently I am running a web
server at work that returns a page with the client's ip address. I need to
parse out the info on the page so I can extract the ip address of my router
when my script/program connects.

I am using the html-parser, sgml-parser and formatter ruby libraries
provided from raa and I have made the changes to the regexp regarding image
width and height. So I'm good there.

In my test.rb file I say:
------------------------------------------------
h = Net::HTTP.new('www.zachstestip.com' , 80 )
resp,data = h.get('/index.php' , nil )

w = DumbWriter.new
f = AbstractFormatter.new(w)
p = HTMLParser.new(f)
p.feed(data)
p.close
------------------------------------------------

Here comes the silly part. The function "feed" is inherited by sgml-parser
to html-parser. It passes "data" along to the sgml-parser function
"goahead". It prints everything to stdout or stderr( i dont know, but it
makes it to my screen =), but there is no print, put, etc... etc... call to
send it there!!! I cant for the life of me determine where in the feed or
goahead functions are outputting my parsed results from data! This is damn
silly of me to ask I know, but how is it getting to my CLI?

In the "goahead" function there is a giant while loop. If i place a print or
puts statement at the right before the loop and right after the loop, then
nothing is outputted( except for my explicit print/puts statements).

Am I losing it?

Zach

5 Answers

Sean O'Dell

10/1/2003 6:03:00 AM

Zach Dennis wrote:
> Ok, silly question.
>
> I am writing a script to determine my router''s WAN ip address and then to
> email me once an hour in case it changes. Currently I am running a web
> server at work that returns a page with the client''s ip address. I need to
> parse out the info on the page so I can extract the ip address of my router
> when my script/program connects.
>
> I am using the html-parser, sgml-parser and formatter ruby libraries
> provided from raa and I have made the changes to the regexp regarding image
> width and height. So I''m good there.
>
> In my test.rb file I say:
> ------------------------------------------------
> h = Net::HTTP.new(''www.zachstestip.com'' , 80 )
> resp,data = h.get(''/index.php'' , nil )
>
> w = DumbWriter.new
> f = AbstractFormatter.new(w)
> p = HTMLParser.new(f)
> p.feed(data)
> p.close
> ------------------------------------------------
>
> Here comes the silly part. The function "feed" is inherited by sgml-parser
> to html-parser. It passes "data" along to the sgml-parser function
> "goahead". It prints everything to stdout or stderr( i dont know, but it
> makes it to my screen =), but there is no print, put, etc... etc... call to
> send it there!!! I cant for the life of me determine where in the feed or
> goahead functions are outputting my parsed results from data! This is damn
> silly of me to ask I know, but how is it getting to my CLI?
>
> In the "goahead" function there is a giant while loop. If i place a print or
> puts statement at the right before the loop and right after the loop, then
> nothing is outputted( except for my explicit print/puts statements).
>
> Am I losing it?

Why not just qualify your IP address with something like >>>>IP<<<< and
then you can regex for it like this:

match = />>>>(.+)<<<</.match(HTML)

match[1] => your IP address

Sean O''Dell

ahoward

10/1/2003 1:08:00 PM

Steven Jenkins

10/1/2003 2:01:00 PM

This doesn''t answer your questions about Ruby, but most of what you want
exists already.

Look at http://www..... I''ve been using them for a year or so.
Every 5 minutes, a Perl daemon (ddclient) on my system wakes up, grabs
the WAN address from my Linksys box, and if it''s changed, updates
dyndns. I can ssh into my system at home using the name
''tidal.dyndns.org'', even though the address actually belongs to my ISP.
It works great, and it''s free.

Steve

Ben Giddings

10/1/2003 4:43:00 PM

Zach Dennis wrote:
> I am using the html-parser, sgml-parser and formatter ruby libraries
> provided from raa and I have made the changes to the regexp regarding image
> width and height. So I'm good there.

I think the HTML parser might be abandoned (RAA says the last update was
2001-07-10 13:35:40 GMT).

You might have better luck using (my) htmltokenizer. It has a really
simple interface, and it might be more what you need:

http://raa.ruby-lang.org/list.rhtml?name=htm...

If you really want to use the html-parser, sorry, I can't help you. I
never managed to understand how to work it, which is why I ported the
htmltokenizer.

Ben

Bernard Delmée

10/1/2003 7:26:00 PM

> ------------------------------------------------
> h = Net::HTTP.new('www.zachstestip.com' , 80 )
> resp,data = h.get('/index.php' , nil )
>
> w = DumbWriter.new
> f = AbstractFormatter.new(w)
> p = HTMLParser.new(f)
> p.feed(data)
> p.close
> ------------------------------------------------
>
> Here comes the silly part. The function "feed" is inherited by
> sgml-parser to html-parser. It passes "data" along to the sgml-parser
> function "goahead". It prints everything to stdout or stderr( i dont
> know, but it makes it to my screen =), but there is no print, put,
> etc... etc... call to send it there!!! I cant for the life of me
> determine where in the feed or goahead functions are outputting my
> parsed results from data! This is damn silly of me to ask I know, but
> how is it getting to my CLI?

Through the DumbWriter. Check its implementation in
....\Ruby\lib\ruby\site_ruby\formatter.rb
that's where the "write" statements live.

Often times when you want to parse HTML, it is simpler to use
the (misleadingly named) SGMLParser. Anyway these libraries are
direct ports of python modules, and can only be understood by
checking the documentation of the originals.
See eg: http://www.python.org/doc/1.5.2/lib/module-sg...
And usage examples (in python ;-)
http://aspn.activestate.com/ASPN/Cookbook/Python/Re...
http://www.oreilly.com/catalog/pythonsl/chapter/ch...

Cheers,

Bernard.

comp.lang.ruby