I started fooling around more with Rapidminer’s web mining abilities and managed to crawl my site and some other popular trading blogs. I’m still a long way from fully integrating this plugin into my data mining activities, but its been fun nonetheless.
Playing with this software renewed my interest in understanding web connections, so I visited a neat web applet I found a few years ago while surfing. This applet lets you see the web connections for a URL and can be found on the “websites as a graph” website. I typed in TraderMike’s web address and from the results, it looks like he’s pretty well connected! Note: The black dot is his root URL.