one of my favorite sites ... a macurfer.com ... updates daily with headlines from many sites on the net.

I was wondering how this is done?

anybody got any clues?

---

openoffice + gimp + sketch ...

xml and/or backend syndication?
--
Rob

SW Montana's Online Community
Modular Model Railroading

Hi Rob,

Yeah, XML crossed my mind but what do you mean by backend syndication?

if it's XML based ... anybody know of any good scripts that can do this? ... hehe ... preferably on budget eh!

---

openoffice + gimp + sketch ...

I really know very little. There are at least two formats for backend syndication, that I know of, xml and something I can't remember.

If you go to hotscripts and poke around portals, content management systems and the like, you will start running across syndication features.

postnuke.com
ez.no
metadot.net or com?

Also look around the hotscripts category "web fetching"
--
Rob

SW Montana's Online Community
Modular Model Railroading

There is a common format being developed, I believe, to package your content for feeding into other websites. I think it's RDF or of course you can use XML.

Basically you'll have to ask other site's permission and then get the address for their RDF/XML feed so that you can plug it straight into your website.

For example of RDF and XML feeds, try looking at http://slashdot.org free feeds for ways you can incorporate these into your site.

XML feed => http://slashdot.org/slashdot.xml
RDF feed => http://slashdot.org/slashdot.rdf

- wil

thanks guys!

hmmm metdot looks really interesting but I was hoping for GT to come up with their community plugin ...

I want to put together something like the mac site above for Japan. Not much interaction on the net and everything is soooo spread out.

I don't think I'll make any money off the site but I'd be pretty famous which is better in some ways

Now I just have to narrow this done to 1 or 2 scripts. 1 if it dows both publish / grab or 2 if I can't find one that does both.



Thanks for the info above!
I totally forgot about hotscipts.com ... web fetching area

---

openoffice + gimp + sketch ...

Download slashcode - the code that powers slashdot and othrs such as use.perl.org. Very powerful.

Cheers

- wil

Thanks Wil,

Just hope it's not that difficult to deal with!

I'm still barely in the hacking stage as most of you can tell

---

openoffice + gimp + sketch ...

On some of our non-profit sites we used to use Isyndicate or something like that. You go to their site and sign up and select categories and news feeds that interest you (financial, sports etc.) and then they basically give you a cut & paste script that pulls in the updates. For an extremely "low-budget" site (ie, not CNN.com) it is pretty smooth. Don't know if they are still around or not, but that is how it used to work.

You do realise that Links SQL has an XML-feed, don't you?

http://slashdemocracy.org/cgi-bin/search.cgi?query=&isNew=Yes&sb=ID&so=DESC&xml_feed=1

That &xml_feed=1 enables anyone with Links SQL to use the famous little orange button, as I do here:

http://slashdemocracy.org/links/

More on RDF (which is XML, BTW):
http://slashdemocracy.org/...gement/Metadata/RDF/

More on XML:
http://slashdemocracy.org/links/XML/

More on syndication:
http://slashdemocracy.org/links/XML/Syndication/

As for tools, I recommend fase4 or RSSMoney.

As for sources, check http://syndic8.com

John

Thanks for the information, John! Most helpful.

- wil

Thanks John!

hmmm ... you using LinksSQL as a gathering point for XML feeds? Seems like if I'm getting what you've suggesting is that LinksSQL could be used for small-medium based sites quite easily.
Links as a news script and search-engine ... hmmm .... slap on gforum then you got user activity built in ....

ughhhhh I WANT the community plugin NOW

---

openoffice + gimp + sketch ...

I think slashcode, ez.no and metadot all require a dedicated server or a host that sells hosting packages that include this script. They require more access to the server than most hosting accounts provide.
--
Rob

SW Montana's Online Community
Modular Model Railroading

Isyndicate is now a subscription model for any new, for-profit sites.

BigNewsNetwork.com does not have as broad as coverage as Isyndicate, but it is free.
--
Rob

SW Montana's Online Community
Modular Model Railroading

Rob

You are absolutely right there. Slashcode is very advanced code. It requires root access as it changes your Apache configuration, and it installs a few deamons onto your system.

- wil

Ahh the joys of flexible hosts. Did I mention I have hosting space available?

Hehe ... syndication and XML/RSS/RDF can be used in many ways ... the links at this BigNewsNetwork looks like this

http://www.bignewsnetwork.com/...ck/here.pl?x37180687

I wonder if they have permission from moreover.com to run their site ... seems they produce no own content. Moreover.com on the other hand offers free (non-commercial) XML-feeds.

Hi,

How about SOAP? This can make the client easly to do :)

Cheers,

Dat

Programming and creating plugins and templates
Blog

Hey Qooq, you can do that even better without worrying about XML and all that stuff with a pretty cheap solution.

All you need is PHP on your server with this script: www.mikenew.net/minifetch.php

The only catch is that you have a few sites who aggregate the content you want, then you can reformat theirs and make a section of it your own on your own page, if you know what I mean.

John, I'm always amazed when I stumble back across your site after you post on these forums.

I am getting an IE error when I try to click the XML "orange thingy"... you need to grep & into & for XML with links to display in IE.

Qooq, if you have no experience with the joy of LWP agents, you could try starting out with Fetcher (http://www.treknews.de/~pixigreg/fetcher.shtml) to snag content off of other sites. Once you get some familiarity with how Fetcher works, you can start dabbling with your own LWP agents.

thanks oldmoney,

I'd be trying to grap japanese content if any.

---

openoffice + gimp + sketch ...

use HTML::Parser;
use LWP;

use caution;