SML Search

Showing posts with label Yahoo Pipes. Show all posts
Showing posts with label Yahoo Pipes. Show all posts

Friday, October 9, 2009

Yahoo Pipes: Meta Search Alerts Digest

No comments:

Since publishing Meta Search Alerts (Yahoo Pipes) (Flickr screenshot / SML Pro Blog / SML Wiki) back in 2007, it has become to most popular pipe ever created. It even popped onto ReadWriteWeb's The Ultimate Yahoo Pipes List in 2008. And perhaps even more bizarre was discovering that somehow CNet had stuck a software publisher profile for me on Download.com earlier this year! SML Thank You!!!

Meta Search Alerts was originally created for my own vanity searches, but then I started using it on SML Wiki so I can track people and things more easily.

This is great until I started writing very long description of photos on Flickr after realising that photos are often referenced as a singular entity — that while you would prefer that people check out the entire set to see the description of the info, most simply don't have the time and patience to do look at them.

For the sake of human browsing, including long description (for example, full bio about an artist that I photographed) in everyone of my photographs about them is useful when items are referenced singularly, but then if you know what you are looking for and wish to cluster them in a single place, the content become repetitive and tired after a very brief instant.


Meta Search Alerts Digest

Screenshot: http://pipes.yahoo.com/seeminglee/metasearchalertsdigest

Meta Search Alerts Digest / 2009-10-09 / SML Pipes (by See-ming Lee 李思明 SML)

This is why I created a baby version called Meta Search Alerts Digest. In essense, this pipe uses Meta Search Alerts as a subpipe, then loop through both the item.description and the item.media:description and limit them to 1000 characters.

A sample of this pipe in action can be seen at
http://wiki.seeminglee.com/people:agata-olek

And you can compare the difference between its grand daddy and itself here:
http://feeds.feedburner.com/metasearchalerts/agataolek
http://feeds.feedburner.com/metasearchalertsdigest/agataolek

Note: The reason why I use Feedburner to subscribe to feed is because that for whatever reasons, Yahoo Pipes RSS tends to generate errors when subscribed via normal means. Many feed reader would complain that it's not a valid feed. By using FeedBurner to burn the feed, that problem goes away. An additionally good aspect about using FeedBurner is that you also get analytics data that comes with it, which is useful - particularly if you wish to use it to feed TwitterFeed etc.


Meta Search Alerts (grand daddy version)


Screenshot: http://pipes.yahoo.com/seeminglee/metasearchalerts

Yahoo Pipes: Meta Search Alerts / 2007-10-27 / SML (by See-ming Lee 李思明 SML)

For folks who are not familiar with my original pipe, this is what it does:
1. Aggregates these search results simultaneously:
+ del.icio.us
+ Findory
+ Flickr
+ Google Blog Search
+ Google News
+ Google Search
+ Icerocket
+ Live News Search
+ Live Search
+ Technorati
+ Yahoo News
+ Yahoo Search

2. Filters the results and ensures that the links are unique.

3. Sorts the results by date such that the latest addition onto the pool will appear at the top of the list.

In other words, it acts as an RSS feed alerts for all these search engines.

Examples
+ Meta Search Alerts: advertising
+ Meta Search Alerts: art
+ Meta Search Alerts: design
+ Meta Search Alerts: design+technology
+ Meta Search Alerts: design+technology+marketing
+ Meta Search Alerts: gay+men
+ Meta Search Alerts: lgbt
+ Meta Search Alerts: marketing
+ Meta Search Alerts: metasearchalerts (Use the pipe to search for itself!)
+ Meta Search Alerts: see-ming-lee (great for daily vanity searches!)
+ Meta Search Alerts: sml-universe
+ Meta Search Alerts: technology
+ Meta Search Alerts: typography
+ Meta Search Alerts: yale

Related SML Universe
+ SML Flickr Sets: SML Pipes
+ SML Pipes

Saturday, September 26, 2009

SML Thank You / 2009-09-25 / SML

No comments:

Today is my birthday so naturally I am getting greetings all over the globe. This is my thank you card to all of you!

SML Thank You / 2009-09-25 / SML (by See-ming Lee 李思明 SML)

I am a believer in thanking people. As an ADHD-afflicted geek, I have often forgotten the kindness and generosity from others, and I make a point of recording them so I can search through them.

I started a blog called SML Thank You (http://thankyou.seeminglee.com) a while back but it was getting a bit challenging to maintain. It also become a bit insane to keep too many blogs so I have since imported them onto SML Pro Blog and labeled those items as SML Thank You.

I do think that thanking people is still an important activity, so I started tweeting with the prefix [SML Thank You] (http://twitter.com/#search?q=%22SML%20Thank%20You%22) but then to save space I started using #smlthankyou as a suffix (http://twitter.com/#search?q=%23smlthankyou).

But what about all those people I've thanked which did not appear on Twitter. I need to find those thanks, and perhaps in comments area on other places. So I built a Yahoo Pipe to do it:

SML Thank You / 2009-09-25 / SML Pipes (by See-ming Lee 李思明 SML)

There is a full description of all the different modules and what it is on SML Wiki: Yahoo Pipes: SML Thank You. In a gist, it does a search on the web and grab data from where I might have thanked folks and put them all in a single RSS feed: http://pipes.yahoo.com/pipes/pipe.run?_id=a8dc3b5c3847f409e0c1f1d6bee13989&_render=rss.

A sample output looks like this:

SML Thank You / 2009-09-25 / SML Pipes (by See-ming Lee 李思明 SML)

and if you go to the Yahoo Pipe page at http://pipes.yahoo.com/seeminglee/smlthankyou you can also use the image view and the map view (for items with geo-data).

A sample output of the pipe and how it renders can be seen on SML Wiki: SML Thank You (http://wiki.seeminglee.com/sml-thank-you)

Related SML
+ SML Flickr Sets: SML Graphic Design
+ SML Flickr Sets: SML Pipes
+ SML Pipes
+ SML Pro Blog: SML Graphic Design
+ SML Pro Blog: SML Thank You
+ SML Pro Blog: Yahoo Pipes

Update 01: 2009-09-25
Since posted the design on Flickr, I noted that the 500x500 version does not really work as a comment to thank you, so I created a mini version for 'thumbnail' comment use. Thanks for visiting the blog! Here's my thankyou card just for you!

SML Thank You / 2009-09-25 / SML (by See-ming Lee 李思明 SML)

Monday, September 14, 2009

SML Wiki New Pages Yahoo Pipes

No comments:

An ultra simple pipe. I think that this will be a very good intro for folks who are not familiar with Yahoo Pipes and wish to see how Pipes can help solve their common problems.

SML Wiki: New Pages / 2009-09-13 / SML Pipes (by See-ming Lee 李思明 SML)
Screenshot: pipes.yahoo.com/seeminglee/smlwikinewpages

My wiki is hosted on wikidot.com and it has an auto-feed feature which reports recent changes and new pages creation via an RSS feed. I use this feed with my friendfeed account, but when I edit pages heavily via frequent saves, the list of "recent changes" makes the feed very hard to follow. Wikidot does not provide a separate feed for new pages vs source changes, so I created this pipe to output only new pages.

Some feed readers appear to have problems getting feeds from the RSS results generated by Yahoo Pipes, so I take the RSS feed and burn it with FeedBurner. Now add the feedburner feed onto FriendFeed and now there's a less-noisy feed on my FriendFeed.

For comparison
Original feed: feeds.feedburner.com/smlwiki
Feed using the pipe: feeds.feedburner.com/smlwiki/newpages

To do
I do still want to include source changes though. I am working on a pipe which truncates items with the same title that were posted too close to each other.

Related SML
+ SML Flickr Tags: SML Pipes
+ SML Pipes

Monday, November 12, 2007

Flickr Social / 2007-11-11 / SML Pipes

No comments:

Yahoo Pipes: See-ming Lee: Flickr Social
Updated with additional fields for permission filtering.

See Flickr screenshot for module details:

Yahoo Pipes: Flickr Social / 2007-11-11 / SML Pipes (by See-ming Lee 李思明 SML)

Here's a screenshot of the additional fields. They are all optional. Again, see Flickr screenshot for notes.

Yahoo Pipes: Flickr Social / 2007-11-11 / SML Pipes (by See-ming Lee 李思明 SML)

More information available on SML Wiki
SML Wiki: Flickr Social

Related SML Pro Blog
+ SML Pro Blog: Flickr Social / 2007-11-11 / SML Pipes

Related SML Universe
+ SML Flickr Tags: Yahoo Pipes
+ SML Ideas
+ SML Pipes
+ SML Wiki: Yahoo Pipes
+ Yahoo Pipes: See-ming Lee

SML Copyright Notice
© 2007 See-ming Lee (Blog / Facebook / Flickr / Google / LinkedIn / YouTube)

Sunday, November 11, 2007

Yahoo Pipes: Flickr Social / 2007-11-10 / SML Pipes

No comments:

I use Flickr a lot, but I am increasingly finding it frustrating to have to go onto Flickr everyday to track my friends' comments and also comments I have posted on, so I created this pipe to track all the commenting activities such that I can log them somewhere.

One of the problems I have with the way the Comments You've Made page works is that if you commented on some particularly popular images, you ended up having a lot of noise in that feed that is unrelated to you.

Given these two problem at hand, I created this pipe to return an RSS feed of all things happening to my activities without the extra noise:

pipes.yahoo.com/seeminglee/flickrsocial

Yahoo Pipes: Flickr Social / 2007-11-10 / SML Pipes (by See-ming Lee 李思明 SML)
This screenshot has notes. Click on the images to get notes on individual modules used on Flickr

What this pipe does

  1. Based on a Flickr username (not user id), return a feed of:
    • Recent comments other people have posted about your photographs
    • Recent comments you have made to other people's photographs
  2. For your recent comments on other people's photographs, fitler out the result such that the feed contains only comments you have made and exclude other people's comments on the same photograph. This ensures that you don't get too much noise on that particular feed if that photograph become very popular--which appears to happen a lot to photographs which I commented on.
  3. Aggregate the results from the two and sort the items based on the published date.

More SML Pipes

SML Thank You
I would like to thank Kris J. Clarke from Scotland for helping me out during the process as I develop this. Kris, you rock!

SML Copyright Notice
©2007 See-ming Lee 李思明 SML / SML Pro Blog / SML Universe. All rights reserved.

Friday, October 26, 2007

Yahoo Pipes: Meta Search Alerts / 2007-10-27 / SML

No comments:

I have updated my Meta Search Alerts (Yahoo Pipe) on 2007-10-27 to include also news and blogs results:

Yahoo Pipes: Meta Search Alerts: RSS feed from (Del.icio.us + Findory + Flickr + Google Blog Search + Google News + Google Search + Icerocket + Live Search + Technorati + Yahoo News + Yahoo Search) / 2007-10-27 / SML (by See-ming Lee 李思明 SML)

This Yahoo Pipe does the following:

  1. Aggregates these search results simultaneously:
  2. Filters the results and ensures that the links are unique.
  3. Sorts the results by date such that the latest addition onto the pool will appear at the top of the list.

In other words, it acts as an RSS feed alerts for all these search engines.

http://pipes.yahoo.com/pipes/pipe.info?_id=nHNB8TJm3BGumlGA9YS63A

Related SML Universe
+ SML Pipes
+ SML RSS
+ SML Search
+ SML Wiki: Meta Search Alerts

SML Copyright Notice

©2007 See-ming Lee 李思明 SML / SML Pro Blog / SML Universe. All rights reserved.