SML Search

Showing posts with label artificial intelligence. Show all posts
Showing posts with label artificial intelligence. Show all posts

Wednesday, October 10, 2007

Human Computation / Google TechTalks

No comments:

Recently I proposed an alternative method for human identification on my blog so when a friend sent me this video via Del.icio.us, I was absolutely delighted:

Google Video: Human Computation / Google TechTalks 2006-07-26


Luis von Ahn

  • Assistant Professor, Computer Science Department, Carnegie Mellon University
  • Ph.D. Computer Science, Carnegie Mellon University, 2005
  • B.S. Mathematics, Duke University, 2000
  • Recipient, Microsoft Research Fellowship


Key points
  • Tasks like image recognition are trivial for humans, but continue to challenge even the most sophisticated computer programs.
  • Utilize human processing power to solve problems that computers cannot yet solve.
  • Traditional approaches to solving such problems focus on improving software.
  • Luis von Ahn advocates a novel approach: constructivly channel human brainpower using computer games.
  • ESP Game = an enjoyable online game that help label images on the Web with descriptive keywords
  • These keywords can be used to improve the accuracy of image search.
  • People play the game not because they want to help, but because they enjoy it.


Fun Facts
  • Number of human-hours spent playing Solitaire in 2003 = 9 billion human-hours
  • Number of human-hours spent building the Empire State Building = 7 million human-hours (6.8 hours of Solitaire)
  • Number of human-hours spent building the Panama Canal = 20 million human-hours (less than a day of Solitaire)


Related Web Sites

Related SML


SML Copyright Notice


©2007 See-ming Lee 李思明 SML / SML Pro Blog / SML Universe. All rights reserved.

Wednesday, September 19, 2007

Human Identification Algorithm

No comments:
Are you human? (Sorry, We Have to Ask). Can’t read the text? Listen to it.
—Digg - Submit Item

You have seen it time and time again. That required step when you submit stories these days for human identification. It composed with letters that are salted with noise and artifacts to defer a bot's attempt to fill out the form and thus spam.


It was a smart idea, but algorithms catch up and soon they don’t work quite as well anymore. So the level has of difficulty for OCR comprehension increased bit by bit everyday. It has become so complex these days that even I cannot identify what characters they are supposed to be.


Perhaps because of the number of complaints received, now we also have the audio version of the same thing. What are they going to do when the audio recognition algorithm got better?


In my opinion, this human identification process simply does not work. Algorithms will get smarter everyday for visual or audio algorithms. A better way is to ask logic questions. For example, ask people to verbally describe the difference between a nerd and a geek. Ask them why they they are reading your blog.


Opinions are largely based on logic, but it is also largely based on creativity, and creativity is something that cannot easily be programmed yet—until the natural language algorithm catch up on it. Another difficult thing that comes natural to us but fairly difficult to do for a machine is comprehension.


I have tested this behavior with a survey which ask the question: Name the odd-man-out among the following: AOL / Google / MSN / Yahoo and state the reason supporting your answer. I get very interesting answers. They are all very inspiring and as such I know that they are not machines.


Being able to go through those answers and pick out the human responses are also most definitely a task that ought to be done by a human. I do not think that there is a computer program that can decipher how creative something is yet. However, I have fears that there are projects underway that is attempting to understand creativity using brute force.


A couple of weeks ago, I went to Google Answers, and I discovered that they are no longer accepting new questions. This was a site where users submit questions and get answers responded by other users. The snippets are very interesting and no doubt allow Google to index more interesting data that is not readily available on the Web. Having the ability to train an algorithm to act like human is a very ambitious activity, but it appears that the algorithm training has paid off.


I visited Google Translate and Google Language Tools recently and I am very impressed with their English to Chinese translation capability.


Unlike English, Chinese uses a defined set of characters. Where Latin languages generally create new meanings by the use of new words, the number of Chinese characters do not change. New meanings are created through the combination of the order of these characters. As such, while Chinese children are rarely able to read newspapers until they are graduating from primary school, there will be no more new words to learn after that. It's all pattern recognition after that part. It's a bit like iconography systems, where new meanings are created out of a predefined set of modifiers.


Despite the language's complexity, I witnessed that the Google Translator is able to handle English to Chinese text relatively easily, which is light years ahead of the translation tools I have used before, and it definitely makes me wonder what else Google Research is brewing inside their labs these days.


SML Copyright Notice


Copyright 2007 See-ming Lee 李思明 SML / SML Pro Blog / SML Universe. All rights reserved.

Sunday, August 19, 2007

Flickr Analytics / SML Analytics

No comments:

FlickrAnalytics.com


Objective.
  • Analyze the Flickr Intersestingness algorithm.

Methodology
  • Tagging and grouping top 20 images from the Popular-Views, Popular-Favorites and Popular-Comments pages on Flickr.

  • Compare results with images from the various sets via AND / OR operators.


Preliminary Analysis


Top Views = what drives users to click;


Related tags: top-v111 / top-v333 / top-v555 / top-v777 / top-v999 / top-v1111 / top-v2222 / top-v3333 / top-v4444 / top-v5555 / views-top20




Top Faves = what drives users to buy;

Related tags: favorites / favorites-5 / favorites-10 / favorites-15 / favorites-20 / favorites-25 / favorites-30 / favorites-35 / favorites-40 / favorites-45 / favorites-50 / favorites-55 / favorites-top20




Top Comments = what drives users to blog;

Related tags: comments-top20




All three galleries combined give you the winning ingredients for market success for any advertising campaigns. These sets, as such, double-duty as quick-visual reference for your next photoshoot.


If analyzing my own photographs give me this conclusion, I can only imagine the entire collection of images hosted on Flickr can provide.


Hypothesis: Top Interesting = Algorithm (Views, Favorites, Comments)


AND(Views, Favorites, Comments) / Flickr Analytics / SML (Set)
Thumbnails / Detail / Slideshow





I hypothesize that Yahoo is using these data to train an AI (artifical intelligence) algorithm to predict images that will be influential. (Related: see my blog post on Theorizing aesthetics). And if they aren't, I think that they should. Google literally dominates the text-ad market by indexing every single bit of text available to them, it would be smart for Yahoo to pick a different market segment and become the expert in it.



200 Most Interesting Images / Flickr Analytics / SML (Set)
Thumbnails / Detail / Slideshow





200 Most Interesting People / Flickr Analytics / SML (Set)
Thumbnails / Detail / Slideshow





200 Most Interesting Designs / Flickr Analytics / SML (Set)
Thumbnails / Detail / Slideshow





Notes


(1) Top 20 ranking fluctuates. As a result, it is possible for the Top-20 sets to have more than 20 photographs.


SML


SML = See-ming Lee = Design + Technology + Marketing Strategy;


SML Copyright Notice


Copyright 2007 See-ming Lee. All rights reserved.

Wednesday, July 11, 2007

Competitive intelligence = Know thyself + Know thy enemies

No comments:
Compete.com provides additional information that Google Analytics lack--your competitors' stats.

Would be nice if they have Google Finance's related news cross referencing feature but it's still pretty cool.

View the complete report to get to:
+ Visitors: people counts, ranks, visits
+ Engagement: attention, average stay, pages/visit
+ Growth: velocity

Here are some examples:

Google.com / Yahoo.com / MSN.com: (Complete report)


YouTube.com / MySpace.com / Facebook.com: (Complete report)


BBC.co.uk / NYTimes.com / WashingtonPost.com (Complete report)

Friday, July 6, 2007

Artificial Life / J. Craig Venter

No comments:
J. Craig Venter, the first scientist who figured out the complete human DNA sequence is at his final phase of creating the first free-living artificial organism by collecting deep-sea organisms last year. It is a bacteria with a few hundred genes. His firm, Synthetic Genomics, Inc will be creating synthetic bugs which produce Ethanol and Hydrogen. The potential benefits of biocomputers are huge, and can be used to create medication, fuels, cleans pollution and detect explosives. (Business Week 2007-06-25 / On The Brink Of Artificial Life / Craig Venter says success is near, but critics blast efforts to patent synthetic organisms)

This verifies The Economist's claim: "What physics was to the 20th century, biology will be to the 21st -- and RNA will be a vital part of it." (The Economist 2007-06-24 / The RNA revolution: Biology's Big Bang)

Related articles on the Web

Friday, June 8, 2007

Life is an RPG game

1 comment:

I never understood why people like RPG games, but recently I had a realization--because life is an RPG game. Let's look at the similarities between life and the role-playing gaming genre.

“Life is an RPG Game”   Some of my blog posts are really long so I have decided that I will now create #infographic for people don’t like to read. I help businesses communicate better daily so I thought that I should help myself also. :) #crazyisgood  Thi

“Life is an RPG Game” / SML.20070608.PHIL.20121224.Infographic

1. Exploration


In RPG, you start with a character in the middle of nowhere, surrounded by fog of war. You are unsure what your goal is, and you scout out + explore territories around you on the unexplored map to uncover tasks and missions until you find your ultimate goal.


In life, you were born somewhere on a little planet called Earth, unsure of your life's purpose, and you travel around to different places and examine different cultures, in an attempt to find reasons and purposes to make yourself useful to the world at large.


2. Attributes


When you start an RPG game, you typically start with some kind of points which you can assign to different specialties. If you don't know the game, you can either choose a specific character class or allow the AI to randomly generate one for you using equal amount of attributes.


In life, everybody gets the same amount of genes, where different combinations of these determine your character, charisma, physique and personality. They are not randomly assigned, and are governed by the laws of nature, which is highly dependent on the genetic make-up of your parents and ancestors.


3. Acquisition


In your journey as an RPG character, you explore dungeons, collect golds, acquire skills, find treasure items, fight dragons + demons along the way, and receive experience points for your various random tasks.


In life, you earn an income, acquire knowledge through education, discover useful gadgets and applicances that make your life more livable, conquer challenges and receive experience from every mundane and exciting interaction with the world around you.


4. Medication


In an RPG, there are many different kinds of magical potions. Some help you regain your health points, some enchant you with special abilities, some last for a long time and some give you short-term effects. Some create very positive impact on your character but will have a negative impact after its use.


If you find enough of these, they help you perform various tasks that your character does not normally possess. If you are not fortunate to find them but have enough gold, you can purchase them at a dealership in a nearby city.


In life, these magical potions exist in the form of medication. Some help you fight diseases, some help you sleep, some imbue you with special abilities that last for a short while until its effect dies out. Some have severe side effects if your body is not compatible with them. If you cannot find natural herbal substitutes, you can always pay your way and get it from a local pharmacy.


5. Specialization


Over time, you figure out what you're good at, and assign experience points to different lines of specialties, until you become a highly skilled fighter, wizard, druid, ranger, cleric or a combination of two or more of the above.


Good game engines like BioWare's Neverwinter Nights do not apply a lot of penalties to your decision to have different specialties. You are also not stuck with the character class that you originally picked.


When you past a certain point in life, you receive recognitions, honors and awards for your contribution to different communities in the form of degrees, publications, certificates of commendation and Nobel prizes.


Based on your experience, you decide to become a an artist, a banker, a designer, an engineer, an entrepreneur, an information architect, a professor, a public relations magnet, a scientist, a strategist or a writer. You can make a career out of a single category, but you can also choose to combine different skill-sets and work on multiple compentencies.


Life places some penalties if you decide to have multiple skills, as you have to work multiple-times as hard to keep track of the happenings among all the industries, but if you are willing to devote the time, you can certainly be successful and become an expert in all of them.


Midway through your life, if you decide that a particular profession is not right for you, you can choose to move onto something else. You will have to work hard to start from scratch, but you are certainly not tied to the decisions in your personal history.


6. Life + Death


In RPG, you try hard to maintain your health points, because if it dwindles beyond absolute zero, you will hit game-over, and you have to start all over again. You might not understand the whole purpose of the game even though you have spent nights and days trying to figure it out, but you stick along because the adventures you are going through are interesting enough and you are having fun.


In life, you aspire to live, because you are never really certain where you will be going after death. You are also not sure if you will really get a second chance. Things that happen around you are sometimes positive and sometimes negative, but they are often interesting enough to keep you going, and the negative impacts you pick up along your journey are negligible when placed against the big picture.


7. Relationships


In a MMORPG (massively multi-player online role playing game), game play gets a bit complex, because human players are much more complex than the AI which you might be able to figure out. If you could not, you can always cheat by getting the game guide.


Because of the added complexity, you have to be mindful of relationships with other characters and try hard to maintain healthy friendships. If your believes align with others, you can form guilds and conquer the universe together. You can also contribute your skills and services for others in return for favors or monetary exchange.


Life is full of its complexities, and you have to be mindful of not just human relationships, but also human-computer relationships and computer-computer interactions. Through your various conscious or subconscious decisions, you make friends and you gain enemies. Based on your career choices or interests, you form groups, clubs or societies based on your profession or your passion. You can volunteer your talents to charitable organizations, or you can sell them as services and create business entities.


Conclusion


When we examine the similarities, it becomes apparent that RPG is really a simulation of life. It has a D+D setting, but it bears no difference with simulation games like SimCity--a computer game which allows you to be the urban planner for a city. Many gaming industry experts doubt the success of The Sims by Will Wright when it was introduced, because they could not understand why anyone would want to live in a virtual reality of reality, but the fantabulous sales figures prove the critics wrong. If an RPG can do well because it simulates life, a game which simulates life can only do better.


The awareness of life simulation has also created real-life economy for some, who spend much of their time creating clothings, entertainment opportunities and all kinds of products and services to allow Sims to live a better life, not quite unlike folks who find and sell unique items from RPGs on eBay for a profit.


Will is currently working on his next big project called Spore. It is a MMORPG where participants advance their species from a single cell organism to a highly complex animal race through evolutionary mutation. After you reach your goal to conquer your planet, you then get to discover the nearby planets and eventually attempt to conquer the universe either through force or diplomacy.


It has received a lot of PR when it was first revealed at the E3 in 2005. You can find various video demos on YouTube charting its development, and I look forward to its release.