Jonathan Richards
Your last chance to get tickets to Top Gear Live
Jimmy Wales, the founder of Wikipedia, has said that just as internet users can contribute to articles on an open-source encyclopedia, so too will they be able to play a hand in the way the web is searched.
Mr Wales said that his open-source search engine, which will let users influence the ranking of search results, should be released by the end of the year. The engine will also allow users' computers to help crawl the hundreds of millions of pages on the web, indexing the content of each.
A key component of the architecture of Search Wikia, as the project is called, is now in place, Mr Wales said, enabling users to download a piece of software to let individual computers crawl a small section of the web.
The idea is that the combined power of thousands of small machines indexing the web could outweigh the searching ability of the vast, centralised crawlers that sit behind engines such as Google's and Yahoo!'s.
"When I opened Wikipedia with only three articles in it, it was a pretty bad encyclopedia," Mr Wales told the Washington Post. "That's where we're going to be in December with the search engine. We'll tell people upfront: 'It's not very good yet.' But we'll open it up to get feedback and community involvement to help us make it better."
Search Wikia would crawl the web more quickly and efficiently than a traditional engine, he said, but it would also offer opportunities, "at various points along the search process, for people to engage, join and participate in the construction of the search results."
Participating users might, for instance, be able to tag sites using keywords and links that would work in conjunction with traditional algorithms to 'map out' the web in a more human way.
The engine would also expose the workings of the algorithm it used to rank pages in the interests of "openness and transparency", Mr Wales said. Traditionally search engines have kept their algorithms secret.
Mr Wales told a conference of developers in Portland, Oregon, that Wikia, the start-up behind the project, has recently acquired Grub, a pioneering web crawler which would be opened up to the software community to make improvements.
LookSmart, the San Fransisco-based firm from which Wikia bought Grub, had agreed to deliver ads to Search Wikia when the engine launched, he said.
Not everyone has expressed enthusiasm for human-based search. Danny Sullivan, one of the editors of the 'Search Engine Land' blog, has said that a "human element" was crucial to the early success of Ask Jeeves, for instance, but that scaling quickly became a problem, and that "over time the machine has reigned supreme."
A comment on the Search Wikia blog said that an open-source search engine would be much more prone to abuse than a site such as Wikpedia, because the potential for for "bad guys" to exploit it for commercial gain was that much greater.
Smaller search engines that are struggling to compete with the larger providers should join the project, Mr Wales said. "A lot of second-tier players understand that competing with Google directly as independent proprietary projects, they'll never catch up," he said. "By banding together using open-source software, they can effectively compete with Google and improve their services."
Wikipedia, which was co-founded by Mr Wales, is operated by the Wikimedia Foundation, a charitable organisation. The search engine 'Search Wikia' is being launched by Wikia, a private company unrelated to Wikimedia which was set up by Mr Wales in 2004.
Explore your passion for food with the delights of Thai, Indian & Chinese cooking
In our new series, Tony Hawks takes a dry, wry look at modern life - junk mail, interminable meetings and snooty sales assistants
Read the training tips and advice that helped our London Triathletes
Read our exclusive 100 Years of Fleming and Bond interactive timeline, packed with original Times articles and reviews
The latest travel news plus the best hotels and gadgets for business travellers
Shortcuts to help you find sections and articles
2007
£30,000
2006
£14,337
2008
£39,937
Great car insurance deals online
c.£75,000
GlosFirstmeansbusiness
Gloucestershire
£32,795 - £41,545
Universitry of Southampton
Southampton
£
£32,795 - £41,545
Universitry of Southampton
Southampton
Competitive Package
Npower
West Midlands
Some of the finest Apts & Penthouses
Across London
Great Investment, River Views
Luxury properties within exclusive development in
Chislehurst Kent
A new experience in Luxury Living
Multi–Centre
from Only £829pp
With Ramblers Worldwide Holidays!
£POA
List your property with two leading travel websites
£POA
Great travel insurance deals online
Contact our advertising team for advertising and sponsorship in Times Online, The Times and The Sunday Times. Globrix Property Search - search houses for sale and rooms and property to rent in the UK. Milkround Job Search - for graduate careers in the UK. Visit our classified services and find jobs, used cars, property or holidays. Use our dating service, read our births, marriages and deaths announcements, or place your advertisement.
Copyright 2008 Times Newspapers Ltd.
This service is provided on Times Newspapers' standard Terms and Conditions. Please read our Privacy Policy.To inquire about a licence to reproduce material from Times Online, The Times or The Sunday Times, click here.This website is published by a member of the News International Group. News International Limited, 1 Virginia St, London E98 1XY, is the holding company for the News International group and is registered in England No 81701. VAT number GB 243 8054 69.
One report on this suggested that to keep hardware costs down, they were planning to invite members of the public to run parts of their web crawler on their own PCs. What an excellent way to expose large numbers of people to drive-by malware attacks! Especially if, as there will be, there are security vulnerabilities in the web crawler software itself.
Ian Kemmish, Biggleswade, UK
This might either be the start of a third generation of search engines, or a great white elephant. I rather hope that will be the former.
James E. Petts, Burnham, England